-- Logs begin at Thu 2022-09-08 15:27:53 UTC, end at Thu 2022-09-08 16:37:33 UTC. -- Sep 08 15:57:55.408502 dv-cinder-856259-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 08 15:57:55.419453 dv-cinder-856259-2-smb devstack@keystone.service[81683]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 15:57:55 2022] *** Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: nodename: dv-cinder-856259-2-smb Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: machine: x86_64 Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: clock source: unix Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: pcre jit disabled Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: detected number of CPU cores: 4 Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: current working directory: / Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: detected binary path: /usr/bin/uwsgi-core Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: your processes number limit is 47680 Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: your memory page size is 4096 bytes Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: detected max file descriptor number: 2048 Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: lock engine: pthread robust mutexes Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: thunder lock: enabled Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 08 15:57:55.422176 dv-cinder-856259-2-smb devstack@keystone.service[81683]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 15:57:55.461121 dv-cinder-856259-2-smb devstack@keystone.service[81683]: Python main interpreter initialized at 0x55f6157bb9c0 Sep 08 15:57:55.461121 dv-cinder-856259-2-smb devstack@keystone.service[81683]: python threads support enabled Sep 08 15:57:55.461121 dv-cinder-856259-2-smb devstack@keystone.service[81683]: your server socket listen backlog is limited to 100 connections Sep 08 15:57:55.461121 dv-cinder-856259-2-smb devstack@keystone.service[81683]: your mercy for graceful operations on workers is 90 seconds Sep 08 15:57:55.461450 dv-cinder-856259-2-smb devstack@keystone.service[81683]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 15:57:55.461533 dv-cinder-856259-2-smb devstack@keystone.service[81683]: *** Operational MODE: preforking *** Sep 08 15:57:55.461804 dv-cinder-856259-2-smb devstack@keystone.service[81683]: *** uWSGI is running in multiple interpreter mode *** Sep 08 15:57:55.461804 dv-cinder-856259-2-smb devstack@keystone.service[81683]: spawned uWSGI master process (pid: 81683) Sep 08 15:57:55.461998 dv-cinder-856259-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 08 15:57:55.463107 dv-cinder-856259-2-smb devstack@keystone.service[81683]: spawned uWSGI worker 1 (pid: 81695, cores: 1) Sep 08 15:57:55.463107 dv-cinder-856259-2-smb devstack@keystone.service[81683]: spawned uWSGI worker 2 (pid: 81696, cores: 1) Sep 08 15:57:55.463107 dv-cinder-856259-2-smb devstack@keystone.service[81683]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 15:57:59.802774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 15:57:59.802774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: from cryptography.utils import int_from_bytes Sep 08 15:57:59.803603 dv-cinder-856259-2-smb devstack@keystone.service[81696]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 15:57:59.803603 dv-cinder-856259-2-smb devstack@keystone.service[81696]: from cryptography.utils import int_from_bytes Sep 08 15:57:59.808376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 15:57:59.808376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: from cryptography.utils import int_from_bytes Sep 08 15:57:59.808826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 15:57:59.808826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: from cryptography.utils import int_from_bytes Sep 08 15:57:59.858860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 15:57:59.859064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 15:57:59.859224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] command line args: [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 15:57:59.859388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 15:57:59.859479 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 15:57:59.859587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 15:57:59.859666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ================================================================================ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 15:57:59.859784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] command line args: [] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 15:57:59.859876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] admin_token = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.860054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 15:57:59.860141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config_dir = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.860235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ================================================================================ {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 15:57:59.860319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.860448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config_source = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.860533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] admin_token = **** {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.860611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] debug = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.860726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] config_dir = [] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.860825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.861078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.861078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] config_source = [] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.861203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.861263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] debug = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.861320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.861458 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.861606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.861711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.861812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.861909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.862016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.862121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.862228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_config_append = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.862323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.862430 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.862525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_dir = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.862617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] list_limit = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.862741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.863521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] log_config_append = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.863521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.863752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.863834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] log_dir = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.863951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.864026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] log_file = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.864153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.864235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.864312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.864437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.864513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.864640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.864723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.864802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.864919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.865001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.865079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.865209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.865292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.865364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.865478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.865583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.865674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.865820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.865904 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.866043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.866159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.866280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.866384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.866535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.866629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.866782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.867033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.867142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.867313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.867394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] publish_errors = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.867544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.867775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.867902 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.868018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.868136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] publish_errors = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.868257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.868428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.868544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.868662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.868662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.868893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] standard_threads = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.869004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.869178 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.869291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.869404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.869516 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] standard_threads = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.869628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.869628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_journal = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.869855 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.869970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_json = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.870088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.870202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_stderr = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.870315 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.870439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_syslog = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.870554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] use_journal = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.870685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.870814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] use_json = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.870814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] use_stderr = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.871041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.871185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] use_syslog = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.871305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.871419 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:57:59.871531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.871643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.871841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.871958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.872077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.872191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.872302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.872415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.872539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.872644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.872761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.872875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.872987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.873105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.873227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.873341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.873454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.873572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.873692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.873692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.873915 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.874030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.874146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.874259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.874371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.874500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.874627 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.874758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.874871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.874983 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.875096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.875207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.875331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.875447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.875567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.875681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.875792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.875910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.876032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.876153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.876273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.876386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.876498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.876617 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.876748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.876863 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.876975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.877087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.877205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.877318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.877505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.877621 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.877735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.877847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.877966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.878080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.878201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.878315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.878434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.878547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.878659 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.878789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.878914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.879019 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.879136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.879250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.879369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.879494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.879609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.879722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.879834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.879947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.880058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.880181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.880295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.880408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.880526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.880640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.880748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.880852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.880954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.881050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.881144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.881243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.881371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.881483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.881594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.881691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.881786 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.881890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.881985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.882088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.882198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.882301 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.882397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.882491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.882598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.882760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.882873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.882977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.883088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.883204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.883308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.883426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.883549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.883673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.883787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.883938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.884062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.884182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.884305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.884419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.884532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.884652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.884766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.884886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.885041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.885160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.885273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.885385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.885506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.885622 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.885734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.885855 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.885976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.886112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.886229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.886354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.886470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.886592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.886730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.886730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.886947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.887068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.887223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.887341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.887455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.887575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.887690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.887804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.887916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.888038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.888155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.888268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.888380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.888494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.888607 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.888797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.888914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.889028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.889141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.889255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.889375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.889502 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.889618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.889732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.889845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.889959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.890080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.890205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.890334 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.890450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.890570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.890726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.890844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.890958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.891085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.891202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.891318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.891431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.891586 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.891704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.891827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.891943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.892057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.892171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.892284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.892399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.892524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.892641 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.892754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.892867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.892980 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.893093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.893215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.893215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.893510 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.893629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.893743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.893856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.893978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.894105 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.894221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.894334 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.894711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.894828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.894955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.894955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.895170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.895283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.895397 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.895511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.895637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.895753 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.895866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.895979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.896099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.896214 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.896336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.896459 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.896575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.external = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.896575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.896825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.896825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.897042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.897158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] auth.external = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.897271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.897375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.897489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.password = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.897489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.token = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.897705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.897828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.897945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.898058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.898173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] auth.password = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.898286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.898400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] auth.token = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.898521 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.898639 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.898795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.898911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.899036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.899152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.899278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.899402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.899518 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.899644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.899762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.899877 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.899999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.900116 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.900230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.900345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] credential.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.900458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.900572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.900694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.900811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.900926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.901047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.901162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.901277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.901398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.901515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.901629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.901744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.901865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.901982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.902109 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.902226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.902341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.902462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.902577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.902707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.902902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.903028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.903143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.903240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.903335 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.903431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.903535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.903632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.903728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.903823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.903919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.904027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] federation.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.904132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.904230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.904325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.904420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.904515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.904609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.904713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.904811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.904906 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.905001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.905097 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.905200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.905307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.905405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.905500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.905602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.905699 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.905794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.905897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.905996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.906098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.906193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.906287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.906382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.906492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.906590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.906746 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.906865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.906980 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.907095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.907225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.907343 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.907457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.907571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.907685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.907807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.907923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.908039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.908153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.908153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.908367 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.908489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.908606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.908720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.908835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.908835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.909048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.909179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.909296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.909412 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.909527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.910152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.910310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.910439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.910557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.910687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.910805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.910919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.911034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.911034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.911267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.911381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.911495 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.911610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.911724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.911846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.911963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.912078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.912192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.912307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.912421 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.912544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.912661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.912776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.912890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.913004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.913119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.913241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.913359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.913474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.913589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.913703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.913817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.913943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.914060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.914174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.914288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.914403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.914517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.914640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.914801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.914916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.915031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.915145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.915259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.915387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.915505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.915505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.915719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.915833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.915947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.916070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.916186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.916301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.916415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.916415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.916630 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.916752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.916868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.916982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.917096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.917210 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.917324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.917446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.917572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.917689 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.917803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.917916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.918030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.918153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.918269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.918383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.918497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.918611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.918740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.918868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.918985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.919098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.919212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.919326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.919326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.919548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.919672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.919788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.919902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.920016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.920207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.920327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.920431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.920544 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.920660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.920799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.920922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.921038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.921152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.921266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.921380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.921494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.921615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.921732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.921846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.921960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.922073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.922187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.922309 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.922427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.922541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.922655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.922823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.922939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.923065 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.923183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.923297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.923412 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.923525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.923639 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.923761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.923883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.923998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.924113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.924227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.924342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.924342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.924567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.924682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.924796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.924911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.925025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.925212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.925920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.926042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.926157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.926271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.926386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.926509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.926617 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.926741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.926841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.926938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.927034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.929405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.929528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.929605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.929678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.929750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.929821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.929901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.929975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] resource.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930564 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.930933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931753 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] role.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.931981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] role.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932430 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.932939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.933949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.934023 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.934095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.934314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.934417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.934547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.934660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.934824 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.934936 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.935075 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.935192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.935311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.935449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.935530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.935727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.935806 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.935984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.936108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.936242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.936327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.936493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.936572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.936733 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.936811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.936964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.937044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.937197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.937276 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.937425 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.937505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.937659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.937741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.937891 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.937970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.938137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.938224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.938370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.938450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.938612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.938716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.938888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.938980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.939124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.939203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] token.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.939378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.939476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.939604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.939693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.939849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.939929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.940081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.940160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.940315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.940402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.940547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.940626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.940793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.940881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.941156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.941244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.941386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.941474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.941632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.941767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.941884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.941999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.942115 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.942240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.942358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.942474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.942589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.942751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.942870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.943003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.943133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.943250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.943366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.943480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.943594 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.943710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.connection = **** {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.943834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.943951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.944067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.944183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.944298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.944413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.944598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.944717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.944834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.944949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.945064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.945179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.945302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.945420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.945535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.945650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.945765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.945882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.946005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.946122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.946236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.946351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.946465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.946580 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.946722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 15:57:59.946843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.946843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.947059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.947266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.947554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.947785 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:57:59.947962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 15:57:59.981125 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:57:59.981352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:57:59.981577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:57:59.981735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:57:59.981973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:57:59.982203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:57:59.990636 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:57:59.992202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.019012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.019245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.020350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.020585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.077428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.077664 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.126496 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.126752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.127650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.127888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.287473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.287712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.287810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.287889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.287964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.288038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.288122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.288249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.288333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.288467 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.288549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.288684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.315410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.315523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.315645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.315729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.315871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.315972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.316096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.316179 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.316318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.316401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.316535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.316619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.316749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.316830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.327929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.328175 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.341044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.341280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.341501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.341582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.341722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.341820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.341939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.342022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.342154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.342235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.342372 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.342452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81696) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.342590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.342832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 15:58:00.359555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.359766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 15:58:00.360014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.360098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.360223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 15:58:00.360322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 15:58:00.360563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.360654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.360776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 15:58:00.360857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.361047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.361128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.361305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.361386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.361563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.361818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.370952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.371231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.371365 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.371503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.371641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.371815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.371966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.372244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.378743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.379264 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.381617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.381905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.382124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.382207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.382406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.382485 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.382739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.382831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.383027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.383119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.383305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.383385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.383563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.383651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.383828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.383909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.384094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.384174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.384358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.384447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.384628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.384893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.407770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.408274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.409253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.409551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.410280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.410566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.414871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.415159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.415281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.415442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.415566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.415847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.421865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.422480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.422549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.422549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.427911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.428208 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.428465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.428674 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.428819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.428907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.429033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.429119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.429312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.429398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.429585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.429666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.429857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.429941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.430128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.430402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.445207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.445486 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.445937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.446213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.449285 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.450045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.452482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.452785 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.453314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.453610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.457494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.458418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.460587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.461638 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.463838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.464138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.464427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.464714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.465002 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.465082 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.465302 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.465383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.465590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.465876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.466163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.466461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.481612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.481905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.482175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.482439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.482807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.483095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.483361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.483620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.489320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.490438 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.490901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.492052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.492428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.492708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.493558 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.493833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.495465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.495754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.496043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.496335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.496602 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.496721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.496893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.497180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.497464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.497889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.507894 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.508182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.508468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.508754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.509091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.509220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.509375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.509461 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.509685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.509814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.509962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.510333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.510627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.510936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.525785 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.527196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.528722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.530073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.531628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.533003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.533143 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.534523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.535241 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.535471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.535872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.536621 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.536898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.537290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.542226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.543676 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.543820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.545111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.546591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.547020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.547312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.547591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.547977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.548373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.548696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.548970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.555440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.555740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.556035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.556790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.557081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.557358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.562925 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81696) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.563211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.563494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.563775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.564050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.564324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.564453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 15:58:00.564592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.564724 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.564854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.564981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.565110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.565248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.565381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.565538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.565713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.566326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.566583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.566697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.566777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.566851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.566998 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81696) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.567080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.572046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.572046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.572046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.572046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.572046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 15:58:00.606359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f6157bb9c0 pid: 81696 (default app) Sep 08 15:58:00.606476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f6157bb9c0 pid: 81695 (default app) Sep 08 15:58:00.606555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8604b-d889-4fc8-989a-e5ac04388bdc None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:00.606555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8604b-d889-4fc8-989a-e5ac04388bdc None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:00.606555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8604b-d889-4fc8-989a-e5ac04388bdc None None] PATH_INFO: `/v3` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:00.609450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Thu Sep 8 15:58:00 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:08.288295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d3da8-8b86-4442-a675-e10f3758f4a8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:08.288821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d3da8-8b86-4442-a675-e10f3758f4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:08.288954 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d3da8-8b86-4442-a675-e10f3758f4a8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:08.293246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:58:08.298691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78112a1-2ef8-4c64-912e-9e739ddcfd27 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:08.299129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78112a1-2ef8-4c64-912e-9e739ddcfd27 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:08.299223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78112a1-2ef8-4c64-912e-9e739ddcfd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:08.381393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: INFO dbcounter [None req-b78112a1-2ef8-4c64-912e-9e739ddcfd27 None None] Registered counter for database keystone Sep 08 15:58:08.401081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG oslo_db.sqlalchemy.engines [None req-b78112a1-2ef8-4c64-912e-9e739ddcfd27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 15:58:08.407180 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writer thread running {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 15:58:08.587320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG passlib.handlers.bcrypt [None req-b78112a1-2ef8-4c64-912e-9e739ddcfd27 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81696) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 15:58:08.587629 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG passlib.handlers.bcrypt [None req-b78112a1-2ef8-4c64-912e-9e739ddcfd27 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81696) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 15:58:08.645475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b78112a1-2ef8-4c64-912e-9e739ddcfd27 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:08.647103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b78112a1-2ef8-4c64-912e-9e739ddcfd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:08.797530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 08 15:58:09.275853 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d3da8-8b86-4442-a675-e10f3758f4a8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:09.344467 dv-cinder-856259-2-smb devstack@keystone.service[81695]: INFO dbcounter [None req-fb4d3da8-8b86-4442-a675-e10f3758f4a8 None None] Registered counter for database keystone Sep 08 15:58:09.366429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG oslo_db.sqlalchemy.engines [None req-fb4d3da8-8b86-4442-a675-e10f3758f4a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 15:58:09.372712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writer thread running {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 15:58:09.492774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d3da8-8b86-4442-a675-e10f3758f4a8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:09.497091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a27d0-ee4b-45a6-a68e-3d070908be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:09.497712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a27d0-ee4b-45a6-a68e-3d070908be05 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:09.497992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a27d0-ee4b-45a6-a68e-3d070908be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:09.498263 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a27d0-ee4b-45a6-a68e-3d070908be05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:09.506522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a27d0-ee4b-45a6-a68e-3d070908be05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:09.558444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: WARNING keystone.common.rbac_enforcer.enforcer [None req-726a27d0-ee4b-45a6-a68e-3d070908be05 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 15:58:09.558764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a27d0-ee4b-45a6-a68e-3d070908be05 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:09.568546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Sep 8 15:58:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 15:58:09.574543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78112a1-2ef8-4c64-912e-9e739ddcfd27 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:09.592841 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78112a1-2ef8-4c64-912e-9e739ddcfd27 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:09.597308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f9fd2-f7e8-4d7e-ab12-4c5b6c0eb6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:09.598428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9fd2-f7e8-4d7e-ab12-4c5b6c0eb6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:09.598747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9fd2-f7e8-4d7e-ab12-4c5b6c0eb6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:09.599025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9fd2-f7e8-4d7e-ab12-4c5b6c0eb6a7 admin admin] PATH_INFO: `/v3/projects/2058312f3bcf45699a154a422ba5b605` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:09.600645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f9fd2-f7e8-4d7e-ab12-4c5b6c0eb6a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=2058312f3bcf45699a154a422ba5b605)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:09.653310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: WARNING keystone.common.rbac_enforcer.enforcer [None req-aa1f9fd2-f7e8-4d7e-ab12-4c5b6c0eb6a7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 15:58:09.653655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f9fd2-f7e8-4d7e-ab12-4c5b6c0eb6a7 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:09.658257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Sep 8 15:58:09 2022] GET /identity/v3/projects/2058312f3bcf45699a154a422ba5b605 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:11.791643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43edb96-57d2-4eb3-8de7-ce6b96741984 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:11.792151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43edb96-57d2-4eb3-8de7-ce6b96741984 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:11.792235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43edb96-57d2-4eb3-8de7-ce6b96741984 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:11.796296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:11.801737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592fd7a-2e35-4b4f-8392-9554da122861 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:11.802184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592fd7a-2e35-4b4f-8392-9554da122861 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:11.802271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592fd7a-2e35-4b4f-8392-9554da122861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:11.822416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-d592fd7a-2e35-4b4f-8392-9554da122861 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:11.823975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d592fd7a-2e35-4b4f-8392-9554da122861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:11.832277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 08 15:58:12.102243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43edb96-57d2-4eb3-8de7-ce6b96741984 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:12.114183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43edb96-57d2-4eb3-8de7-ce6b96741984 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:12.118398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638f8d8-402c-4bdc-b4d6-44a55f8dbde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:12.119018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638f8d8-402c-4bdc-b4d6-44a55f8dbde0 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:12.119292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638f8d8-402c-4bdc-b4d6-44a55f8dbde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:12.119562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638f8d8-402c-4bdc-b4d6-44a55f8dbde0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:12.127045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638f8d8-402c-4bdc-b4d6-44a55f8dbde0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:12.129334 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638f8d8-402c-4bdc-b4d6-44a55f8dbde0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:12.137928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Sep 8 15:58:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 15:58:12.143103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592fd7a-2e35-4b4f-8392-9554da122861 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:12.153002 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592fd7a-2e35-4b4f-8392-9554da122861 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:12.157368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddd3ea-00af-41c4-b497-3eb8b8a7a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:12.157988 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddd3ea-00af-41c4-b497-3eb8b8a7a184 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:12.158267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddd3ea-00af-41c4-b497-3eb8b8a7a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:12.158541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddd3ea-00af-41c4-b497-3eb8b8a7a184 admin admin] PATH_INFO: `/v3/users/36773b7875fb4147ba998e41ff5a8fe9` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:12.159913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddd3ea-00af-41c4-b497-3eb8b8a7a184 admin admin] RBAC: Authorizing `identity:get_user(user_id=36773b7875fb4147ba998e41ff5a8fe9)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:12.161738 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddd3ea-00af-41c4-b497-3eb8b8a7a184 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:12.163293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Sep 8 15:58:12 2022] GET /identity/v3/users/36773b7875fb4147ba998e41ff5a8fe9 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:14.381875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14cd2-10cc-4f2e-8aca-c47de9ae282a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:14.382391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14cd2-10cc-4f2e-8aca-c47de9ae282a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:14.382391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14cd2-10cc-4f2e-8aca-c47de9ae282a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:14.383758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:14.388911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb234d-09b7-4719-9c10-ede4ca19c5fa None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:14.389342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb234d-09b7-4719-9c10-ede4ca19c5fa None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:14.389465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb234d-09b7-4719-9c10-ede4ca19c5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:14.407575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-cdfb234d-09b7-4719-9c10-ede4ca19c5fa None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:14.409267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-cdfb234d-09b7-4719-9c10-ede4ca19c5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:14.442491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6b617-9b9a-4185-8a24-ae048c7b3932 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:14.442807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6b617-9b9a-4185-8a24-ae048c7b3932 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:14.443084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6b617-9b9a-4185-8a24-ae048c7b3932 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:14.444390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:58:14.450029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1a650-f580-4bda-9bb4-7c1eacce1abe None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:14.450327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1a650-f580-4bda-9bb4-7c1eacce1abe None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:14.450598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1a650-f580-4bda-9bb4-7c1eacce1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:14.492709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:14.493430 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG passlib.handlers.bcrypt [None req-66d1a650-f580-4bda-9bb4-7c1eacce1abe None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81695) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 15:58:14.493827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG passlib.handlers.bcrypt [None req-66d1a650-f580-4bda-9bb4-7c1eacce1abe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81695) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 15:58:14.543584 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-66d1a650-f580-4bda-9bb4-7c1eacce1abe None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:14.545166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-66d1a650-f580-4bda-9bb4-7c1eacce1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:14.644043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:58:14.759405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb234d-09b7-4719-9c10-ede4ca19c5fa None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:14.785671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:14.862518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb234d-09b7-4719-9c10-ede4ca19c5fa None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:14.898240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ea3a9-2ebc-4c73-9345-28f94b221036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:14.898860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea3a9-2ebc-4c73-9345-28f94b221036 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:14.899141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea3a9-2ebc-4c73-9345-28f94b221036 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:14.899416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ea3a9-2ebc-4c73-9345-28f94b221036 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:14.910220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1a650-f580-4bda-9bb4-7c1eacce1abe None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:14.910954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ea3a9-2ebc-4c73-9345-28f94b221036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-019ea3a9-2ebc-4c73-9345-28f94b221036 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:14.919487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:14.920402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:14.921242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:58:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:14.926348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ea3a9-2ebc-4c73-9345-28f94b221036 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:15.006736 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:15.011469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1a650-f580-4bda-9bb4-7c1eacce1abe None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:15.013773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:15.024968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ea3a9-2ebc-4c73-9345-28f94b221036 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:15.049117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e38e1-a95e-4808-9616-cb9d1817ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:15.050004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e38e1-a95e-4808-9616-cb9d1817ecea None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:15.050286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e38e1-a95e-4808-9616-cb9d1817ecea None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:15.050560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e38e1-a95e-4808-9616-cb9d1817ecea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:15.058232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e98e0-43de-488a-b008-9374132c60f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:15.058868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e98e0-43de-488a-b008-9374132c60f5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:15.059154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e98e0-43de-488a-b008-9374132c60f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:15.059422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e98e0-43de-488a-b008-9374132c60f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:15.060077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e98e0-43de-488a-b008-9374132c60f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:15.060375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e98e0-43de-488a-b008-9374132c60f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:15.061767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e98e0-43de-488a-b008-9374132c60f5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:15.073654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:15.079197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e98e0-43de-488a-b008-9374132c60f5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:15.117817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e38e1-a95e-4808-9616-cb9d1817ecea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:15.119370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e38e1-a95e-4808-9616-cb9d1817ecea None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:15.176411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e98e0-43de-488a-b008-9374132c60f5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:15.209184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba31e9-4199-4100-b8fc-4b9a725a83da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:15.209801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba31e9-4199-4100-b8fc-4b9a725a83da None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:15.210079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba31e9-4199-4100-b8fc-4b9a725a83da None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:15.210351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba31e9-4199-4100-b8fc-4b9a725a83da None admin] PATH_INFO: `/v3/users/36773b7875fb4147ba998e41ff5a8fe9` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:15.211520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba31e9-4199-4100-b8fc-4b9a725a83da None admin] RBAC: Authorizing `identity:get_user(user_id=36773b7875fb4147ba998e41ff5a8fe9)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:15.212967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba31e9-4199-4100-b8fc-4b9a725a83da None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:15.214525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 9/16] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:15 2022] GET /identity/v3/users/36773b7875fb4147ba998e41ff5a8fe9 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:15.215104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 8/17] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 15:58:15.219777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba31e9-4199-4100-b8fc-4b9a725a83da None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:15.220598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e38e1-a95e-4808-9616-cb9d1817ecea None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:15.223412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:15.234408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:15.317126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e38e1-a95e-4808-9616-cb9d1817ecea None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:15.319358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba31e9-4199-4100-b8fc-4b9a725a83da None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:15.350101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39e3a1-a9ab-496a-b557-c063d55d275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:15.350971 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e3a1-a9ab-496a-b557-c063d55d275c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:15.351247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e3a1-a9ab-496a-b557-c063d55d275c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:15.351514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e3a1-a9ab-496a-b557-c063d55d275c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:15.352228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108795c7-e251-4253-9e72-6fa5431b1302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:15.352848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108795c7-e251-4253-9e72-6fa5431b1302 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:15.353124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108795c7-e251-4253-9e72-6fa5431b1302 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:15.353393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108795c7-e251-4253-9e72-6fa5431b1302 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:15.354491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108795c7-e251-4253-9e72-6fa5431b1302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:15.355958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108795c7-e251-4253-9e72-6fa5431b1302 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:15.357500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:15.363820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108795c7-e251-4253-9e72-6fa5431b1302 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:15.370270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39e3a1-a9ab-496a-b557-c063d55d275c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:15.371782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39e3a1-a9ab-496a-b557-c063d55d275c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-cb39e3a1-a9ab-496a-b557-c063d55d275c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:58:15.390799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:15.392214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:58:15.393044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:58:15.393044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:58:15.393044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:15.393044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:58:15.397889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39e3a1-a9ab-496a-b557-c063d55d275c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:15.448289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:15.454054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:15.466797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108795c7-e251-4253-9e72-6fa5431b1302 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:15.498113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39e3a1-a9ab-496a-b557-c063d55d275c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:15.501529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62015581-7069-4245-8099-87b4c73b3cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:15.502134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015581-7069-4245-8099-87b4c73b3cca None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:15.503057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015581-7069-4245-8099-87b4c73b3cca None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:15.503355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015581-7069-4245-8099-87b4c73b3cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:15.504080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62015581-7069-4245-8099-87b4c73b3cca None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.domain.id=default, user.id=36773b7875fb4147ba998e41ff5a8fe9) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:15.504383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62015581-7069-4245-8099-87b4c73b3cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:15.505835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62015581-7069-4245-8099-87b4c73b3cca None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:15.512538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Thu Sep 8 15:58:15 2022] GET /identity/v3/role_assignments?user.id=36773b7875fb4147ba998e41ff5a8fe9&scope.domain.id=default&role.id=519b356d36364663a59265dc7eeff0b8 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:15.534794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd9d22-06d4-48f6-952b-dc1834591f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:15.535472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd9d22-06d4-48f6-952b-dc1834591f06 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:15.535757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd9d22-06d4-48f6-952b-dc1834591f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:15.536031 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd9d22-06d4-48f6-952b-dc1834591f06 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:15.536694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd9d22-06d4-48f6-952b-dc1834591f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:15.537000 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd9d22-06d4-48f6-952b-dc1834591f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:15.538439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd9d22-06d4-48f6-952b-dc1834591f06 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:15.558659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:17.866479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b515-c6e1-4e4b-958d-755fc3da2821 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:17.867032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b515-c6e1-4e4b-958d-755fc3da2821 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:17.867032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0b515-c6e1-4e4b-958d-755fc3da2821 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:17.868451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:17.874226 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1885d2-c6c8-471c-b720-f10c3e32771d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:17.874620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1885d2-c6c8-471c-b720-f10c3e32771d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:17.879277 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1885d2-c6c8-471c-b720-f10c3e32771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:17.904037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1e1885d2-c6c8-471c-b720-f10c3e32771d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:17.905304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1e1885d2-c6c8-471c-b720-f10c3e32771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:17.999905 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:18.102966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50833eaa-645e-4283-9e5e-ec69d1f33594 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:18.103578 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50833eaa-645e-4283-9e5e-ec69d1f33594 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:18.104125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50833eaa-645e-4283-9e5e-ec69d1f33594 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:18.105718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:58:18.111846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64debf1-31ea-4514-937d-bc379befcdee None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:18.112133 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64debf1-31ea-4514-937d-bc379befcdee None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:18.114036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64debf1-31ea-4514-937d-bc379befcdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:18.135492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a64debf1-31ea-4514-937d-bc379befcdee None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:18.143449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a64debf1-31ea-4514-937d-bc379befcdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:18.199047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:18.228276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 12/25] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:18.321238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9056349-8f19-4134-81dc-8412d9d9c697 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:18.321574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9056349-8f19-4134-81dc-8412d9d9c697 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:18.321831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9056349-8f19-4134-81dc-8412d9d9c697 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:18.323213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 14/26] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:18.328756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f356f5d-9f17-4b2b-917c-013558ce1b35 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:18.329045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f356f5d-9f17-4b2b-917c-013558ce1b35 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:18.329457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f356f5d-9f17-4b2b-917c-013558ce1b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:18.351300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5f356f5d-9f17-4b2b-917c-013558ce1b35 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:18.352494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5f356f5d-9f17-4b2b-917c-013558ce1b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:18.426225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9056349-8f19-4134-81dc-8412d9d9c697 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:18.477917 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 13/27] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:18.583346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9056349-8f19-4134-81dc-8412d9d9c697 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:18.605733 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f356f5d-9f17-4b2b-917c-013558ce1b35 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:18.655382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af218cc-ec00-496a-803b-e1f6c10ff765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:18.656016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af218cc-ec00-496a-803b-e1f6c10ff765 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:18.656288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af218cc-ec00-496a-803b-e1f6c10ff765 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:18.656556 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af218cc-ec00-496a-803b-e1f6c10ff765 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:18.690061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af218cc-ec00-496a-803b-e1f6c10ff765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-0af218cc-ec00-496a-803b-e1f6c10ff765 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:18.695215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:18.696036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:18.696804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 15/28] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:58:18.702175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af218cc-ec00-496a-803b-e1f6c10ff765 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:18.708510 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:18.817625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f356f5d-9f17-4b2b-917c-013558ce1b35 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:18.834698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:18.892709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dadd3-bb0e-4369-a8f6-f752ed0172d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:18.894547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dadd3-bb0e-4369-a8f6-f752ed0172d3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:18.895133 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dadd3-bb0e-4369-a8f6-f752ed0172d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:18.895601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dadd3-bb0e-4369-a8f6-f752ed0172d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:18.915413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dadd3-bb0e-4369-a8f6-f752ed0172d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:18.917406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dadd3-bb0e-4369-a8f6-f752ed0172d3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:18.919518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af218cc-ec00-496a-803b-e1f6c10ff765 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ae2dadd3-bb0e-4369-a8f6-f752ed0172d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:58:18.946039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:18.947192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:58:18.948014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:58:18.948014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:58:18.948014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:18.951444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 14/29] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:58:18.952045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dadd3-bb0e-4369-a8f6-f752ed0172d3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:18.974147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ec5d-5015-49ef-9513-9bbaebe8e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:18.975151 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ec5d-5015-49ef-9513-9bbaebe8e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:18.975630 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ec5d-5015-49ef-9513-9bbaebe8e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:18.976119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ec5d-5015-49ef-9513-9bbaebe8e2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:18.977076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863ec5d-5015-49ef-9513-9bbaebe8e2c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:18.977597 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863ec5d-5015-49ef-9513-9bbaebe8e2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:18.979874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863ec5d-5015-49ef-9513-9bbaebe8e2c7 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:18.996890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 16/30] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:19.000945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ec5d-5015-49ef-9513-9bbaebe8e2c7 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:19.075198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:19.101725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dadd3-bb0e-4369-a8f6-f752ed0172d3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:19.113854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ec5d-5015-49ef-9513-9bbaebe8e2c7 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:19.145179 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e368fc-16d4-436d-acf4-30467e54348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:19.146379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e368fc-16d4-436d-acf4-30467e54348a None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:19.147205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e368fc-16d4-436d-acf4-30467e54348a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:19.147969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e368fc-16d4-436d-acf4-30467e54348a None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:19.149006 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e368fc-16d4-436d-acf4-30467e54348a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:19.151221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e368fc-16d4-436d-acf4-30467e54348a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:19.154284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afee926-ac00-4b33-aa5c-82ba1e1c78cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:19.154940 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afee926-ac00-4b33-aa5c-82ba1e1c78cb None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:19.155220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afee926-ac00-4b33-aa5c-82ba1e1c78cb None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:19.155493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afee926-ac00-4b33-aa5c-82ba1e1c78cb None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:19.156307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afee926-ac00-4b33-aa5c-82ba1e1c78cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:19.156623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afee926-ac00-4b33-aa5c-82ba1e1c78cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:19.158016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afee926-ac00-4b33-aa5c-82ba1e1c78cb None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:19.178790 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 17/31] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:19.179473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afee926-ac00-4b33-aa5c-82ba1e1c78cb None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:19.292668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afee926-ac00-4b33-aa5c-82ba1e1c78cb None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:19.320788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:19.329873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f70cc-b6e3-449d-9ec0-c8182a5d3e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:19.338094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f70cc-b6e3-449d-9ec0-c8182a5d3e70 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:19.338094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f70cc-b6e3-449d-9ec0-c8182a5d3e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:19.338094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f70cc-b6e3-449d-9ec0-c8182a5d3e70 None admin] PATH_INFO: `/v3/users/36773b7875fb4147ba998e41ff5a8fe9` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:19.338094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f70cc-b6e3-449d-9ec0-c8182a5d3e70 None admin] RBAC: Authorizing `identity:get_user(user_id=36773b7875fb4147ba998e41ff5a8fe9)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:19.338094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f70cc-b6e3-449d-9ec0-c8182a5d3e70 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:19.338094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 18/32] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:19 2022] GET /identity/v3/users/36773b7875fb4147ba998e41ff5a8fe9 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:19.338503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443384-7b64-4034-9860-0eff758bd62b None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:19.338503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443384-7b64-4034-9860-0eff758bd62b None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:19.338503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443384-7b64-4034-9860-0eff758bd62b None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:19.343170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 19/33] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:19.343876 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443384-7b64-4034-9860-0eff758bd62b None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:19.396542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 15/34] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Sep 8 15:58:18 2022] POST /identity/v3/roles => generated 219 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:19.398780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e368fc-16d4-436d-acf4-30467e54348a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:19.435064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:19.485920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443384-7b64-4034-9860-0eff758bd62b None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:19.527127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e368fc-16d4-436d-acf4-30467e54348a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:19.534837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb87253-5492-4f1c-a425-ac0fa3e349b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:19.535813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87253-5492-4f1c-a425-ac0fa3e349b2 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:19.536898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87253-5492-4f1c-a425-ac0fa3e349b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:19.537404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb87253-5492-4f1c-a425-ac0fa3e349b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:19.538293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb87253-5492-4f1c-a425-ac0fa3e349b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:19.540776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb87253-5492-4f1c-a425-ac0fa3e349b2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:19.572417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660c7a9-bb37-4b67-8fd6-d71a6b8fabfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:19.573446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660c7a9-bb37-4b67-8fd6-d71a6b8fabfe None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:19.573940 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660c7a9-bb37-4b67-8fd6-d71a6b8fabfe None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:19.574429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660c7a9-bb37-4b67-8fd6-d71a6b8fabfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:19.576310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660c7a9-bb37-4b67-8fd6-d71a6b8fabfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:19.578179 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660c7a9-bb37-4b67-8fd6-d71a6b8fabfe None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:19.584345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 16/35] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:19.584345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6808a42-3749-41d2-a330-7d4f904bc161 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:19.584345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6808a42-3749-41d2-a330-7d4f904bc161 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:19.584345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6808a42-3749-41d2-a330-7d4f904bc161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:19.603020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b6808a42-3749-41d2-a330-7d4f904bc161 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:19.604920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b6808a42-3749-41d2-a330-7d4f904bc161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:19.685931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 17/36] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:19.687537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206381c6-0e2d-47eb-8df6-1ebf4dc72632 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:19.687985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206381c6-0e2d-47eb-8df6-1ebf4dc72632 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:19.688418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206381c6-0e2d-47eb-8df6-1ebf4dc72632 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:19.689890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 18/37] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:19.690752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206381c6-0e2d-47eb-8df6-1ebf4dc72632 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:19.726007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:19.791872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 20/38] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 15:58:19 2022] POST /identity/v3/projects => generated 301 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:19.793543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0695d36-f2e8-4313-a5de-f58113be304d None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:19.793872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0695d36-f2e8-4313-a5de-f58113be304d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:19.794154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0695d36-f2e8-4313-a5de-f58113be304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:19.835342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206381c6-0e2d-47eb-8df6-1ebf4dc72632 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:19.839766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-d0695d36-f2e8-4313-a5de-f58113be304d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:19.841358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d0695d36-f2e8-4313-a5de-f58113be304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:19.875988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f2bf7-a6fa-44ee-b0fa-a22d485d3d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:19.876849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f2bf7-a6fa-44ee-b0fa-a22d485d3d37 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:19.877187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f2bf7-a6fa-44ee-b0fa-a22d485d3d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:19.877471 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f2bf7-a6fa-44ee-b0fa-a22d485d3d37 None admin] PATH_INFO: `/v3/domains/default/users/36773b7875fb4147ba998e41ff5a8fe9/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:19.880241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f2bf7-a6fa-44ee-b0fa-a22d485d3d37 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=36773b7875fb4147ba998e41ff5a8fe9, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:19.881793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f2bf7-a6fa-44ee-b0fa-a22d485d3d37 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:19.924766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:19.954216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 21/39] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:20.003092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 19/40] 10.222.0.23 () {58 vars in 1361 bytes} [Thu Sep 8 15:58:19 2022] PUT /identity/v3/domains/default/users/36773b7875fb4147ba998e41ff5a8fe9/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:58:20.014290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0695d36-f2e8-4313-a5de-f58113be304d None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:20.137354 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0695d36-f2e8-4313-a5de-f58113be304d None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:20.204784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cec8-afa1-4132-9e0c-71c3ae01e303 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:20.205155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cec8-afa1-4132-9e0c-71c3ae01e303 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:20.205387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742cec8-afa1-4132-9e0c-71c3ae01e303 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:20.211270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 20/41] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:20.216799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1896a2-79e1-408a-947b-6d84a26e1853 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:20.217084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1896a2-79e1-408a-947b-6d84a26e1853 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:20.217366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1896a2-79e1-408a-947b-6d84a26e1853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:20.248485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5a1896a2-79e1-408a-947b-6d84a26e1853 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:20.249714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5a1896a2-79e1-408a-947b-6d84a26e1853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:20.289411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aa21c-b0ee-48fe-90e5-cfd738c75256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:20.290041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa21c-b0ee-48fe-90e5-cfd738c75256 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:20.290326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa21c-b0ee-48fe-90e5-cfd738c75256 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:20.290600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa21c-b0ee-48fe-90e5-cfd738c75256 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:20.291322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0aa21c-b0ee-48fe-90e5-cfd738c75256 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:20.295247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0aa21c-b0ee-48fe-90e5-cfd738c75256 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:20.322685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 21/42] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:58:20.323551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1896a2-79e1-408a-947b-6d84a26e1853 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:20.331728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:20.367243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 22/43] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Sep 8 15:58:20 2022] POST /identity/v3/roles => generated 225 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:20.430984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1896a2-79e1-408a-947b-6d84a26e1853 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:20.469756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614821c-e0f9-42ee-af82-79361b396abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:20.470401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614821c-e0f9-42ee-af82-79361b396abc None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:20.471641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614821c-e0f9-42ee-af82-79361b396abc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:20.471923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614821c-e0f9-42ee-af82-79361b396abc None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:20.472617 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614821c-e0f9-42ee-af82-79361b396abc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:20.474066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614821c-e0f9-42ee-af82-79361b396abc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:20.551067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Sep 8 15:58:20 2022] POST /identity/v3/roles => generated 223 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:20.609540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aa21c-b0ee-48fe-90e5-cfd738c75256 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:20.651843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:20.726626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aa21c-b0ee-48fe-90e5-cfd738c75256 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:20.761979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3fbd9-928f-4bcf-98a2-95042f8546a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:20.762632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fbd9-928f-4bcf-98a2-95042f8546a2 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:20.762958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fbd9-928f-4bcf-98a2-95042f8546a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:20.763233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3fbd9-928f-4bcf-98a2-95042f8546a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:20.764358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3fbd9-928f-4bcf-98a2-95042f8546a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:20.765824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3fbd9-928f-4bcf-98a2-95042f8546a2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:20.768108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 23/45] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:20.773942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614821c-e0f9-42ee-af82-79361b396abc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:20.839758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:20.874451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614821c-e0f9-42ee-af82-79361b396abc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:20.908748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ae2a5-2b17-4d65-ad0b-7e97360853b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:20.909359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ae2a5-2b17-4d65-ad0b-7e97360853b9 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:20.909641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ae2a5-2b17-4d65-ad0b-7e97360853b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:20.909914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ae2a5-2b17-4d65-ad0b-7e97360853b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:20.910560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ae2a5-2b17-4d65-ad0b-7e97360853b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:20.912042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ae2a5-2b17-4d65-ad0b-7e97360853b9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:21.006783 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 15:58:20 2022] POST /identity/v3/projects => generated 312 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:22.267544 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86761a-964a-4bfc-8dff-ffb27dfbdd71 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:22.268058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86761a-964a-4bfc-8dff-ffb27dfbdd71 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:22.268141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86761a-964a-4bfc-8dff-ffb27dfbdd71 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:22.269680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:22.274973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d2822-f56f-4c29-9fda-29a7d389bc51 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:22.275424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d2822-f56f-4c29-9fda-29a7d389bc51 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:22.275507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d2822-f56f-4c29-9fda-29a7d389bc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:22.293656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-602d2822-f56f-4c29-9fda-29a7d389bc51 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:22.294879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-602d2822-f56f-4c29-9fda-29a7d389bc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:22.358203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:22.624670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86761a-964a-4bfc-8dff-ffb27dfbdd71 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:22.724683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86761a-964a-4bfc-8dff-ffb27dfbdd71 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:22.727003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:22.756980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed46d5-2b1b-45e2-b527-51ef7bda2c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:22.757617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed46d5-2b1b-45e2-b527-51ef7bda2c0a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:22.757896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed46d5-2b1b-45e2-b527-51ef7bda2c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:22.758166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed46d5-2b1b-45e2-b527-51ef7bda2c0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:22.768564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed46d5-2b1b-45e2-b527-51ef7bda2c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-f7ed46d5-2b1b-45e2-b527-51ef7bda2c0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:22.773729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:22.774757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:22.775543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 25/49] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:58:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:22.780739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d2822-f56f-4c29-9fda-29a7d389bc51 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:22.827631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:22.876481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d2822-f56f-4c29-9fda-29a7d389bc51 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:22.910975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f676ce8-1cdc-440d-b9b5-eb4764aaca62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:22.911575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f676ce8-1cdc-440d-b9b5-eb4764aaca62 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:22.911849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f676ce8-1cdc-440d-b9b5-eb4764aaca62 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:22.912120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f676ce8-1cdc-440d-b9b5-eb4764aaca62 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:22.912773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f676ce8-1cdc-440d-b9b5-eb4764aaca62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:22.913070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f676ce8-1cdc-440d-b9b5-eb4764aaca62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:22.914437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f676ce8-1cdc-440d-b9b5-eb4764aaca62 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:22.925382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 25/50] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:22.931192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed46d5-2b1b-45e2-b527-51ef7bda2c0a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:23.031561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed46d5-2b1b-45e2-b527-51ef7bda2c0a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:23.066655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b7771-5ebb-4de9-b4d2-f23464581590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:23.067306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b7771-5ebb-4de9-b4d2-f23464581590 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:23.067588 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b7771-5ebb-4de9-b4d2-f23464581590 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:23.067865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b7771-5ebb-4de9-b4d2-f23464581590 None admin] PATH_INFO: `/v3/users/36773b7875fb4147ba998e41ff5a8fe9` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:23.068990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b7771-5ebb-4de9-b4d2-f23464581590 None admin] RBAC: Authorizing `identity:get_user(user_id=36773b7875fb4147ba998e41ff5a8fe9)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:23.070444 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b7771-5ebb-4de9-b4d2-f23464581590 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:23.072064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 26/51] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:22 2022] GET /identity/v3/users/36773b7875fb4147ba998e41ff5a8fe9 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:23.077491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f676ce8-1cdc-440d-b9b5-eb4764aaca62 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:23.129878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c97e-2a87-4af2-8bf8-37897ad0caa8 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:23.130050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c97e-2a87-4af2-8bf8-37897ad0caa8 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:23.130331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c97e-2a87-4af2-8bf8-37897ad0caa8 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:23.131733 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 27/52] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:58:23.137484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a376782-223b-482b-ba27-9739a0dc25e9 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:23.137768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a376782-223b-482b-ba27-9739a0dc25e9 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:23.138040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a376782-223b-482b-ba27-9739a0dc25e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:23.158062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-2a376782-223b-482b-ba27-9739a0dc25e9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:23.159341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2a376782-223b-482b-ba27-9739a0dc25e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:23.186267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:23.227356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 28/53] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:58:23.280168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f676ce8-1cdc-440d-b9b5-eb4764aaca62 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:23.290151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:23.312476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c18dab-4a1c-478c-9cc2-e8cbb34100a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:23.313156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c18dab-4a1c-478c-9cc2-e8cbb34100a0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:23.313433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c18dab-4a1c-478c-9cc2-e8cbb34100a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:23.313706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c18dab-4a1c-478c-9cc2-e8cbb34100a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:23.315408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c18dab-4a1c-478c-9cc2-e8cbb34100a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:23.316835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c18dab-4a1c-478c-9cc2-e8cbb34100a0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:23.318380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 26/54] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:23.324132 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a376782-223b-482b-ba27-9739a0dc25e9 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:23.421232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a376782-223b-482b-ba27-9739a0dc25e9 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:23.454342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a70c6-9d8f-4ac9-8b82-1d2ada31fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:23.455047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a70c6-9d8f-4ac9-8b82-1d2ada31fb66 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:23.455363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a70c6-9d8f-4ac9-8b82-1d2ada31fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:23.455638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a70c6-9d8f-4ac9-8b82-1d2ada31fb66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:23.456355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a70c6-9d8f-4ac9-8b82-1d2ada31fb66 None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.domain.id=default, user.id=36773b7875fb4147ba998e41ff5a8fe9) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:23.456664 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a70c6-9d8f-4ac9-8b82-1d2ada31fb66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:23.458112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a70c6-9d8f-4ac9-8b82-1d2ada31fb66 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:23.463701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 29/55] 10.222.0.23 () {56 vars in 1322 bytes} [Thu Sep 8 15:58:23 2022] GET /identity/v3/role_assignments?user.id=36773b7875fb4147ba998e41ff5a8fe9&scope.domain.id=default&role.id=519b356d36364663a59265dc7eeff0b8 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:23.493181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c18dab-4a1c-478c-9cc2-e8cbb34100a0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:23.597859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c18dab-4a1c-478c-9cc2-e8cbb34100a0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:23.634161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b0c1d-9aa6-424c-8070-0d2383495da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:23.634833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b0c1d-9aa6-424c-8070-0d2383495da6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:23.635116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b0c1d-9aa6-424c-8070-0d2383495da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:23.635397 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b0c1d-9aa6-424c-8070-0d2383495da6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:23.637234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b0c1d-9aa6-424c-8070-0d2383495da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:23.637961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b0c1d-9aa6-424c-8070-0d2383495da6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:23.639567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 27/56] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:23.645672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a70c6-9d8f-4ac9-8b82-1d2ada31fb66 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:23.674515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:23.755239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a70c6-9d8f-4ac9-8b82-1d2ada31fb66 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:23.788355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e45ef-c345-48ba-9112-028ef5a1fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:23.788963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e45ef-c345-48ba-9112-028ef5a1fdd5 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:23.789245 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e45ef-c345-48ba-9112-028ef5a1fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:23.789519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e45ef-c345-48ba-9112-028ef5a1fdd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:23.790176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e45ef-c345-48ba-9112-028ef5a1fdd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:23.791658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e45ef-c345-48ba-9112-028ef5a1fdd5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:23.852333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 30/57] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Sep 8 15:58:23 2022] POST /identity/v3/projects => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:26.011498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fc7b5-840a-44ca-9124-2f27c60c72f7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:26.012038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fc7b5-840a-44ca-9124-2f27c60c72f7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:26.012038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fc7b5-840a-44ca-9124-2f27c60c72f7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:26.013403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 28/58] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:26.019465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59813-32c9-47f9-a8a5-16f13d9fcefe None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:26.019868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59813-32c9-47f9-a8a5-16f13d9fcefe None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:26.020021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca59813-32c9-47f9-a8a5-16f13d9fcefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:26.039486 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-1ca59813-32c9-47f9-a8a5-16f13d9fcefe None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:26.040712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1ca59813-32c9-47f9-a8a5-16f13d9fcefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:26.107814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 31/59] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:26.374996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fc7b5-840a-44ca-9124-2f27c60c72f7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:26.426186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:26.481953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fc7b5-840a-44ca-9124-2f27c60c72f7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:26.515654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4784b4-b87d-4578-ad6c-56b4ac185643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:26.516284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784b4-b87d-4578-ad6c-56b4ac185643 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:26.516563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784b4-b87d-4578-ad6c-56b4ac185643 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:26.516834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784b4-b87d-4578-ad6c-56b4ac185643 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:26.517937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4784b4-b87d-4578-ad6c-56b4ac185643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:26.519663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4784b4-b87d-4578-ad6c-56b4ac185643 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:26.521228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 29/60] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:26.526784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca59813-32c9-47f9-a8a5-16f13d9fcefe None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:26.536652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:26.623361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca59813-32c9-47f9-a8a5-16f13d9fcefe None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:26.656308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b241c4a-1c11-47b8-b540-c98bbd226cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:26.656859 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b241c4a-1c11-47b8-b540-c98bbd226cf5 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:26.657143 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b241c4a-1c11-47b8-b540-c98bbd226cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:26.657421 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b241c4a-1c11-47b8-b540-c98bbd226cf5 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:26.658714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b241c4a-1c11-47b8-b540-c98bbd226cf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:26.660171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b241c4a-1c11-47b8-b540-c98bbd226cf5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:26.748278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 32/61] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:58:26 2022] POST /identity/v3/users => generated 275 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:29.934815 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e1f4-1573-4a6c-93a6-85d47e65cfc6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:29.934815 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e1f4-1573-4a6c-93a6-85d47e65cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:29.934815 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56e1f4-1573-4a6c-93a6-85d47e65cfc6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:29.935995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 30/62] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:29.940416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa3c55-6c80-4568-a20d-da873cb8f925 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:29.941195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa3c55-6c80-4568-a20d-da873cb8f925 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:29.941765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa3c55-6c80-4568-a20d-da873cb8f925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:29.967964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-09aa3c55-6c80-4568-a20d-da873cb8f925 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:29.969460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-09aa3c55-6c80-4568-a20d-da873cb8f925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:30.047962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:30.060364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 33/63] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:30.218418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e41cfc-b59f-4cb4-a832-a02d3edc43d2 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:30.219013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e41cfc-b59f-4cb4-a832-a02d3edc43d2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:30.219436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e41cfc-b59f-4cb4-a832-a02d3edc43d2 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:30.221391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 31/64] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:30.226990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a494a-1366-4be3-9b8e-e42a8dffac99 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:30.227539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a494a-1366-4be3-9b8e-e42a8dffac99 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:30.227967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a494a-1366-4be3-9b8e-e42a8dffac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:30.252922 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-360a494a-1366-4be3-9b8e-e42a8dffac99 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:30.254404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-360a494a-1366-4be3-9b8e-e42a8dffac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:30.337779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 34/65] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:30.344114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e819e-222a-4785-a2cc-94b9ecb051ba None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:30.344632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e819e-222a-4785-a2cc-94b9ecb051ba None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:30.345140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e819e-222a-4785-a2cc-94b9ecb051ba None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:30.346648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 32/66] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:30.351794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bdee2-064a-4417-bfc5-d283ebcf06e6 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:30.352289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bdee2-064a-4417-bfc5-d283ebcf06e6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:30.352804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bdee2-064a-4417-bfc5-d283ebcf06e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:30.376047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-da3bdee2-064a-4417-bfc5-d283ebcf06e6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:30.378130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-da3bdee2-064a-4417-bfc5-d283ebcf06e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:30.426702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e819e-222a-4785-a2cc-94b9ecb051ba None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:30.465214 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 35/67] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:30.607386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e1fe6-6923-4b2f-8bfc-4a8d062e1b90 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:30.607545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e819e-222a-4785-a2cc-94b9ecb051ba None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:30.608078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e1fe6-6923-4b2f-8bfc-4a8d062e1b90 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:30.608554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e1fe6-6923-4b2f-8bfc-4a8d062e1b90 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:30.610124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 36/68] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:58:30.615909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e109f1-775f-4b07-b5db-82c35dd003e9 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:30.616416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e109f1-775f-4b07-b5db-82c35dd003e9 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:30.616907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e109f1-775f-4b07-b5db-82c35dd003e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:30.627596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:30.637118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-93e109f1-775f-4b07-b5db-82c35dd003e9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:30.638588 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-93e109f1-775f-4b07-b5db-82c35dd003e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:30.668564 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c54f97-1907-418c-a200-0f0eea5a8373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:30.669212 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c54f97-1907-418c-a200-0f0eea5a8373 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:30.669492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c54f97-1907-418c-a200-0f0eea5a8373 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:30.669762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c54f97-1907-418c-a200-0f0eea5a8373 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:30.688667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c54f97-1907-418c-a200-0f0eea5a8373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f9c54f97-1907-418c-a200-0f0eea5a8373 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:30.701557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:30.702450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:30.703330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:30.703911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 33/69] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:58:30.706852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c54f97-1907-418c-a200-0f0eea5a8373 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:30.715761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:30.738637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 37/70] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:58:30.744276 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e109f1-775f-4b07-b5db-82c35dd003e9 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:30.835498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c54f97-1907-418c-a200-0f0eea5a8373 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:30.877310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e109f1-775f-4b07-b5db-82c35dd003e9 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:30.877622 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a91ce-ad39-46d1-9bcc-ca68cf8c9933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:30.878268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a91ce-ad39-46d1-9bcc-ca68cf8c9933 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:30.878543 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a91ce-ad39-46d1-9bcc-ca68cf8c9933 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:30.879007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a91ce-ad39-46d1-9bcc-ca68cf8c9933 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:30.891643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a91ce-ad39-46d1-9bcc-ca68cf8c9933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-705a91ce-ad39-46d1-9bcc-ca68cf8c9933 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:30.899177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:30.900027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:30.900804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 34/71] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:58:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:30.902148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a91ce-ad39-46d1-9bcc-ca68cf8c9933 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:30.918206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095cc8d-a7aa-4cfa-af26-ddb7c72fcaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:30.919054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095cc8d-a7aa-4cfa-af26-ddb7c72fcaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:30.919525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095cc8d-a7aa-4cfa-af26-ddb7c72fcaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:30.919888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095cc8d-a7aa-4cfa-af26-ddb7c72fcaf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:30.920611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095cc8d-a7aa-4cfa-af26-ddb7c72fcaf1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:30.921021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095cc8d-a7aa-4cfa-af26-ddb7c72fcaf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:30.922520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095cc8d-a7aa-4cfa-af26-ddb7c72fcaf1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:30.931901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 38/72] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:30.937266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095cc8d-a7aa-4cfa-af26-ddb7c72fcaf1 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:30.942384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:30.985465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:31.024690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a91ce-ad39-46d1-9bcc-ca68cf8c9933 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:31.044596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095cc8d-a7aa-4cfa-af26-ddb7c72fcaf1 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:31.059950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecc81f-9e12-4309-a540-a68e4e3d46bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:31.060595 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecc81f-9e12-4309-a540-a68e4e3d46bc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.060868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecc81f-9e12-4309-a540-a68e4e3d46bc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.061141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecc81f-9e12-4309-a540-a68e4e3d46bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.071599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecc81f-9e12-4309-a540-a68e4e3d46bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6cecc81f-9e12-4309-a540-a68e4e3d46bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:31.076865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:31.077694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:31.079378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 35/73] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:58:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:31.080023 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a50ba7-3f9c-46f2-8f62-def342603f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:31.080114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecc81f-9e12-4309-a540-a68e4e3d46bc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:31.080181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50ba7-3f9c-46f2-8f62-def342603f8b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.080181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50ba7-3f9c-46f2-8f62-def342603f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.080181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50ba7-3f9c-46f2-8f62-def342603f8b None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.080181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a50ba7-3f9c-46f2-8f62-def342603f8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:31.080397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a50ba7-3f9c-46f2-8f62-def342603f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:31.081736 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a50ba7-3f9c-46f2-8f62-def342603f8b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:31.090331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 39/74] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:31.092741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606480c-fea8-45ed-975b-8d8fc258364d None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.093159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606480c-fea8-45ed-975b-8d8fc258364d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.093582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606480c-fea8-45ed-975b-8d8fc258364d None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.095124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 40/75] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:31.095891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606480c-fea8-45ed-975b-8d8fc258364d None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:31.174352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:31.180838 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecc81f-9e12-4309-a540-a68e4e3d46bc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:31.194127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606480c-fea8-45ed-975b-8d8fc258364d None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:31.203807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:31.216226 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b617-8566-4971-8191-e41a6c636fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:31.216861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b617-8566-4971-8191-e41a6c636fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.217146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b617-8566-4971-8191-e41a6c636fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.217420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b617-8566-4971-8191-e41a6c636fd2 None admin] PATH_INFO: `/v3/users/0a61cd86a351421ca5fde715dd4da46e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.228093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2fd90-4fa4-4383-b74c-bbde17ea0d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:31.228719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2fd90-4fa4-4383-b74c-bbde17ea0d8e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.229002 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2fd90-4fa4-4383-b74c-bbde17ea0d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.229278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2fd90-4fa4-4383-b74c-bbde17ea0d8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.231748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1b617-8566-4971-8191-e41a6c636fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=0a61cd86a351421ca5fde715dd4da46e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:31.233303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1b617-8566-4971-8191-e41a6c636fd2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:31.235164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 36/76] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:31 2022] GET /identity/v3/users/0a61cd86a351421ca5fde715dd4da46e => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:31.236518 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b617-8566-4971-8191-e41a6c636fd2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:31.244810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2fd90-4fa4-4383-b74c-bbde17ea0d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-48e2fd90-4fa4-4383-b74c-bbde17ea0d8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:31.249757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:31.250707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:31.252084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 41/77] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:31.252708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2fd90-4fa4-4383-b74c-bbde17ea0d8e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:31.339770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b617-8566-4971-8191-e41a6c636fd2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:31.353161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2fd90-4fa4-4383-b74c-bbde17ea0d8e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:31.373146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d77fd-402f-40ad-816b-ff1025b94a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:31.373753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d77fd-402f-40ad-816b-ff1025b94a31 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.374034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d77fd-402f-40ad-816b-ff1025b94a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.374311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d77fd-402f-40ad-816b-ff1025b94a31 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.375005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d77fd-402f-40ad-816b-ff1025b94a31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:31.375314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d77fd-402f-40ad-816b-ff1025b94a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:31.376725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d77fd-402f-40ad-816b-ff1025b94a31 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:31.384382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 37/78] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:58:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:31.388995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946cd79-c6c9-4171-b9cc-eb5a1c865005 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.388995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946cd79-c6c9-4171-b9cc-eb5a1c865005 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.388995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946cd79-c6c9-4171-b9cc-eb5a1c865005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.390852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f413a-c19c-424b-9c09-0fcc22efff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:31.391487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f413a-c19c-424b-9c09-0fcc22efff99 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.391769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f413a-c19c-424b-9c09-0fcc22efff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.392046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f413a-c19c-424b-9c09-0fcc22efff99 None admin] PATH_INFO: `/v3/users/36773b7875fb4147ba998e41ff5a8fe9` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.393181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f413a-c19c-424b-9c09-0fcc22efff99 None admin] RBAC: Authorizing `identity:get_user(user_id=36773b7875fb4147ba998e41ff5a8fe9)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:31.394971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f413a-c19c-424b-9c09-0fcc22efff99 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:31.396541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 42/79] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:31 2022] GET /identity/v3/users/36773b7875fb4147ba998e41ff5a8fe9 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:31.397299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f413a-c19c-424b-9c09-0fcc22efff99 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:31.404202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8946cd79-c6c9-4171-b9cc-eb5a1c865005 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:31.405396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8946cd79-c6c9-4171-b9cc-eb5a1c865005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:31.415902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:31.434236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:31.474846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 38/80] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:31.475699 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946cd79-c6c9-4171-b9cc-eb5a1c865005 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:31.509807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f413a-c19c-424b-9c09-0fcc22efff99 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:31.546508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79251c-ceb5-41f0-a2ab-977f31708c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:31.547194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79251c-ceb5-41f0-a2ab-977f31708c4b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.547479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79251c-ceb5-41f0-a2ab-977f31708c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.547810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79251c-ceb5-41f0-a2ab-977f31708c4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.573820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946cd79-c6c9-4171-b9cc-eb5a1c865005 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:31.610475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8153a-50ed-452e-8f5c-b7f2fd3aaada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:31.611648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8153a-50ed-452e-8f5c-b7f2fd3aaada None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.611927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8153a-50ed-452e-8f5c-b7f2fd3aaada None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.612195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8153a-50ed-452e-8f5c-b7f2fd3aaada None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.612847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8153a-50ed-452e-8f5c-b7f2fd3aaada None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:31.613141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8153a-50ed-452e-8f5c-b7f2fd3aaada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:31.614508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8153a-50ed-452e-8f5c-b7f2fd3aaada None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:31.620048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79251c-ceb5-41f0-a2ab-977f31708c4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:31.621734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79251c-ceb5-41f0-a2ab-977f31708c4b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:31.622412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 39/81] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:31.623234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8153a-50ed-452e-8f5c-b7f2fd3aaada None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:31.633582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:31.662875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:31.729970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8153a-50ed-452e-8f5c-b7f2fd3aaada None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:31.730942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 43/82] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:31.732112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79251c-ceb5-41f0-a2ab-977f31708c4b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:31.774055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5606f-5918-4cd9-9248-f4ee1e79ffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:31.774715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5606f-5918-4cd9-9248-f4ee1e79ffbd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.775002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5606f-5918-4cd9-9248-f4ee1e79ffbd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.775275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5606f-5918-4cd9-9248-f4ee1e79ffbd None admin] PATH_INFO: `/v3/users/0a61cd86a351421ca5fde715dd4da46e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.776419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5606f-5918-4cd9-9248-f4ee1e79ffbd None admin] RBAC: Authorizing `identity:get_user(user_id=0a61cd86a351421ca5fde715dd4da46e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:31.777855 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5606f-5918-4cd9-9248-f4ee1e79ffbd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:31.779471 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 40/83] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:31 2022] GET /identity/v3/users/0a61cd86a351421ca5fde715dd4da46e => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:31.779471 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5606f-5918-4cd9-9248-f4ee1e79ffbd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:31.834054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79251c-ceb5-41f0-a2ab-977f31708c4b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:31.855472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:31.866989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f3f8-2b64-400b-93f9-22115caf82ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:31.867601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f3f8-2b64-400b-93f9-22115caf82ee None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.867879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f3f8-2b64-400b-93f9-22115caf82ee None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.870249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7f3f8-2b64-400b-93f9-22115caf82ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.871548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:31.879501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5606f-5918-4cd9-9248-f4ee1e79ffbd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:31.913361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ff90f-79a2-418c-917f-05bab05881bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:31.913993 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ff90f-79a2-418c-917f-05bab05881bd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:31.914276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ff90f-79a2-418c-917f-05bab05881bd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:31.914548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ff90f-79a2-418c-917f-05bab05881bd None admin] PATH_INFO: `/v3/users/0a61cd86a351421ca5fde715dd4da46e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:31.915703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ff90f-79a2-418c-917f-05bab05881bd None admin] RBAC: Authorizing `identity:get_user(user_id=0a61cd86a351421ca5fde715dd4da46e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:31.917129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ff90f-79a2-418c-917f-05bab05881bd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:31.918884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 41/84] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:31 2022] GET /identity/v3/users/0a61cd86a351421ca5fde715dd4da46e => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:31.919478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ff90f-79a2-418c-917f-05bab05881bd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:31.938704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7f3f8-2b64-400b-93f9-22115caf82ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:31.940167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7f3f8-2b64-400b-93f9-22115caf82ee None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:32.016646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ff90f-79a2-418c-917f-05bab05881bd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:32.036497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 44/85] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:32.036497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f3f8-2b64-400b-93f9-22115caf82ee None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:32.055766 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a25c5-f5f8-40c6-8c10-b5708415a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:32.056400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a25c5-f5f8-40c6-8c10-b5708415a530 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:32.056679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a25c5-f5f8-40c6-8c10-b5708415a530 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:32.056950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a25c5-f5f8-40c6-8c10-b5708415a530 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:32.058083 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a25c5-f5f8-40c6-8c10-b5708415a530 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:32.059559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a25c5-f5f8-40c6-8c10-b5708415a530 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:32.061183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 42/86] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:31 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:32.061942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a25c5-f5f8-40c6-8c10-b5708415a530 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:32.074369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:32.074770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:32.137624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7f3f8-2b64-400b-93f9-22115caf82ee None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:32.157791 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a25c5-f5f8-40c6-8c10-b5708415a530 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:32.171720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe8d3c-15d5-44fc-8441-42ceddee89b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:32.172348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8d3c-15d5-44fc-8441-42ceddee89b2 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:32.172626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8d3c-15d5-44fc-8441-42ceddee89b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:32.172899 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8d3c-15d5-44fc-8441-42ceddee89b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:32.174010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe8d3c-15d5-44fc-8441-42ceddee89b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:32.175484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe8d3c-15d5-44fc-8441-42ceddee89b2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:32.177061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 45/87] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:32.184281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe8d3c-15d5-44fc-8441-42ceddee89b2 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:32.191310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93183ce-26b8-4d36-9a8c-361700044b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:32.191928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93183ce-26b8-4d36-9a8c-361700044b4a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:32.192216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93183ce-26b8-4d36-9a8c-361700044b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:32.192489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93183ce-26b8-4d36-9a8c-361700044b4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:32.259895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93183ce-26b8-4d36-9a8c-361700044b4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:32.261459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93183ce-26b8-4d36-9a8c-361700044b4a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:32.273040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:32.283100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe8d3c-15d5-44fc-8441-42ceddee89b2 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:32.285645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:32.318646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8884b-91d7-4f6c-9d68-9dad2f5b891c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:32.319313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8884b-91d7-4f6c-9d68-9dad2f5b891c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:32.319591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8884b-91d7-4f6c-9d68-9dad2f5b891c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:32.319878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8884b-91d7-4f6c-9d68-9dad2f5b891c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:32.359212 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 43/88] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:32.360062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93183ce-26b8-4d36-9a8c-361700044b4a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:32.388003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8884b-91d7-4f6c-9d68-9dad2f5b891c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:32.389591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8884b-91d7-4f6c-9d68-9dad2f5b891c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:32.456596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93183ce-26b8-4d36-9a8c-361700044b4a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:32.466792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:32.489204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0926e-5e49-4766-be67-186be9a58940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:32.489824 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0926e-5e49-4766-be67-186be9a58940 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:32.490101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0926e-5e49-4766-be67-186be9a58940 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:32.490370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0926e-5e49-4766-be67-186be9a58940 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:32.490608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 46/89] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:32.491518 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0926e-5e49-4766-be67-186be9a58940 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:32.492954 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0926e-5e49-4766-be67-186be9a58940 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:32.494058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8884b-91d7-4f6c-9d68-9dad2f5b891c None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:32.497201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:32.499450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 44/90] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:32 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:32.500148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0926e-5e49-4766-be67-186be9a58940 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:32.595024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8884b-91d7-4f6c-9d68-9dad2f5b891c None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:32.599692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0926e-5e49-4766-be67-186be9a58940 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:32.628681 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca022a6-3595-4900-a769-cff50b7a6ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:32.629288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca022a6-3595-4900-a769-cff50b7a6ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:32.629571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca022a6-3595-4900-a769-cff50b7a6ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:32.629844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca022a6-3595-4900-a769-cff50b7a6ce3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:32.630566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca022a6-3595-4900-a769-cff50b7a6ce3 None admin] RBAC: Adding query filter params (role.id=6ba784d4bd374e1793729d1ff430e45f, scope.project.id=680231dab5b3448499d71c6cba44d7c6, user.id=0a61cd86a351421ca5fde715dd4da46e) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:32.630901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca022a6-3595-4900-a769-cff50b7a6ce3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:32.632365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca022a6-3595-4900-a769-cff50b7a6ce3 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:32.634301 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb057244-f835-45b3-bb99-993c614738f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:32.634939 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057244-f835-45b3-bb99-993c614738f0 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:32.635220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057244-f835-45b3-bb99-993c614738f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:32.635496 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057244-f835-45b3-bb99-993c614738f0 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:32.636144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb057244-f835-45b3-bb99-993c614738f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:32.637706 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 47/91] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:32 2022] GET /identity/v3/role_assignments?user.id=0a61cd86a351421ca5fde715dd4da46e&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:32.637810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb057244-f835-45b3-bb99-993c614738f0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:32.638321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca022a6-3595-4900-a769-cff50b7a6ce3 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:32.711722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:32.731114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 45/92] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:58:32 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:32.732108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb057244-f835-45b3-bb99-993c614738f0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:32.752992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca022a6-3595-4900-a769-cff50b7a6ce3 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:32.792937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:32.797019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e6e28-753e-4d0e-ab7a-b9b78b49cfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:32.797879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e6e28-753e-4d0e-ab7a-b9b78b49cfbf None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:32.798903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e6e28-753e-4d0e-ab7a-b9b78b49cfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:32.799200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e6e28-753e-4d0e-ab7a-b9b78b49cfbf None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:32.800653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e6e28-753e-4d0e-ab7a-b9b78b49cfbf None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:32.802324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e6e28-753e-4d0e-ab7a-b9b78b49cfbf None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:32.810426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 48/93] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:32 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:32.813406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e6e28-753e-4d0e-ab7a-b9b78b49cfbf None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:32.898853 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb057244-f835-45b3-bb99-993c614738f0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:32.939070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d08c98-85cb-4927-a460-328cc86e5af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:32.939715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d08c98-85cb-4927-a460-328cc86e5af9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:32.939993 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d08c98-85cb-4927-a460-328cc86e5af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:32.940267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d08c98-85cb-4927-a460-328cc86e5af9 None admin] PATH_INFO: `/v3/projects/37410e96cc924a2eb9fa909600123cb6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:32.941577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d08c98-85cb-4927-a460-328cc86e5af9 None admin] RBAC: Authorizing `identity:get_project(project_id=37410e96cc924a2eb9fa909600123cb6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:32.942932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d08c98-85cb-4927-a460-328cc86e5af9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:32.944588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 46/94] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:32 2022] GET /identity/v3/projects/37410e96cc924a2eb9fa909600123cb6 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:32.945353 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d08c98-85cb-4927-a460-328cc86e5af9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:32.975563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e6e28-753e-4d0e-ab7a-b9b78b49cfbf None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:33.017748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f329f-b9d3-472c-8123-bb1e00c1381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:33.018361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f329f-b9d3-472c-8123-bb1e00c1381b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:33.018642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f329f-b9d3-472c-8123-bb1e00c1381b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:33.019207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f329f-b9d3-472c-8123-bb1e00c1381b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:33.020057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f329f-b9d3-472c-8123-bb1e00c1381b None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=680231dab5b3448499d71c6cba44d7c6, user.id=36773b7875fb4147ba998e41ff5a8fe9) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:33.020487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f329f-b9d3-472c-8123-bb1e00c1381b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:33.021954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f329f-b9d3-472c-8123-bb1e00c1381b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:33.027534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:33.029991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 49/95] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:32 2022] GET /identity/v3/role_assignments?user.id=36773b7875fb4147ba998e41ff5a8fe9&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=519b356d36364663a59265dc7eeff0b8 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:33.031028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f329f-b9d3-472c-8123-bb1e00c1381b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:33.115839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d08c98-85cb-4927-a460-328cc86e5af9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:33.118806 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:33.170647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de7615-cf7d-4ca3-b5b0-57a0cb17cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:33.171449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de7615-cf7d-4ca3-b5b0-57a0cb17cc55 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:33.171875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de7615-cf7d-4ca3-b5b0-57a0cb17cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:33.172246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de7615-cf7d-4ca3-b5b0-57a0cb17cc55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:33.172347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f329f-b9d3-472c-8123-bb1e00c1381b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:33.173732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de7615-cf7d-4ca3-b5b0-57a0cb17cc55 None admin] RBAC: Adding query filter params (role.id=779e95b5df394f2a95fbdfa2a9fb58eb, scope.project.id=680231dab5b3448499d71c6cba44d7c6, user.id=0a61cd86a351421ca5fde715dd4da46e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:33.174142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de7615-cf7d-4ca3-b5b0-57a0cb17cc55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:33.177015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de7615-cf7d-4ca3-b5b0-57a0cb17cc55 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:33.188403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 47/96] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:32 2022] GET /identity/v3/role_assignments?user.id=0a61cd86a351421ca5fde715dd4da46e&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=779e95b5df394f2a95fbdfa2a9fb58eb => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:33.223120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7828c-7aa0-4d4c-a4cc-54a4426da7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:33.223856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7828c-7aa0-4d4c-a4cc-54a4426da7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:33.224173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7828c-7aa0-4d4c-a4cc-54a4426da7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:33.224454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7828c-7aa0-4d4c-a4cc-54a4426da7a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:33.225213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7828c-7aa0-4d4c-a4cc-54a4426da7a7 None admin] RBAC: Adding query filter params (role.id=6ba784d4bd374e1793729d1ff430e45f, scope.project.id=37410e96cc924a2eb9fa909600123cb6, user.id=0a61cd86a351421ca5fde715dd4da46e) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:33.225534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7828c-7aa0-4d4c-a4cc-54a4426da7a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:33.227059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7828c-7aa0-4d4c-a4cc-54a4426da7a7 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:33.236447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 50/97] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:33 2022] GET /identity/v3/role_assignments?user.id=0a61cd86a351421ca5fde715dd4da46e&scope.project.id=37410e96cc924a2eb9fa909600123cb6&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:35.327143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf5c65-3e5f-4992-aecc-4cc2f2d327cd None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:35.327657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf5c65-3e5f-4992-aecc-4cc2f2d327cd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:35.327959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf5c65-3e5f-4992-aecc-4cc2f2d327cd None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:35.329670 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 48/98] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:35.335283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfa4e2-2090-4d7f-b1d3-605f1a045f1f None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:35.335797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfa4e2-2090-4d7f-b1d3-605f1a045f1f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:35.335947 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfa4e2-2090-4d7f-b1d3-605f1a045f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:35.361898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a1dfa4e2-2090-4d7f-b1d3-605f1a045f1f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:35.363157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a1dfa4e2-2090-4d7f-b1d3-605f1a045f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:35.444628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:35.456246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 51/99] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:35.992766 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf5c65-3e5f-4992-aecc-4cc2f2d327cd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:35.996088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de98a9a-f815-421f-b6a2-97b04cb5984a None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:35.996374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de98a9a-f815-421f-b6a2-97b04cb5984a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:35.996650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de98a9a-f815-421f-b6a2-97b04cb5984a None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:35.999565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 52/100] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:36.003887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac08690-a6a2-4952-9899-576ee8cdcec0 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.004172 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac08690-a6a2-4952-9899-576ee8cdcec0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.004485 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac08690-a6a2-4952-9899-576ee8cdcec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.044201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-dac08690-a6a2-4952-9899-576ee8cdcec0 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:36.045397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dac08690-a6a2-4952-9899-576ee8cdcec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:36.187422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 53/101] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:36.204620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf5c65-3e5f-4992-aecc-4cc2f2d327cd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:36.250315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cc11c-7ed7-44c1-9d00-f7c47ed8ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:36.251445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cc11c-7ed7-44c1-9d00-f7c47ed8ceaf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.251735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cc11c-7ed7-44c1-9d00-f7c47ed8ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.252007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cc11c-7ed7-44c1-9d00-f7c47ed8ceaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.273285 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cc11c-7ed7-44c1-9d00-f7c47ed8ceaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-242cc11c-7ed7-44c1-9d00-f7c47ed8ceaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:36.278612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:36.279580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:36.280423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 49/102] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:36.286593 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac08690-a6a2-4952-9899-576ee8cdcec0 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:36.386294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398bb8-04c3-4381-af60-6b288d80206f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.386953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398bb8-04c3-4381-af60-6b288d80206f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.386953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398bb8-04c3-4381-af60-6b288d80206f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.389034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 50/103] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:58:36.394524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cf496-6913-4070-9f7c-1034a6f4f38a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.394852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cf496-6913-4070-9f7c-1034a6f4f38a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.395131 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cf496-6913-4070-9f7c-1034a6f4f38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.427505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a10cf496-6913-4070-9f7c-1034a6f4f38a None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:36.428729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a10cf496-6913-4070-9f7c-1034a6f4f38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:36.475063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac08690-a6a2-4952-9899-576ee8cdcec0 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:36.480769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:36.533546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:36.550036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44b911-7e4e-46bc-896c-17ae4805a1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:36.550846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b911-7e4e-46bc-896c-17ae4805a1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.551249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b911-7e4e-46bc-896c-17ae4805a1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.551534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b911-7e4e-46bc-896c-17ae4805a1d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.552468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44b911-7e4e-46bc-896c-17ae4805a1d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:36.552778 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44b911-7e4e-46bc-896c-17ae4805a1d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:36.554896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44b911-7e4e-46bc-896c-17ae4805a1d9 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:36.558730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 51/104] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:58:36.560197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623518-a767-49bf-b0e8-923e3307a794 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.561100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623518-a767-49bf-b0e8-923e3307a794 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.561542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623518-a767-49bf-b0e8-923e3307a794 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.563338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 52/105] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:36.569052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44693a3b-fbe2-4d14-a58f-008d98f26f5d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.569179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 54/106] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:36.569252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44693a3b-fbe2-4d14-a58f-008d98f26f5d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.569339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12358-dbaa-4ccd-b35a-ce7dd018325c None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.569407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44693a3b-fbe2-4d14-a58f-008d98f26f5d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.570618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 53/107] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:36.572254 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12358-dbaa-4ccd-b35a-ce7dd018325c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.572254 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12358-dbaa-4ccd-b35a-ce7dd018325c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.572510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44693a3b-fbe2-4d14-a58f-008d98f26f5d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:36.595667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c1e12358-dbaa-4ccd-b35a-ce7dd018325c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:36.597405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c1e12358-dbaa-4ccd-b35a-ce7dd018325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:36.680690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 55/108] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:36.682195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22393a-dcb1-4422-9f1d-88516970a190 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.682700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22393a-dcb1-4422-9f1d-88516970a190 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.682997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22393a-dcb1-4422-9f1d-88516970a190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.696471 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44693a3b-fbe2-4d14-a58f-008d98f26f5d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:36.705093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-9e22393a-dcb1-4422-9f1d-88516970a190 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:36.707108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9e22393a-dcb1-4422-9f1d-88516970a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:36.733704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c65176-abea-4bad-a51e-2ae3a5b37f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:36.734345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c65176-abea-4bad-a51e-2ae3a5b37f9f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.734686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c65176-abea-4bad-a51e-2ae3a5b37f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.735042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c65176-abea-4bad-a51e-2ae3a5b37f9f None admin] PATH_INFO: `/v3/users/0a61cd86a351421ca5fde715dd4da46e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.736808 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c65176-abea-4bad-a51e-2ae3a5b37f9f None admin] RBAC: Authorizing `identity:get_user(user_id=0a61cd86a351421ca5fde715dd4da46e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:36.738399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c65176-abea-4bad-a51e-2ae3a5b37f9f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:36.744535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 54/109] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:36 2022] GET /identity/v3/users/0a61cd86a351421ca5fde715dd4da46e => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:36.744535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270aec7-e2f4-4d13-9cba-afe9c33d8602 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.744535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270aec7-e2f4-4d13-9cba-afe9c33d8602 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.744535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270aec7-e2f4-4d13-9cba-afe9c33d8602 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.744535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 55/110] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:36.744535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270aec7-e2f4-4d13-9cba-afe9c33d8602 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:36.780706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:36.801858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 56/111] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:36.801858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22393a-dcb1-4422-9f1d-88516970a190 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:36.880619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:36.883140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270aec7-e2f4-4d13-9cba-afe9c33d8602 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:36.943390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8eb74-c827-4797-9148-6fd1f892eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:36.944028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8eb74-c827-4797-9148-6fd1f892eada None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.944308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8eb74-c827-4797-9148-6fd1f892eada None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.944582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8eb74-c827-4797-9148-6fd1f892eada None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.945688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8eb74-c827-4797-9148-6fd1f892eada None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:36.947151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8eb74-c827-4797-9148-6fd1f892eada None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:36.948747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 56/112] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:36.953757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73e0ce-b61b-4e6d-89a9-fa7663e7be74 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:36.953757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73e0ce-b61b-4e6d-89a9-fa7663e7be74 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:36.953757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73e0ce-b61b-4e6d-89a9-fa7663e7be74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:36.964372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22393a-dcb1-4422-9f1d-88516970a190 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:36.973080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fd73e0ce-b61b-4e6d-89a9-fa7663e7be74 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:36.974453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fd73e0ce-b61b-4e6d-89a9-fa7663e7be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:37.000089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc117ddd-3fb6-451e-b84e-8e4056299a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:37.000730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc117ddd-3fb6-451e-b84e-8e4056299a57 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:37.001036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc117ddd-3fb6-451e-b84e-8e4056299a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:37.001312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc117ddd-3fb6-451e-b84e-8e4056299a57 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:37.002441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc117ddd-3fb6-451e-b84e-8e4056299a57 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:37.003946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc117ddd-3fb6-451e-b84e-8e4056299a57 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:37.010066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 57/113] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:36 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:37.010066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc117ddd-3fb6-451e-b84e-8e4056299a57 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:37.058175 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 57/114] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:37.058960 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73e0ce-b61b-4e6d-89a9-fa7663e7be74 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:37.088784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:37.116918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc117ddd-3fb6-451e-b84e-8e4056299a57 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:37.132250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:37.153119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054b21b-fefc-420c-9bf7-7bd3675a7a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:37.153925 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054b21b-fefc-420c-9bf7-7bd3675a7a9b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:37.154273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054b21b-fefc-420c-9bf7-7bd3675a7a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:37.154716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054b21b-fefc-420c-9bf7-7bd3675a7a9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:37.165460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054b21b-fefc-420c-9bf7-7bd3675a7a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-a054b21b-fefc-420c-9bf7-7bd3675a7a9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:37.170391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:37.171423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:37.172183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 58/115] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:37.172842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73e0ce-b61b-4e6d-89a9-fa7663e7be74 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:37.172914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054b21b-fefc-420c-9bf7-7bd3675a7a9b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:37.211307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbcc85-c5ab-4515-8d99-390b980b3709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:37.212054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcc85-c5ab-4515-8d99-390b980b3709 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:37.212342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcc85-c5ab-4515-8d99-390b980b3709 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:37.212621 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcc85-c5ab-4515-8d99-390b980b3709 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:37.213375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbcc85-c5ab-4515-8d99-390b980b3709 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:37.215163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbcc85-c5ab-4515-8d99-390b980b3709 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:37.276351 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 58/116] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 15:58:37 2022] POST /identity/v3/projects => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:37.277368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbcc85-c5ab-4515-8d99-390b980b3709 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:37.289083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054b21b-fefc-420c-9bf7-7bd3675a7a9b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:37.348219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb386c-7d31-4c84-acec-fca41855718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:37.348779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb386c-7d31-4c84-acec-fca41855718f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:37.349058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb386c-7d31-4c84-acec-fca41855718f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:37.349326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb386c-7d31-4c84-acec-fca41855718f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:37.360794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb386c-7d31-4c84-acec-fca41855718f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-4aeb386c-7d31-4c84-acec-fca41855718f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:37.365810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:37.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 59/117] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:37.371319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb386c-7d31-4c84-acec-fca41855718f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:37.378199 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:37.408098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbcc85-c5ab-4515-8d99-390b980b3709 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:37.415229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:37.454794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26012933-eefb-4aa5-b984-2ef7464c4d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:37.455767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26012933-eefb-4aa5-b984-2ef7464c4d4d None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:37.456887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26012933-eefb-4aa5-b984-2ef7464c4d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:37.457194 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26012933-eefb-4aa5-b984-2ef7464c4d4d None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6/users/0a61cd86a351421ca5fde715dd4da46e/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:37.459229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26012933-eefb-4aa5-b984-2ef7464c4d4d None admin] RBAC: Authorizing `identity:create_grant(project_id=680231dab5b3448499d71c6cba44d7c6, user_id=0a61cd86a351421ca5fde715dd4da46e, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:37.460691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26012933-eefb-4aa5-b984-2ef7464c4d4d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:37.486981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb386c-7d31-4c84-acec-fca41855718f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:37.521975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346de7be-db85-4d9d-9051-8f5be363ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:37.522614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346de7be-db85-4d9d-9051-8f5be363ffcf None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:37.522988 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346de7be-db85-4d9d-9051-8f5be363ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:37.523299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346de7be-db85-4d9d-9051-8f5be363ffcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:37.527046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 59/118] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:58:37 2022] PUT /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6/users/0a61cd86a351421ca5fde715dd4da46e/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:58:37.527046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26012933-eefb-4aa5-b984-2ef7464c4d4d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:37.541043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346de7be-db85-4d9d-9051-8f5be363ffcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-346de7be-db85-4d9d-9051-8f5be363ffcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:37.546652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:37.547787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:37.548730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:37.550751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 60/119] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:58:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:37.556418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346de7be-db85-4d9d-9051-8f5be363ffcf None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:37.664509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:37.673193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346de7be-db85-4d9d-9051-8f5be363ffcf None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:37.684270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26012933-eefb-4aa5-b984-2ef7464c4d4d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:37.713070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7c302-cf8e-4c35-a544-41e95a6d791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:37.714006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7c302-cf8e-4c35-a544-41e95a6d791f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:37.714512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7c302-cf8e-4c35-a544-41e95a6d791f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:37.715000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7c302-cf8e-4c35-a544-41e95a6d791f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:37.733800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7c302-cf8e-4c35-a544-41e95a6d791f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:37.733978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b52bd-2685-4a3c-80dc-55afe2708405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:37.734476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b52bd-2685-4a3c-80dc-55afe2708405 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:37.734786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b52bd-2685-4a3c-80dc-55afe2708405 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:37.735060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b52bd-2685-4a3c-80dc-55afe2708405 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:37.736293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b52bd-2685-4a3c-80dc-55afe2708405 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:37.736599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b52bd-2685-4a3c-80dc-55afe2708405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:37.737992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b52bd-2685-4a3c-80dc-55afe2708405 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:37.739507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-b5a7c302-cf8e-4c35-a544-41e95a6d791f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:37.740106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:37.740962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:37.741723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 61/120] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:37.742356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7c302-cf8e-4c35-a544-41e95a6d791f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:37.748591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 60/121] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:37.749417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b52bd-2685-4a3c-80dc-55afe2708405 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:37.864576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7c302-cf8e-4c35-a544-41e95a6d791f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:37.887739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b52bd-2685-4a3c-80dc-55afe2708405 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:37.903014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5dc76-4196-47c7-bb3c-2522d73e376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:37.903908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5dc76-4196-47c7-bb3c-2522d73e376a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:37.904203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5dc76-4196-47c7-bb3c-2522d73e376a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:37.904483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5dc76-4196-47c7-bb3c-2522d73e376a None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:37.905164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5dc76-4196-47c7-bb3c-2522d73e376a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:37.905763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5dc76-4196-47c7-bb3c-2522d73e376a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:37.907834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5dc76-4196-47c7-bb3c-2522d73e376a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:37.919910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 62/122] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:37.920643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5dc76-4196-47c7-bb3c-2522d73e376a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:37.933973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bd91e-dab7-4b16-b80d-2bf57061fc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:37.934737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bd91e-dab7-4b16-b80d-2bf57061fc14 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:37.935134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bd91e-dab7-4b16-b80d-2bf57061fc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:37.935504 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bd91e-dab7-4b16-b80d-2bf57061fc14 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:37.936265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bd91e-dab7-4b16-b80d-2bf57061fc14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:37.936665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bd91e-dab7-4b16-b80d-2bf57061fc14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:37.938267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bd91e-dab7-4b16-b80d-2bf57061fc14 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:37.943577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:37.948044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 61/123] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:58:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:37.949029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bd91e-dab7-4b16-b80d-2bf57061fc14 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:38.014068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:38.053099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5dc76-4196-47c7-bb3c-2522d73e376a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:38.061476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bd91e-dab7-4b16-b80d-2bf57061fc14 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:38.098330 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54787-5a39-463b-b9bd-afbecccb587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:38.098975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54787-5a39-463b-b9bd-afbecccb587c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:38.099113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d260818-ebfb-4e4b-8069-2c82ec57e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:38.099256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54787-5a39-463b-b9bd-afbecccb587c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:38.099537 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54787-5a39-463b-b9bd-afbecccb587c None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:38.099948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d260818-ebfb-4e4b-8069-2c82ec57e0fd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:38.100207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54787-5a39-463b-b9bd-afbecccb587c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:38.100403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d260818-ebfb-4e4b-8069-2c82ec57e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:38.100500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54787-5a39-463b-b9bd-afbecccb587c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:38.100884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d260818-ebfb-4e4b-8069-2c82ec57e0fd None admin] PATH_INFO: `/v3/users/0a61cd86a351421ca5fde715dd4da46e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:38.102032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54787-5a39-463b-b9bd-afbecccb587c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:38.102179 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d260818-ebfb-4e4b-8069-2c82ec57e0fd None admin] RBAC: Authorizing `identity:get_user(user_id=0a61cd86a351421ca5fde715dd4da46e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:38.103935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d260818-ebfb-4e4b-8069-2c82ec57e0fd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:38.105713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 62/124] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:37 2022] GET /identity/v3/users/0a61cd86a351421ca5fde715dd4da46e => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:38.106572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d260818-ebfb-4e4b-8069-2c82ec57e0fd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:38.112572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 63/125] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:38.113400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54787-5a39-463b-b9bd-afbecccb587c None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:38.217465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:38.223834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d260818-ebfb-4e4b-8069-2c82ec57e0fd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:38.245636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54787-5a39-463b-b9bd-afbecccb587c None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:38.255991 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:38.265414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902dfaa-93fe-4d26-9219-1d4d1510c600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:38.266161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902dfaa-93fe-4d26-9219-1d4d1510c600 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:38.266529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902dfaa-93fe-4d26-9219-1d4d1510c600 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:38.266898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902dfaa-93fe-4d26-9219-1d4d1510c600 None admin] PATH_INFO: `/v3/users/36773b7875fb4147ba998e41ff5a8fe9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:38.268409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902dfaa-93fe-4d26-9219-1d4d1510c600 None admin] RBAC: Authorizing `identity:get_user(user_id=36773b7875fb4147ba998e41ff5a8fe9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:38.270225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902dfaa-93fe-4d26-9219-1d4d1510c600 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:38.272362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 63/126] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:38 2022] GET /identity/v3/users/36773b7875fb4147ba998e41ff5a8fe9 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:38.273070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902dfaa-93fe-4d26-9219-1d4d1510c600 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:38.288558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e79c69-d973-485d-9363-c977311843a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:38.289609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e79c69-d973-485d-9363-c977311843a3 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:38.290371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e79c69-d973-485d-9363-c977311843a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:38.290724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e79c69-d973-485d-9363-c977311843a3 None admin] PATH_INFO: `/v3/users/0a61cd86a351421ca5fde715dd4da46e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:38.292489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e79c69-d973-485d-9363-c977311843a3 None admin] RBAC: Authorizing `identity:get_user(user_id=0a61cd86a351421ca5fde715dd4da46e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:38.294482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e79c69-d973-485d-9363-c977311843a3 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:38.296523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 64/127] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:38 2022] GET /identity/v3/users/0a61cd86a351421ca5fde715dd4da46e => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:38.297375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e79c69-d973-485d-9363-c977311843a3 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:38.385376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902dfaa-93fe-4d26-9219-1d4d1510c600 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:38.428349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194deda-a47e-4431-9fea-84a623086479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:38.428349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194deda-a47e-4431-9fea-84a623086479 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:38.428349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194deda-a47e-4431-9fea-84a623086479 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:38.429763 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194deda-a47e-4431-9fea-84a623086479 None admin] PATH_INFO: `/v3/projects/37410e96cc924a2eb9fa909600123cb6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:38.429763 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194deda-a47e-4431-9fea-84a623086479 None admin] RBAC: Authorizing `identity:get_project(project_id=37410e96cc924a2eb9fa909600123cb6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:38.431406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194deda-a47e-4431-9fea-84a623086479 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:38.431971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e79c69-d973-485d-9363-c977311843a3 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:38.434908 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 64/128] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:38 2022] GET /identity/v3/projects/37410e96cc924a2eb9fa909600123cb6 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:38.435789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194deda-a47e-4431-9fea-84a623086479 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:38.479046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368809f-bd42-4519-a1d1-dba9b4b3b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:38.479682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368809f-bd42-4519-a1d1-dba9b4b3b473 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:38.479967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368809f-bd42-4519-a1d1-dba9b4b3b473 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:38.480247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368809f-bd42-4519-a1d1-dba9b4b3b473 None admin] PATH_INFO: `/v3/users/5ac872662dc6483f9570d4a13ee8daa1` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:38.500308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368809f-bd42-4519-a1d1-dba9b4b3b473 None admin] RBAC: Authorizing `identity:get_user(user_id=5ac872662dc6483f9570d4a13ee8daa1)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:38.502637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368809f-bd42-4519-a1d1-dba9b4b3b473 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:38.505356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 65/129] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:38 2022] GET /identity/v3/users/5ac872662dc6483f9570d4a13ee8daa1 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:38.506147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368809f-bd42-4519-a1d1-dba9b4b3b473 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:38.509756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:38.516121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:38.567588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194deda-a47e-4431-9fea-84a623086479 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:38.617116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e583f5-a07f-402f-952a-d71390508846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:38.618024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e583f5-a07f-402f-952a-d71390508846 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:38.618314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e583f5-a07f-402f-952a-d71390508846 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:38.618590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e583f5-a07f-402f-952a-d71390508846 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:38.619765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e583f5-a07f-402f-952a-d71390508846 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:38.620454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368809f-bd42-4519-a1d1-dba9b4b3b473 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:38.621225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e583f5-a07f-402f-952a-d71390508846 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:38.624281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 65/130] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:38 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:38.624953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e583f5-a07f-402f-952a-d71390508846 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:38.657873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9a70-2e2a-4258-9dea-af2f348e58e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:38.658853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9a70-2e2a-4258-9dea-af2f348e58e0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:38.659303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9a70-2e2a-4258-9dea-af2f348e58e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:38.659745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9a70-2e2a-4258-9dea-af2f348e58e0 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:38.661041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab9a70-2e2a-4258-9dea-af2f348e58e0 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:38.662710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab9a70-2e2a-4258-9dea-af2f348e58e0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:38.664499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 66/131] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:38 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:38.669926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9a70-2e2a-4258-9dea-af2f348e58e0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:38.735429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e583f5-a07f-402f-952a-d71390508846 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:38.749451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:38.763859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:38.770809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070d8c5-58cd-4e19-bc88-2de13d463f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:38.771726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d8c5-58cd-4e19-bc88-2de13d463f0c None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:38.772196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d8c5-58cd-4e19-bc88-2de13d463f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:38.772659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d8c5-58cd-4e19-bc88-2de13d463f0c None admin] PATH_INFO: `/v3/projects/37410e96cc924a2eb9fa909600123cb6/users/0a61cd86a351421ca5fde715dd4da46e/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:38.774831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070d8c5-58cd-4e19-bc88-2de13d463f0c None admin] RBAC: Authorizing `identity:create_grant(project_id=37410e96cc924a2eb9fa909600123cb6, user_id=0a61cd86a351421ca5fde715dd4da46e, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:38.776521 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070d8c5-58cd-4e19-bc88-2de13d463f0c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:38.782688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9a70-2e2a-4258-9dea-af2f348e58e0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:38.818155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee4a4f-9f69-4644-aed4-b5aa9d70f876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:38.818797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee4a4f-9f69-4644-aed4-b5aa9d70f876 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:38.819081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee4a4f-9f69-4644-aed4-b5aa9d70f876 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:38.819356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee4a4f-9f69-4644-aed4-b5aa9d70f876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:38.881880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 66/132] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:58:38 2022] PUT /identity/v3/projects/37410e96cc924a2eb9fa909600123cb6/users/0a61cd86a351421ca5fde715dd4da46e/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:58:38.883406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070d8c5-58cd-4e19-bc88-2de13d463f0c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:38.894943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee4a4f-9f69-4644-aed4-b5aa9d70f876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:38.896545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee4a4f-9f69-4644-aed4-b5aa9d70f876 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:39.016087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:39.080694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070d8c5-58cd-4e19-bc88-2de13d463f0c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:39.088472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 67/133] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:39.090706 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee4a4f-9f69-4644-aed4-b5aa9d70f876 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:39.131777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3770d79-a145-434f-8cb0-05e226d2286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:39.132474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3770d79-a145-434f-8cb0-05e226d2286b None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:39.132740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3770d79-a145-434f-8cb0-05e226d2286b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:39.133005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3770d79-a145-434f-8cb0-05e226d2286b None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6/users/36773b7875fb4147ba998e41ff5a8fe9/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:39.134986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3770d79-a145-434f-8cb0-05e226d2286b None admin] RBAC: Authorizing `identity:create_grant(project_id=680231dab5b3448499d71c6cba44d7c6, user_id=36773b7875fb4147ba998e41ff5a8fe9, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:39.136525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3770d79-a145-434f-8cb0-05e226d2286b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:39.218336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 67/134] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:58:38 2022] PUT /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6/users/36773b7875fb4147ba998e41ff5a8fe9/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:58:39.220267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3770d79-a145-434f-8cb0-05e226d2286b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:39.222499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee4a4f-9f69-4644-aed4-b5aa9d70f876 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:39.299781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbe200-a371-4e98-b25d-59bcef312e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:39.301358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbe200-a371-4e98-b25d-59bcef312e73 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:39.301642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbe200-a371-4e98-b25d-59bcef312e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:39.304133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbe200-a371-4e98-b25d-59bcef312e73 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6/users/0a61cd86a351421ca5fde715dd4da46e/roles/779e95b5df394f2a95fbdfa2a9fb58eb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:39.306504 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbe200-a371-4e98-b25d-59bcef312e73 None admin] RBAC: Authorizing `identity:create_grant(project_id=680231dab5b3448499d71c6cba44d7c6, user_id=0a61cd86a351421ca5fde715dd4da46e, role_id=779e95b5df394f2a95fbdfa2a9fb58eb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:39.308046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbe200-a371-4e98-b25d-59bcef312e73 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:39.330038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:39.395381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 68/135] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:58:39 2022] PUT /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6/users/0a61cd86a351421ca5fde715dd4da46e/roles/779e95b5df394f2a95fbdfa2a9fb58eb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:58:39.406053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3770d79-a145-434f-8cb0-05e226d2286b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:39.472508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d2d40-92a1-4b0b-be96-bb6626f3ff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:39.473170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d2d40-92a1-4b0b-be96-bb6626f3ff21 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:39.473434 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d2d40-92a1-4b0b-be96-bb6626f3ff21 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:39.473708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d2d40-92a1-4b0b-be96-bb6626f3ff21 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:39.474984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d2d40-92a1-4b0b-be96-bb6626f3ff21 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:39.476514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d2d40-92a1-4b0b-be96-bb6626f3ff21 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:39.478422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 68/136] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:39 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:39.484791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbe200-a371-4e98-b25d-59bcef312e73 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:39.538345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:39.631945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbe200-a371-4e98-b25d-59bcef312e73 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:39.662946 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda790-fb5f-430b-ae64-817fc1958a84 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:39.663249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda790-fb5f-430b-ae64-817fc1958a84 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:39.663509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda790-fb5f-430b-ae64-817fc1958a84 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:39.664918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 69/137] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:58:39.670718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea4a7-6115-4c47-aa17-3293db77cf6b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:39.671016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea4a7-6115-4c47-aa17-3293db77cf6b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:39.671275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ea4a7-6115-4c47-aa17-3293db77cf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:39.694114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c93ea4a7-6115-4c47-aa17-3293db77cf6b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:39.694298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b630aa-fbb4-48e3-a8a3-67278455ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:39.694839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b630aa-fbb4-48e3-a8a3-67278455ebfe None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:39.695124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b630aa-fbb4-48e3-a8a3-67278455ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:39.695398 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b630aa-fbb4-48e3-a8a3-67278455ebfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:39.695663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c93ea4a7-6115-4c47-aa17-3293db77cf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:39.696204 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b630aa-fbb4-48e3-a8a3-67278455ebfe None admin] RBAC: Adding query filter params (role.id=a970a114620e467295e3dd153a9f4321, scope.project.id=680231dab5b3448499d71c6cba44d7c6, user.id=5ac872662dc6483f9570d4a13ee8daa1) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:39.696519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b630aa-fbb4-48e3-a8a3-67278455ebfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:39.698060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b630aa-fbb4-48e3-a8a3-67278455ebfe None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:39.712319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 69/138] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:39 2022] GET /identity/v3/role_assignments?user.id=5ac872662dc6483f9570d4a13ee8daa1&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=a970a114620e467295e3dd153a9f4321 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:39.775256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 70/139] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:40.119654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533f1e-642d-4380-a4ba-68b4ac140602 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:40.120025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533f1e-642d-4380-a4ba-68b4ac140602 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:40.120190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533f1e-642d-4380-a4ba-68b4ac140602 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:40.121688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 70/140] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:40.127259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ea4a7-6115-4c47-aa17-3293db77cf6b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:40.133381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1788-12eb-4ba9-83d5-bd171d5f70cc None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:40.133653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1788-12eb-4ba9-83d5-bd171d5f70cc None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:40.133920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1788-12eb-4ba9-83d5-bd171d5f70cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:40.178161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3ead1788-12eb-4ba9-83d5-bd171d5f70cc None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:40.179431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3ead1788-12eb-4ba9-83d5-bd171d5f70cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:40.247009 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:40.331830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:58:40.343130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ea4a7-6115-4c47-aa17-3293db77cf6b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:40.380225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70671f5-591b-4d30-a86a-d95349c93769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:40.380787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70671f5-591b-4d30-a86a-d95349c93769 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:40.381070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70671f5-591b-4d30-a86a-d95349c93769 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:40.381347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70671f5-591b-4d30-a86a-d95349c93769 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:40.382475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70671f5-591b-4d30-a86a-d95349c93769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:40.383994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70671f5-591b-4d30-a86a-d95349c93769 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:40.385746 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 71/142] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:40.391063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead1788-12eb-4ba9-83d5-bd171d5f70cc None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:40.429170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:40.526522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead1788-12eb-4ba9-83d5-bd171d5f70cc None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:40.568865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42e87f-70e7-4e1f-9398-58777e5b85a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:40.570271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e87f-70e7-4e1f-9398-58777e5b85a5 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:40.570778 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e87f-70e7-4e1f-9398-58777e5b85a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:40.571243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e87f-70e7-4e1f-9398-58777e5b85a5 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:40.572088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42e87f-70e7-4e1f-9398-58777e5b85a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:40.573732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42e87f-70e7-4e1f-9398-58777e5b85a5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:40.705648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 72/143] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:58:40 2022] POST /identity/v3/users => generated 283 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:40.789488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70671f5-591b-4d30-a86a-d95349c93769 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:40.923844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70671f5-591b-4d30-a86a-d95349c93769 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:40.943825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:40.964928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7f0a7-bc64-4c29-91ae-431a4e8a027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:40.965506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7f0a7-bc64-4c29-91ae-431a4e8a027a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:40.965787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7f0a7-bc64-4c29-91ae-431a4e8a027a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:40.966065 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7f0a7-bc64-4c29-91ae-431a4e8a027a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:40.978129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7f0a7-bc64-4c29-91ae-431a4e8a027a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-dfd7f0a7-bc64-4c29-91ae-431a4e8a027a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:40.983324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:40.984247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:40.985565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 72/144] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:40.992377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42e87f-70e7-4e1f-9398-58777e5b85a5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:41.088550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:41.114202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42e87f-70e7-4e1f-9398-58777e5b85a5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:41.169529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a754a-81da-43d3-8e5c-3379b3f67c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:41.170167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a754a-81da-43d3-8e5c-3379b3f67c3b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:41.170456 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a754a-81da-43d3-8e5c-3379b3f67c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:41.170994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a754a-81da-43d3-8e5c-3379b3f67c3b None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:41.172160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a754a-81da-43d3-8e5c-3379b3f67c3b None admin] RBAC: Adding query filter params (name=member) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:41.173247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a754a-81da-43d3-8e5c-3379b3f67c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:41.175640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a754a-81da-43d3-8e5c-3379b3f67c3b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:41.190307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 73/145] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:41.195942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7f0a7-bc64-4c29-91ae-431a4e8a027a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:41.310210 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7f0a7-bc64-4c29-91ae-431a4e8a027a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:41.346588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b28a55-6d73-4780-99cb-045217261e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:41.347262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28a55-6d73-4780-99cb-045217261e18 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:41.347547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28a55-6d73-4780-99cb-045217261e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:41.347827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28a55-6d73-4780-99cb-045217261e18 None admin] PATH_INFO: `/v3/users/0a61cd86a351421ca5fde715dd4da46e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:41.348978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b28a55-6d73-4780-99cb-045217261e18 None admin] RBAC: Authorizing `identity:get_user(user_id=0a61cd86a351421ca5fde715dd4da46e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:41.350448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b28a55-6d73-4780-99cb-045217261e18 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:41.352080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 73/146] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:41 2022] GET /identity/v3/users/0a61cd86a351421ca5fde715dd4da46e => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:41.357591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a754a-81da-43d3-8e5c-3379b3f67c3b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:41.479588 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a754a-81da-43d3-8e5c-3379b3f67c3b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:41.515350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62914758-90dc-481c-a7ff-a50eea762965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:41.515974 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62914758-90dc-481c-a7ff-a50eea762965 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:41.516839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62914758-90dc-481c-a7ff-a50eea762965 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:41.517115 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62914758-90dc-481c-a7ff-a50eea762965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:41.534016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:41.592633 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62914758-90dc-481c-a7ff-a50eea762965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:41.594062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62914758-90dc-481c-a7ff-a50eea762965 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:41.700350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 74/147] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:41.706615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b28a55-6d73-4780-99cb-045217261e18 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:41.756691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:41.816638 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b28a55-6d73-4780-99cb-045217261e18 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:41.856955 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee89e1-4998-426b-9cba-784d9be3fdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:41.857521 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee89e1-4998-426b-9cba-784d9be3fdf8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:41.857865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee89e1-4998-426b-9cba-784d9be3fdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:41.858144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee89e1-4998-426b-9cba-784d9be3fdf8 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:41.859308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee89e1-4998-426b-9cba-784d9be3fdf8 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:41.860798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee89e1-4998-426b-9cba-784d9be3fdf8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:41.862449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 74/148] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:41 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:41.868683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62914758-90dc-481c-a7ff-a50eea762965 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:41.919120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:41.965739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c588e-0625-49a7-a1de-3fbe7f881065 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:41.966364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c588e-0625-49a7-a1de-3fbe7f881065 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:41.966882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c588e-0625-49a7-a1de-3fbe7f881065 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:41.968581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 75/149] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:58:41.976730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7165aa7-6aae-452d-8ddf-337b6e0d782b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:41.977801 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7165aa7-6aae-452d-8ddf-337b6e0d782b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:41.978768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7165aa7-6aae-452d-8ddf-337b6e0d782b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:41.990570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62914758-90dc-481c-a7ff-a50eea762965 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:42.003682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b7165aa7-6aae-452d-8ddf-337b6e0d782b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:42.005377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b7165aa7-6aae-452d-8ddf-337b6e0d782b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:42.045208 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bbb71-2b16-4330-98e8-754983670ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:42.045829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bbb71-2b16-4330-98e8-754983670ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:42.046114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bbb71-2b16-4330-98e8-754983670ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:42.046391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bbb71-2b16-4330-98e8-754983670ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:42.047146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bbb71-2b16-4330-98e8-754983670ea8 None admin] RBAC: Adding query filter params (role.id=6ba784d4bd374e1793729d1ff430e45f, scope.project.id=680231dab5b3448499d71c6cba44d7c6, user.id=0a61cd86a351421ca5fde715dd4da46e) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:42.047673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bbb71-2b16-4330-98e8-754983670ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:42.049289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bbb71-2b16-4330-98e8-754983670ea8 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:42.059311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 75/150] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:41 2022] GET /identity/v3/role_assignments?user.id=0a61cd86a351421ca5fde715dd4da46e&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:42.097176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 76/151] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:42.647025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bbb71-2b16-4330-98e8-754983670ea8 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:42.661250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1752e33-a862-47d7-baea-ae8b828b52e4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:42.661871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1752e33-a862-47d7-baea-ae8b828b52e4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:42.662376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1752e33-a862-47d7-baea-ae8b828b52e4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:42.664187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 77/152] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:42.670910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4de674-eddf-49ec-bc00-babdd2864d85 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:42.671477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4de674-eddf-49ec-bc00-babdd2864d85 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:42.671936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4de674-eddf-49ec-bc00-babdd2864d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:42.695933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9b4de674-eddf-49ec-bc00-babdd2864d85 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:42.697488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9b4de674-eddf-49ec-bc00-babdd2864d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:42.747324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:42.784785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 78/153] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:58:42.786095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bbb71-2b16-4330-98e8-754983670ea8 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:42.791449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b3d00-a539-4727-91ba-842cc8bf7550 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:42.796848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b3d00-a539-4727-91ba-842cc8bf7550 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:42.798218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b3d00-a539-4727-91ba-842cc8bf7550 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:42.802178 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:42.803153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 79/154] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:42 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:42.813135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa50d8-52c7-42e3-848d-183e2d1df7ed None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:42.819559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa50d8-52c7-42e3-848d-183e2d1df7ed None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:42.819559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa50d8-52c7-42e3-848d-183e2d1df7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:42.834658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55fe73-0a3b-42e9-9346-e602cf7f5804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:42.835721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55fe73-0a3b-42e9-9346-e602cf7f5804 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:42.836146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55fe73-0a3b-42e9-9346-e602cf7f5804 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:42.836592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55fe73-0a3b-42e9-9346-e602cf7f5804 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:42.850066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55fe73-0a3b-42e9-9346-e602cf7f5804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-ef55fe73-0a3b-42e9-9346-e602cf7f5804 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:42.856185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:42.857058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:42.857843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:42.861243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 76/155] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:42.866843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55fe73-0a3b-42e9-9346-e602cf7f5804 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:42.868182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c4aa50d8-52c7-42e3-848d-183e2d1df7ed None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:42.870329 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c4aa50d8-52c7-42e3-848d-183e2d1df7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:42.985608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55fe73-0a3b-42e9-9346-e602cf7f5804 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:43.024229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cfa50-66bc-4af4-9b87-b1215145efe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:43.025204 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cfa50-66bc-4af4-9b87-b1215145efe2 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:43.025683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cfa50-66bc-4af4-9b87-b1215145efe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:43.026235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cfa50-66bc-4af4-9b87-b1215145efe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:43.027144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cfa50-66bc-4af4-9b87-b1215145efe2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:43.027673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cfa50-66bc-4af4-9b87-b1215145efe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:43.029578 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cfa50-66bc-4af4-9b87-b1215145efe2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:43.040509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 77/156] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:43.045924 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cfa50-66bc-4af4-9b87-b1215145efe2 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:43.066799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 80/157] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 08 15:58:43.080728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:43.154720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cfa50-66bc-4af4-9b87-b1215145efe2 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:43.190517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f05d71-790f-4f72-99f6-0a19cf82b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:43.191510 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f05d71-790f-4f72-99f6-0a19cf82b8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:43.191989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f05d71-790f-4f72-99f6-0a19cf82b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:43.192489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f05d71-790f-4f72-99f6-0a19cf82b8f8 None admin] PATH_INFO: `/v3/users/0a61cd86a351421ca5fde715dd4da46e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:43.193856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f05d71-790f-4f72-99f6-0a19cf82b8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=0a61cd86a351421ca5fde715dd4da46e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:43.195550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f05d71-790f-4f72-99f6-0a19cf82b8f8 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:43.197662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 78/158] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:43 2022] GET /identity/v3/users/0a61cd86a351421ca5fde715dd4da46e => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:43.204199 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa50d8-52c7-42e3-848d-183e2d1df7ed None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:43.408834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa50d8-52c7-42e3-848d-183e2d1df7ed None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:43.411326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:43.471762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1f33f-3c04-4243-b9f8-7ad04c7a1612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:43.472771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1f33f-3c04-4243-b9f8-7ad04c7a1612 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:43.473254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1f33f-3c04-4243-b9f8-7ad04c7a1612 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:43.473716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1f33f-3c04-4243-b9f8-7ad04c7a1612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:43.475818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f05d71-790f-4f72-99f6-0a19cf82b8f8 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:43.601452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:43.601900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1f33f-3c04-4243-b9f8-7ad04c7a1612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:43.605153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1f33f-3c04-4243-b9f8-7ad04c7a1612 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:43.606359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f05d71-790f-4f72-99f6-0a19cf82b8f8 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:43.653433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddeede-a1f7-4809-a9b8-ee1e347e2bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:43.655791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddeede-a1f7-4809-a9b8-ee1e347e2bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:43.656278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddeede-a1f7-4809-a9b8-ee1e347e2bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:43.656831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddeede-a1f7-4809-a9b8-ee1e347e2bb1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:43.670638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddeede-a1f7-4809-a9b8-ee1e347e2bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-a2ddeede-a1f7-4809-a9b8-ee1e347e2bb1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:43.676982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:43.677872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:58:43.678779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:43.685121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 79/159] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:43.693295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddeede-a1f7-4809-a9b8-ee1e347e2bb1 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:43.833457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 81/160] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:43.834762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfde1-463c-446d-837c-36fe47fe2c44 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:43.835035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfde1-463c-446d-837c-36fe47fe2c44 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:43.835312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfde1-463c-446d-837c-36fe47fe2c44 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:43.836727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 82/161] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:43.837273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bfde1-463c-446d-837c-36fe47fe2c44 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:43.844702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:43.868527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddeede-a1f7-4809-a9b8-ee1e347e2bb1 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:43.909789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ce34f-c870-4e45-a357-4b725532ea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:43.910686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce34f-c870-4e45-a357-4b725532ea71 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:43.910973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce34f-c870-4e45-a357-4b725532ea71 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:43.911581 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce34f-c870-4e45-a357-4b725532ea71 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:43.912311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ce34f-c870-4e45-a357-4b725532ea71 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:43.912628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ce34f-c870-4e45-a357-4b725532ea71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:43.914096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ce34f-c870-4e45-a357-4b725532ea71 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:43.928015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 80/162] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:43.928015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849e168-a0be-46e1-bad1-ca7b99cdf9a2 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:43.928015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849e168-a0be-46e1-bad1-ca7b99cdf9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:43.928015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849e168-a0be-46e1-bad1-ca7b99cdf9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:43.954781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-4849e168-a0be-46e1-bad1-ca7b99cdf9a2 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:43.955998 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4849e168-a0be-46e1-bad1-ca7b99cdf9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:43.977551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:44.066763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 81/163] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:44.067359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bfde1-463c-446d-837c-36fe47fe2c44 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:44.067690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849e168-a0be-46e1-bad1-ca7b99cdf9a2 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:44.160862 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45863efc-f8cb-4fae-8acc-0abea1b0a7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:44.161517 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45863efc-f8cb-4fae-8acc-0abea1b0a7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:44.161792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45863efc-f8cb-4fae-8acc-0abea1b0a7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:44.162059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45863efc-f8cb-4fae-8acc-0abea1b0a7e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:44.190319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45863efc-f8cb-4fae-8acc-0abea1b0a7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-45863efc-f8cb-4fae-8acc-0abea1b0a7e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:44.195406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:44.196268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:44.197038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 83/164] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:58:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:44.197796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45863efc-f8cb-4fae-8acc-0abea1b0a7e9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:44.265253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:44.274101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849e168-a0be-46e1-bad1-ca7b99cdf9a2 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:44.307945 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45863efc-f8cb-4fae-8acc-0abea1b0a7e9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:44.339007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cf2f0-39a9-437d-8c89-b01dea1deafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:44.339830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cf2f0-39a9-437d-8c89-b01dea1deafb None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:44.340207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cf2f0-39a9-437d-8c89-b01dea1deafb None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:44.340672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cf2f0-39a9-437d-8c89-b01dea1deafb None admin] PATH_INFO: `/v3/projects/37410e96cc924a2eb9fa909600123cb6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:44.344300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92cf2f0-39a9-437d-8c89-b01dea1deafb None admin] RBAC: Authorizing `identity:get_project(project_id=37410e96cc924a2eb9fa909600123cb6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:44.346083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92cf2f0-39a9-437d-8c89-b01dea1deafb None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:44.346737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a1a7-668b-43e5-b2c9-ff5572722f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:44.347522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a1a7-668b-43e5-b2c9-ff5572722f02 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:44.347940 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a1a7-668b-43e5-b2c9-ff5572722f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:44.348356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 82/165] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:44 2022] GET /identity/v3/projects/37410e96cc924a2eb9fa909600123cb6 => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:44.348804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a1a7-668b-43e5-b2c9-ff5572722f02 None admin] PATH_INFO: `/v3/users/5ac872662dc6483f9570d4a13ee8daa1` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:44.349128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cf2f0-39a9-437d-8c89-b01dea1deafb None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:44.350449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868a1a7-668b-43e5-b2c9-ff5572722f02 None admin] RBAC: Authorizing `identity:get_user(user_id=5ac872662dc6483f9570d4a13ee8daa1)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:44.352047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868a1a7-668b-43e5-b2c9-ff5572722f02 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:44.354088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 84/166] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:44 2022] GET /identity/v3/users/5ac872662dc6483f9570d4a13ee8daa1 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:44.359867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a1a7-668b-43e5-b2c9-ff5572722f02 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:44.387127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:44.555750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cf2f0-39a9-437d-8c89-b01dea1deafb None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:44.564796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a1a7-668b-43e5-b2c9-ff5572722f02 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:44.602502 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:44.609596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5a050-dd66-4b4b-b426-952eaed3c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:44.610234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5a050-dd66-4b4b-b426-952eaed3c2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:44.610510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5a050-dd66-4b4b-b426-952eaed3c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:44.610808 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5a050-dd66-4b4b-b426-952eaed3c2a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:44.611543 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5a050-dd66-4b4b-b426-952eaed3c2a6 None admin] RBAC: Adding query filter params (role.id=6ba784d4bd374e1793729d1ff430e45f, scope.project.id=37410e96cc924a2eb9fa909600123cb6, user.id=0a61cd86a351421ca5fde715dd4da46e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:44.611849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5a050-dd66-4b4b-b426-952eaed3c2a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:44.613301 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5a050-dd66-4b4b-b426-952eaed3c2a6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:44.615434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a7d00-39a1-4bf1-adbb-66d6f29c01de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:44.616049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7d00-39a1-4bf1-adbb-66d6f29c01de None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:44.616328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7d00-39a1-4bf1-adbb-66d6f29c01de None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:44.616602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7d00-39a1-4bf1-adbb-66d6f29c01de None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:44.617271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a7d00-39a1-4bf1-adbb-66d6f29c01de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:44.617572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a7d00-39a1-4bf1-adbb-66d6f29c01de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:44.619156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a7d00-39a1-4bf1-adbb-66d6f29c01de None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:44.619600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 85/167] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:44 2022] GET /identity/v3/role_assignments?user.id=0a61cd86a351421ca5fde715dd4da46e&scope.project.id=37410e96cc924a2eb9fa909600123cb6&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:44.620454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5a050-dd66-4b4b-b426-952eaed3c2a6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:44.628292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 83/168] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:44.634193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a7d00-39a1-4bf1-adbb-66d6f29c01de None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:44.736441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:44.737052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5a050-dd66-4b4b-b426-952eaed3c2a6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:44.772598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a7d00-39a1-4bf1-adbb-66d6f29c01de None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:44.775672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa1963-6a8d-4811-baab-5c33a053c2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:44.776333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa1963-6a8d-4811-baab-5c33a053c2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:44.776615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa1963-6a8d-4811-baab-5c33a053c2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:44.776890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa1963-6a8d-4811-baab-5c33a053c2b7 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:44.778152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa1963-6a8d-4811-baab-5c33a053c2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:44.780798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa1963-6a8d-4811-baab-5c33a053c2b7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:44.783226 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 86/169] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:44 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:44.784101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa1963-6a8d-4811-baab-5c33a053c2b7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:44.840274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6c9b2-9db4-43dc-a29e-d3bc3dcb3f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:44.840846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6c9b2-9db4-43dc-a29e-d3bc3dcb3f05 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:44.841126 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6c9b2-9db4-43dc-a29e-d3bc3dcb3f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:44.841402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6c9b2-9db4-43dc-a29e-d3bc3dcb3f05 None admin] PATH_INFO: `/v3/users/36773b7875fb4147ba998e41ff5a8fe9` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:44.842696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6c9b2-9db4-43dc-a29e-d3bc3dcb3f05 None admin] RBAC: Authorizing `identity:get_user(user_id=36773b7875fb4147ba998e41ff5a8fe9)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:44.844245 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6c9b2-9db4-43dc-a29e-d3bc3dcb3f05 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:44.846178 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 84/170] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:44 2022] GET /identity/v3/users/36773b7875fb4147ba998e41ff5a8fe9 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:44.852592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6c9b2-9db4-43dc-a29e-d3bc3dcb3f05 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:44.855063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:44.903302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa1963-6a8d-4811-baab-5c33a053c2b7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:44.943695 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e37da-e13e-41e5-8c36-6f57f9210ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:44.944459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e37da-e13e-41e5-8c36-6f57f9210ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:44.944741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e37da-e13e-41e5-8c36-6f57f9210ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:44.945012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e37da-e13e-41e5-8c36-6f57f9210ae4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:44.958203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e37da-e13e-41e5-8c36-6f57f9210ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-121e37da-e13e-41e5-8c36-6f57f9210ae4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:44.964378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:44.966485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 87/171] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:58:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:44.967957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e37da-e13e-41e5-8c36-6f57f9210ae4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:45.021323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6c9b2-9db4-43dc-a29e-d3bc3dcb3f05 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:45.059732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5bf79-b631-4699-9b8b-10572a864a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:45.060403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5bf79-b631-4699-9b8b-10572a864a48 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:45.060683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5bf79-b631-4699-9b8b-10572a864a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:45.060956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5bf79-b631-4699-9b8b-10572a864a48 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6/users/5ac872662dc6483f9570d4a13ee8daa1/roles/a970a114620e467295e3dd153a9f4321` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:45.063500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5bf79-b631-4699-9b8b-10572a864a48 None admin] RBAC: Authorizing `identity:create_grant(project_id=680231dab5b3448499d71c6cba44d7c6, user_id=5ac872662dc6483f9570d4a13ee8daa1, role_id=a970a114620e467295e3dd153a9f4321)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:45.065260 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5bf79-b631-4699-9b8b-10572a864a48 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:45.091124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e37da-e13e-41e5-8c36-6f57f9210ae4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:45.113959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:45.126342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d8be0-11f1-45fb-806a-0ce020a4fab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:45.127039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d8be0-11f1-45fb-806a-0ce020a4fab8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:45.127316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d8be0-11f1-45fb-806a-0ce020a4fab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:45.127588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d8be0-11f1-45fb-806a-0ce020a4fab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:45.146290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 85/172] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:58:44 2022] PUT /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6/users/5ac872662dc6483f9570d4a13ee8daa1/roles/a970a114620e467295e3dd153a9f4321 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:58:45.147210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5bf79-b631-4699-9b8b-10572a864a48 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:45.170827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:45.218094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d8be0-11f1-45fb-806a-0ce020a4fab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:45.219828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d8be0-11f1-45fb-806a-0ce020a4fab8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:45.342377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5bf79-b631-4699-9b8b-10572a864a48 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:45.345115 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 88/173] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:45.351601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d8be0-11f1-45fb-806a-0ce020a4fab8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:45.426748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb3cf-b942-4cbb-8308-5afd5bda07a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:45.426948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb3cf-b942-4cbb-8308-5afd5bda07a4 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:45.430691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb3cf-b942-4cbb-8308-5afd5bda07a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:45.430691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb3cf-b942-4cbb-8308-5afd5bda07a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:45.430691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb3cf-b942-4cbb-8308-5afd5bda07a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:45.430691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb3cf-b942-4cbb-8308-5afd5bda07a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:45.430691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb3cf-b942-4cbb-8308-5afd5bda07a4 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:45.433677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:45.446165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 86/174] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:58:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:45.452152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb3cf-b942-4cbb-8308-5afd5bda07a4 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:45.574151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d8be0-11f1-45fb-806a-0ce020a4fab8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:45.585634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:45.619279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ceec23-f1f4-486e-943f-d495418bf289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:45.620056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceec23-f1f4-486e-943f-d495418bf289 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:45.620397 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceec23-f1f4-486e-943f-d495418bf289 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:45.620735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceec23-f1f4-486e-943f-d495418bf289 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:45.622057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ceec23-f1f4-486e-943f-d495418bf289 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:45.624173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ceec23-f1f4-486e-943f-d495418bf289 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:45.625185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb3cf-b942-4cbb-8308-5afd5bda07a4 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:45.626296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 89/175] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:45 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:45.631663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ad7a2-4c6a-4ff7-8487-7ebf47fef67c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:45.632874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ad7a2-4c6a-4ff7-8487-7ebf47fef67c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:45.633328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ad7a2-4c6a-4ff7-8487-7ebf47fef67c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:45.636336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 90/176] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:45.637157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ad7a2-4c6a-4ff7-8487-7ebf47fef67c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:45.676413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bf0d0-aaa8-4388-b6a3-a7361778b8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:45.677511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bf0d0-aaa8-4388-b6a3-a7361778b8cd None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:45.678019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bf0d0-aaa8-4388-b6a3-a7361778b8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:45.678840 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bf0d0-aaa8-4388-b6a3-a7361778b8cd None admin] PATH_INFO: `/v3/users/0a61cd86a351421ca5fde715dd4da46e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:45.680476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bf0d0-aaa8-4388-b6a3-a7361778b8cd None admin] RBAC: Authorizing `identity:get_user(user_id=0a61cd86a351421ca5fde715dd4da46e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:45.682124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bf0d0-aaa8-4388-b6a3-a7361778b8cd None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:45.685340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 87/177] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:45 2022] GET /identity/v3/users/0a61cd86a351421ca5fde715dd4da46e => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:45.686780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045733b-4f36-4a29-99b7-0e91435ac6b1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:45.687306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045733b-4f36-4a29-99b7-0e91435ac6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:45.687794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045733b-4f36-4a29-99b7-0e91435ac6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:45.712681 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-4045733b-4f36-4a29-99b7-0e91435ac6b1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:45.714741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4045733b-4f36-4a29-99b7-0e91435ac6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:45.771056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:45.793991 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ad7a2-4c6a-4ff7-8487-7ebf47fef67c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:45.860369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 88/178] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:45.861248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045733b-4f36-4a29-99b7-0e91435ac6b1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:45.870494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52269cb0-678d-443f-ab6a-0ddc980c2cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:45.871138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269cb0-678d-443f-ab6a-0ddc980c2cfe None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:45.871415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269cb0-678d-443f-ab6a-0ddc980c2cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:45.871780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52269cb0-678d-443f-ab6a-0ddc980c2cfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:45.872508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269cb0-678d-443f-ab6a-0ddc980c2cfe None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=680231dab5b3448499d71c6cba44d7c6, user.id=36773b7875fb4147ba998e41ff5a8fe9) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:45.872812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269cb0-678d-443f-ab6a-0ddc980c2cfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:45.874314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52269cb0-678d-443f-ab6a-0ddc980c2cfe None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:45.885877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 91/179] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:45 2022] GET /identity/v3/role_assignments?user.id=36773b7875fb4147ba998e41ff5a8fe9&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=519b356d36364663a59265dc7eeff0b8 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:45.935013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3ebf0-1298-49db-9306-5cffeed6eceb None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:45.935349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3ebf0-1298-49db-9306-5cffeed6eceb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:45.935568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3ebf0-1298-49db-9306-5cffeed6eceb None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:45.937623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 92/180] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:45.944154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf1403-76bb-4ef3-8a60-2baaad3da1a1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:45.944501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf1403-76bb-4ef3-8a60-2baaad3da1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:45.944776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf1403-76bb-4ef3-8a60-2baaad3da1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:45.984127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4ebf1403-76bb-4ef3-8a60-2baaad3da1a1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:45.985628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4ebf1403-76bb-4ef3-8a60-2baaad3da1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:46.017731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:46.085666 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045733b-4f36-4a29-99b7-0e91435ac6b1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:46.148485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 93/181] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:46.149274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3121c0-706a-49c9-b82e-4db3e5d26503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:46.150026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3121c0-706a-49c9-b82e-4db3e5d26503 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:46.150303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3121c0-706a-49c9-b82e-4db3e5d26503 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:46.150573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3121c0-706a-49c9-b82e-4db3e5d26503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:46.172693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e70d7-7d08-468b-ac69-fde9bfd8add2 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:46.173020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e70d7-7d08-468b-ac69-fde9bfd8add2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:46.173241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e70d7-7d08-468b-ac69-fde9bfd8add2 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:46.176380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 94/182] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:46.181769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad48c8-ed09-4b12-9eac-4e571e621f67 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:46.182047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad48c8-ed09-4b12-9eac-4e571e621f67 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:46.182315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad48c8-ed09-4b12-9eac-4e571e621f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:46.230170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8dad48c8-ed09-4b12-9eac-4e571e621f67 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:46.231725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8dad48c8-ed09-4b12-9eac-4e571e621f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:46.257430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3121c0-706a-49c9-b82e-4db3e5d26503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:46.258943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3121c0-706a-49c9-b82e-4db3e5d26503 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:46.332840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 95/183] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:58:46.333817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad48c8-ed09-4b12-9eac-4e571e621f67 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:46.341297 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:46.351284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:46.413493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 89/184] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:46.424113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3121c0-706a-49c9-b82e-4db3e5d26503 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:46.443370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad48c8-ed09-4b12-9eac-4e571e621f67 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:46.480603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7078-8170-42bc-b695-11512fa2fd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:46.481240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7078-8170-42bc-b695-11512fa2fd56 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:46.481520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7078-8170-42bc-b695-11512fa2fd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:46.481793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7078-8170-42bc-b695-11512fa2fd56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:46.492609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b7078-8170-42bc-b695-11512fa2fd56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-2d0b7078-8170-42bc-b695-11512fa2fd56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:46.497769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:46.498714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:46.499548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:46.500756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 96/185] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:58:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:46.507600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7078-8170-42bc-b695-11512fa2fd56 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:46.575875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3121c0-706a-49c9-b82e-4db3e5d26503 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:46.601114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:46.615059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a90ae5-cd04-4f20-9342-0b8fc00673d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:46.615989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90ae5-cd04-4f20-9342-0b8fc00673d2 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:46.616441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90ae5-cd04-4f20-9342-0b8fc00673d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:46.616911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a90ae5-cd04-4f20-9342-0b8fc00673d2 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:46.618395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a90ae5-cd04-4f20-9342-0b8fc00673d2 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:46.620076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a90ae5-cd04-4f20-9342-0b8fc00673d2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:46.621985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 90/186] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:46 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:46.622986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a90ae5-cd04-4f20-9342-0b8fc00673d2 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:46.628956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7078-8170-42bc-b695-11512fa2fd56 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:46.661913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:46.667555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73350a-69e2-49f2-85c5-b4b3b2bea8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:46.667949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73350a-69e2-49f2-85c5-b4b3b2bea8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:46.668227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73350a-69e2-49f2-85c5-b4b3b2bea8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:46.668503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73350a-69e2-49f2-85c5-b4b3b2bea8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:46.669202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73350a-69e2-49f2-85c5-b4b3b2bea8f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:46.669504 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73350a-69e2-49f2-85c5-b4b3b2bea8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:46.670899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73350a-69e2-49f2-85c5-b4b3b2bea8f4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:46.680302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 97/187] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:46.680941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73350a-69e2-49f2-85c5-b4b3b2bea8f4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:46.732787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a90ae5-cd04-4f20-9342-0b8fc00673d2 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:46.769052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad10e2d-5d5c-4bd9-9479-3a3c27af2512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:46.769684 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad10e2d-5d5c-4bd9-9479-3a3c27af2512 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:46.769953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad10e2d-5d5c-4bd9-9479-3a3c27af2512 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:46.770217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad10e2d-5d5c-4bd9-9479-3a3c27af2512 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:46.780210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad10e2d-5d5c-4bd9-9479-3a3c27af2512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-3ad10e2d-5d5c-4bd9-9479-3a3c27af2512 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:46.785053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:46.786051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:46.786880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 91/188] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:58:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:46.787540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad10e2d-5d5c-4bd9-9479-3a3c27af2512 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:46.802452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73350a-69e2-49f2-85c5-b4b3b2bea8f4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:46.837929 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eb271-2cf7-4704-aaf8-02619152445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:46.838517 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb271-2cf7-4704-aaf8-02619152445b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:46.838874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb271-2cf7-4704-aaf8-02619152445b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:46.839139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eb271-2cf7-4704-aaf8-02619152445b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:46.839858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eb271-2cf7-4704-aaf8-02619152445b None admin] RBAC: Adding query filter params (role.id=779e95b5df394f2a95fbdfa2a9fb58eb, scope.project.id=680231dab5b3448499d71c6cba44d7c6, user.id=0a61cd86a351421ca5fde715dd4da46e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:46.840169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eb271-2cf7-4704-aaf8-02619152445b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:46.841593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eb271-2cf7-4704-aaf8-02619152445b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:46.844421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:46.848161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 98/189] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:46 2022] GET /identity/v3/role_assignments?user.id=0a61cd86a351421ca5fde715dd4da46e&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=779e95b5df394f2a95fbdfa2a9fb58eb => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:46.855728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eb271-2cf7-4704-aaf8-02619152445b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:46.903458 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:46.910423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad10e2d-5d5c-4bd9-9479-3a3c27af2512 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:46.951594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034183e9-0fe1-4243-8768-a2c2fcd3b862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:46.952303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034183e9-0fe1-4243-8768-a2c2fcd3b862 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:46.952585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034183e9-0fe1-4243-8768-a2c2fcd3b862 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:46.952856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034183e9-0fe1-4243-8768-a2c2fcd3b862 None admin] PATH_INFO: `/v3/users/7e2559c582e7432db114189569767b5e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:46.969137 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034183e9-0fe1-4243-8768-a2c2fcd3b862 None admin] RBAC: Authorizing `identity:get_user(user_id=7e2559c582e7432db114189569767b5e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:46.970879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034183e9-0fe1-4243-8768-a2c2fcd3b862 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:46.972762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 92/190] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:46 2022] GET /identity/v3/users/7e2559c582e7432db114189569767b5e => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:46.973702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034183e9-0fe1-4243-8768-a2c2fcd3b862 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:46.995119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eb271-2cf7-4704-aaf8-02619152445b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:47.049306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c30cc-930a-42db-86cb-840d905c03c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:47.049945 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c30cc-930a-42db-86cb-840d905c03c4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:47.050221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c30cc-930a-42db-86cb-840d905c03c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:47.050492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c30cc-930a-42db-86cb-840d905c03c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:47.051749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c30cc-930a-42db-86cb-840d905c03c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:47.053645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c30cc-930a-42db-86cb-840d905c03c4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:47.055530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 99/191] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:47.056293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c30cc-930a-42db-86cb-840d905c03c4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:47.099955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034183e9-0fe1-4243-8768-a2c2fcd3b862 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:47.137728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a406-5985-427e-aa19-909938a03c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:47.138693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a406-5985-427e-aa19-909938a03c0b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:47.139211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a406-5985-427e-aa19-909938a03c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:47.139699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a406-5985-427e-aa19-909938a03c0b None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:47.140562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27a406-5985-427e-aa19-909938a03c0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:47.141085 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27a406-5985-427e-aa19-909938a03c0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:47.141545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:47.142694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27a406-5985-427e-aa19-909938a03c0b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:47.152260 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 93/192] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:58:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:47.152967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a406-5985-427e-aa19-909938a03c0b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:47.173518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:47.175540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c30cc-930a-42db-86cb-840d905c03c4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:47.213308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be12c11-3638-4211-8dec-ad5af074f22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:47.213854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be12c11-3638-4211-8dec-ad5af074f22e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:47.214133 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be12c11-3638-4211-8dec-ad5af074f22e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:47.214436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be12c11-3638-4211-8dec-ad5af074f22e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:47.259297 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a406-5985-427e-aa19-909938a03c0b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:47.289893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be12c11-3638-4211-8dec-ad5af074f22e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:47.291384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be12c11-3638-4211-8dec-ad5af074f22e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:47.295306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ab10d-492b-4e46-9c75-73cc1f3a3a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:47.296187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ab10d-492b-4e46-9c75-73cc1f3a3a56 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:47.296467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ab10d-492b-4e46-9c75-73cc1f3a3a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:47.296732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ab10d-492b-4e46-9c75-73cc1f3a3a56 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:47.297927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ab10d-492b-4e46-9c75-73cc1f3a3a56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:47.299393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ab10d-492b-4e46-9c75-73cc1f3a3a56 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:47.356604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:47.389461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 100/193] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:47.389461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be12c11-3638-4211-8dec-ad5af074f22e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:47.431492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 94/194] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:58:47 2022] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:47.431492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ab10d-492b-4e46-9c75-73cc1f3a3a56 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:47.518700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be12c11-3638-4211-8dec-ad5af074f22e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:47.545140 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:47.565194 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae499-cff4-4d42-ac4f-a0da20571fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:47.565963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae499-cff4-4d42-ac4f-a0da20571fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:47.566312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae499-cff4-4d42-ac4f-a0da20571fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:47.566677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae499-cff4-4d42-ac4f-a0da20571fe5 None admin] PATH_INFO: `/v3/users/7e2559c582e7432db114189569767b5e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:47.568070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aae499-cff4-4d42-ac4f-a0da20571fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=7e2559c582e7432db114189569767b5e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:47.569632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aae499-cff4-4d42-ac4f-a0da20571fe5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:47.576744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 101/195] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:47 2022] GET /identity/v3/users/7e2559c582e7432db114189569767b5e => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:47.578988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae499-cff4-4d42-ac4f-a0da20571fe5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:47.585838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ab10d-492b-4e46-9c75-73cc1f3a3a56 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:47.628997 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:47.639933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bcc45-269c-4ddd-af0d-21e243028044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:47.640578 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bcc45-269c-4ddd-af0d-21e243028044 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:47.641451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bcc45-269c-4ddd-af0d-21e243028044 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:47.641742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bcc45-269c-4ddd-af0d-21e243028044 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:47.642980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bcc45-269c-4ddd-af0d-21e243028044 None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:47.644674 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bcc45-269c-4ddd-af0d-21e243028044 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:47.646487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 95/196] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:47 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:47.652260 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bcc45-269c-4ddd-af0d-21e243028044 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:47.705499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae499-cff4-4d42-ac4f-a0da20571fe5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:47.759469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00090e28-f3c2-4f75-9043-dfe1457bdd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:47.761893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00090e28-f3c2-4f75-9043-dfe1457bdd00 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:47.761893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00090e28-f3c2-4f75-9043-dfe1457bdd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:47.761893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00090e28-f3c2-4f75-9043-dfe1457bdd00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:47.798568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bcc45-269c-4ddd-af0d-21e243028044 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:47.846272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6c54-c60e-4f2a-a994-68321e06dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:47.846946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6c54-c60e-4f2a-a994-68321e06dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:47.847200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6c54-c60e-4f2a-a994-68321e06dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:47.847472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6c54-c60e-4f2a-a994-68321e06dcb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:47.848211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6c54-c60e-4f2a-a994-68321e06dcb3 None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=323eda8873b34125b0dc80cad45fb567, user.id=7e2559c582e7432db114189569767b5e) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:47.848520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6c54-c60e-4f2a-a994-68321e06dcb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:47.850261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6c54-c60e-4f2a-a994-68321e06dcb3 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:47.858019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 96/197] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:47 2022] GET /identity/v3/role_assignments?user.id=7e2559c582e7432db114189569767b5e&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=519b356d36364663a59265dc7eeff0b8 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:47.858645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00090e28-f3c2-4f75-9043-dfe1457bdd00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:47.860519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00090e28-f3c2-4f75-9043-dfe1457bdd00 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:47.891933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f7af1-77af-4851-9320-173d3a0e88be None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:47.891933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f7af1-77af-4851-9320-173d3a0e88be None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:47.892216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f7af1-77af-4851-9320-173d3a0e88be None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:47.898849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 97/198] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:47.902941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:47.908183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb13422-ffd1-49b6-be6f-379ef8efa83e None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:47.908680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb13422-ffd1-49b6-be6f-379ef8efa83e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:47.908752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb13422-ffd1-49b6-be6f-379ef8efa83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:47.920898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:47.935953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-dbb13422-ffd1-49b6-be6f-379ef8efa83e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:47.937438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dbb13422-ffd1-49b6-be6f-379ef8efa83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:48.004691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 102/199] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:48.026968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00090e28-f3c2-4f75-9043-dfe1457bdd00 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:48.071200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 98/200] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:48.146159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00090e28-f3c2-4f75-9043-dfe1457bdd00 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:48.183781 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ababde1-970c-4c59-8929-34be21fc94c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:48.184792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ababde1-970c-4c59-8929-34be21fc94c3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:48.185287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ababde1-970c-4c59-8929-34be21fc94c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:48.185752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ababde1-970c-4c59-8929-34be21fc94c3 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:48.187127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ababde1-970c-4c59-8929-34be21fc94c3 None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:48.194690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ababde1-970c-4c59-8929-34be21fc94c3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:48.196942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 103/201] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:48 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:48.207786 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb13422-ffd1-49b6-be6f-379ef8efa83e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:48.343929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb13422-ffd1-49b6-be6f-379ef8efa83e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:48.378950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed28299-4117-46ed-aade-e27d8d3cc04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:48.379566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed28299-4117-46ed-aade-e27d8d3cc04e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:48.379845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed28299-4117-46ed-aade-e27d8d3cc04e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:48.380114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed28299-4117-46ed-aade-e27d8d3cc04e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:48.380850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed28299-4117-46ed-aade-e27d8d3cc04e None admin] RBAC: Adding query filter params (role.id=779e95b5df394f2a95fbdfa2a9fb58eb, scope.project.id=323eda8873b34125b0dc80cad45fb567, user.id=7e2559c582e7432db114189569767b5e) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:48.381157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed28299-4117-46ed-aade-e27d8d3cc04e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:48.382606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed28299-4117-46ed-aade-e27d8d3cc04e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:48.384531 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:48.388731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 99/202] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:48 2022] GET /identity/v3/role_assignments?user.id=7e2559c582e7432db114189569767b5e&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=779e95b5df394f2a95fbdfa2a9fb58eb => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:48.472989 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ababde1-970c-4c59-8929-34be21fc94c3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:48.477022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:48.607925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ababde1-970c-4c59-8929-34be21fc94c3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:48.665537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3e228-d5b2-436b-b407-963a768685b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:48.666202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3e228-d5b2-436b-b407-963a768685b0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:48.666480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3e228-d5b2-436b-b407-963a768685b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:48.666776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3e228-d5b2-436b-b407-963a768685b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:48.681765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3e228-d5b2-436b-b407-963a768685b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-cdb3e228-d5b2-436b-b407-963a768685b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:48.687256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:48.688282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:48.689054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 104/203] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:48.695772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed28299-4117-46ed-aade-e27d8d3cc04e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:48.824322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed28299-4117-46ed-aade-e27d8d3cc04e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:48.877361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd5bc1-983a-4668-b32c-9848fc7d1345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:48.877899 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd5bc1-983a-4668-b32c-9848fc7d1345 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:48.878174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd5bc1-983a-4668-b32c-9848fc7d1345 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:48.878443 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd5bc1-983a-4668-b32c-9848fc7d1345 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:48.879138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd5bc1-983a-4668-b32c-9848fc7d1345 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:48.879438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd5bc1-983a-4668-b32c-9848fc7d1345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:48.880983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd5bc1-983a-4668-b32c-9848fc7d1345 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:48.889437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 100/204] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:48.895987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3e228-d5b2-436b-b407-963a768685b0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:49.019749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:49.064516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3e228-d5b2-436b-b407-963a768685b0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:49.116069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c97b3-3da0-4bdb-ac9f-abe0ee893bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:49.116714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c97b3-3da0-4bdb-ac9f-abe0ee893bbc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:49.116988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c97b3-3da0-4bdb-ac9f-abe0ee893bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:49.117256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c97b3-3da0-4bdb-ac9f-abe0ee893bbc None admin] PATH_INFO: `/v3/users/5ac872662dc6483f9570d4a13ee8daa1` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:49.123373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c97b3-3da0-4bdb-ac9f-abe0ee893bbc None admin] RBAC: Authorizing `identity:get_user(user_id=5ac872662dc6483f9570d4a13ee8daa1)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:49.124823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c97b3-3da0-4bdb-ac9f-abe0ee893bbc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:49.126486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 105/205] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:48 2022] GET /identity/v3/users/5ac872662dc6483f9570d4a13ee8daa1 => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:49.132196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd5bc1-983a-4668-b32c-9848fc7d1345 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:49.211664 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:49.258510 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd5bc1-983a-4668-b32c-9848fc7d1345 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:49.301163 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd46da8-8430-4581-8040-08e3c1422139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:49.301779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd46da8-8430-4581-8040-08e3c1422139 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:49.302056 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd46da8-8430-4581-8040-08e3c1422139 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:49.302408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd46da8-8430-4581-8040-08e3c1422139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:49.396612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd46da8-8430-4581-8040-08e3c1422139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:49.398007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd46da8-8430-4581-8040-08e3c1422139 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:49.467295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:49.501171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 101/206] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:49.506887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c97b3-3da0-4bdb-ac9f-abe0ee893bbc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:49.638757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c97b3-3da0-4bdb-ac9f-abe0ee893bbc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:49.676662 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:49.682085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab42f99-5a28-4560-88d5-cc6e4aa1f63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:49.682765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42f99-5a28-4560-88d5-cc6e4aa1f63d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:49.683037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42f99-5a28-4560-88d5-cc6e4aa1f63d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:49.691921 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42f99-5a28-4560-88d5-cc6e4aa1f63d None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:49.691921 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab42f99-5a28-4560-88d5-cc6e4aa1f63d None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:49.691921 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab42f99-5a28-4560-88d5-cc6e4aa1f63d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:49.691921 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 106/207] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:49 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:49.693423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd46da8-8430-4581-8040-08e3c1422139 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:49.802859 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd46da8-8430-4581-8040-08e3c1422139 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:49.837820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783ce76-ef61-4c61-9153-87c97db3fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:49.838432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783ce76-ef61-4c61-9153-87c97db3fe5e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:49.838727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783ce76-ef61-4c61-9153-87c97db3fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:49.839000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783ce76-ef61-4c61-9153-87c97db3fe5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:49.839722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783ce76-ef61-4c61-9153-87c97db3fe5e None admin] RBAC: Adding query filter params (role.id=a970a114620e467295e3dd153a9f4321, scope.project.id=680231dab5b3448499d71c6cba44d7c6, user.id=5ac872662dc6483f9570d4a13ee8daa1) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:49.840081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783ce76-ef61-4c61-9153-87c97db3fe5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:49.841532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783ce76-ef61-4c61-9153-87c97db3fe5e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:49.847696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 102/208] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:49 2022] GET /identity/v3/role_assignments?user.id=5ac872662dc6483f9570d4a13ee8daa1&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=a970a114620e467295e3dd153a9f4321 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:50.159137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac2f2-b213-42bf-b15e-55713f47adc5 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:50.159649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac2f2-b213-42bf-b15e-55713f47adc5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:50.159649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ac2f2-b213-42bf-b15e-55713f47adc5 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:50.161271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 107/209] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:50.166542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa4e2-966e-41cf-a2c0-b28a529a2f6f None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:50.167360 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa4e2-966e-41cf-a2c0-b28a529a2f6f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:50.167638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa4e2-966e-41cf-a2c0-b28a529a2f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:50.188738 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-7cafa4e2-966e-41cf-a2c0-b28a529a2f6f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:50.190244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7cafa4e2-966e-41cf-a2c0-b28a529a2f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:50.211383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:50.282221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 103/210] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:50.393701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3949a7-f8da-44c1-a679-73a7c8fc7ddc None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:50.394014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3949a7-f8da-44c1-a679-73a7c8fc7ddc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:50.394260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3949a7-f8da-44c1-a679-73a7c8fc7ddc None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:50.395626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 108/211] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:50.401045 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62251-8a56-4a6c-9b0d-ec4600e0a79a None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:50.401324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62251-8a56-4a6c-9b0d-ec4600e0a79a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:50.401827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62251-8a56-4a6c-9b0d-ec4600e0a79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:50.427964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-e4d62251-8a56-4a6c-9b0d-ec4600e0a79a None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:50.429389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e4d62251-8a56-4a6c-9b0d-ec4600e0a79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:50.499198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 104/212] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:50.563223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3949a7-f8da-44c1-a679-73a7c8fc7ddc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:50.678044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3949a7-f8da-44c1-a679-73a7c8fc7ddc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:50.715539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98589f84-2284-4a8b-87be-7ae575f2af2d None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:50.716165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98589f84-2284-4a8b-87be-7ae575f2af2d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:50.716627 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98589f84-2284-4a8b-87be-7ae575f2af2d None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:50.718304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 105/213] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:50.718525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da15be9-c960-42f9-b6b9-4924585d056e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:50.719743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da15be9-c960-42f9-b6b9-4924585d056e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:50.720019 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da15be9-c960-42f9-b6b9-4924585d056e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:50.720288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da15be9-c960-42f9-b6b9-4924585d056e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:50.725580 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380f96-29a4-4edd-9647-0b9b49f01825 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:50.725857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380f96-29a4-4edd-9647-0b9b49f01825 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:50.726123 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380f96-29a4-4edd-9647-0b9b49f01825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:50.735797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da15be9-c960-42f9-b6b9-4924585d056e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6da15be9-c960-42f9-b6b9-4924585d056e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:50.741635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:50.742514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:50.743794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:50.750775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-81380f96-29a4-4edd-9647-0b9b49f01825 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:50.750775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-81380f96-29a4-4edd-9647-0b9b49f01825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:50.751649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 109/214] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:58:50.754439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da15be9-c960-42f9-b6b9-4924585d056e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:50.817252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:50.821038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 106/215] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:58:50.821808 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380f96-29a4-4edd-9647-0b9b49f01825 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:50.839754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:50.869061 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da15be9-c960-42f9-b6b9-4924585d056e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:50.909349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b18c00-c978-42d9-91bf-aa85c75ad0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:50.910041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b18c00-c978-42d9-91bf-aa85c75ad0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:50.911827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b18c00-c978-42d9-91bf-aa85c75ad0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:50.911827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b18c00-c978-42d9-91bf-aa85c75ad0f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:50.911827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b18c00-c978-42d9-91bf-aa85c75ad0f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:50.911827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b18c00-c978-42d9-91bf-aa85c75ad0f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:50.913245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b18c00-c978-42d9-91bf-aa85c75ad0f9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:50.923165 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 110/216] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:50.926486 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380f96-29a4-4edd-9647-0b9b49f01825 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:50.929054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b18c00-c978-42d9-91bf-aa85c75ad0f9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:50.964529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd36d5-9611-4915-bad6-3038e06d8e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:50.965329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd36d5-9611-4915-bad6-3038e06d8e62 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:50.965705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd36d5-9611-4915-bad6-3038e06d8e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:50.966027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd36d5-9611-4915-bad6-3038e06d8e62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:50.967269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd36d5-9611-4915-bad6-3038e06d8e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:50.968872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd36d5-9611-4915-bad6-3038e06d8e62 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:50.970844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 107/217] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:50.976266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd36d5-9611-4915-bad6-3038e06d8e62 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:51.044208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b18c00-c978-42d9-91bf-aa85c75ad0f9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:51.064904 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:51.077478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:51.091554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd36d5-9611-4915-bad6-3038e06d8e62 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:51.091754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14c150-6fb1-4f7f-a182-e14d33d15327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:51.092359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14c150-6fb1-4f7f-a182-e14d33d15327 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:51.092640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14c150-6fb1-4f7f-a182-e14d33d15327 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:51.092910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14c150-6fb1-4f7f-a182-e14d33d15327 None admin] PATH_INFO: `/v3/users/beb54459a4344ad6bb88bec382e3a17b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:51.110474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14c150-6fb1-4f7f-a182-e14d33d15327 None admin] RBAC: Authorizing `identity:get_user(user_id=beb54459a4344ad6bb88bec382e3a17b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:51.112170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14c150-6fb1-4f7f-a182-e14d33d15327 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:51.114781 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 111/218] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:50 2022] GET /identity/v3/users/beb54459a4344ad6bb88bec382e3a17b => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:51.119871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14c150-6fb1-4f7f-a182-e14d33d15327 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:51.135377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece8aec-38f0-4051-8b99-e05566b5da64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:51.136556 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece8aec-38f0-4051-8b99-e05566b5da64 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:51.136972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece8aec-38f0-4051-8b99-e05566b5da64 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:51.137257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece8aec-38f0-4051-8b99-e05566b5da64 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:51.137910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece8aec-38f0-4051-8b99-e05566b5da64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:51.139921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece8aec-38f0-4051-8b99-e05566b5da64 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:51.221248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14c150-6fb1-4f7f-a182-e14d33d15327 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:51.244371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 108/219] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:58:50 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:51.247618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece8aec-38f0-4051-8b99-e05566b5da64 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:51.257768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57456c59-914c-45b5-8909-6c5cbf71403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:51.258402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57456c59-914c-45b5-8909-6c5cbf71403d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:51.259341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57456c59-914c-45b5-8909-6c5cbf71403d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:51.259341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57456c59-914c-45b5-8909-6c5cbf71403d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:51.316255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:51.337195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57456c59-914c-45b5-8909-6c5cbf71403d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:51.338878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57456c59-914c-45b5-8909-6c5cbf71403d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:51.364596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece8aec-38f0-4051-8b99-e05566b5da64 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:51.401450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4e0f5-d88b-4917-a894-a4b003685b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:51.402099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e0f5-d88b-4917-a894-a4b003685b0d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:51.402373 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e0f5-d88b-4917-a894-a4b003685b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:51.402640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e0f5-d88b-4917-a894-a4b003685b0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:51.412676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:51.417706 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4e0f5-d88b-4917-a894-a4b003685b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-70a4e0f5-d88b-4917-a894-a4b003685b0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:51.424332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:51.427299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 109/220] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:51.428092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fdc39-d722-47f7-b37d-c207a107728a None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:51.428799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fdc39-d722-47f7-b37d-c207a107728a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:51.428799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fdc39-d722-47f7-b37d-c207a107728a None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:51.428799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 110/221] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:51.431507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fdc39-d722-47f7-b37d-c207a107728a None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:51.471189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 112/222] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:51.472519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2ec16-bf41-4716-845a-9e6de53bd1aa None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:51.472839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2ec16-bf41-4716-845a-9e6de53bd1aa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:51.474870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2ec16-bf41-4716-845a-9e6de53bd1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:51.493673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3bb2ec16-bf41-4716-845a-9e6de53bd1aa None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:51.494903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3bb2ec16-bf41-4716-845a-9e6de53bd1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:51.566544 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fdc39-d722-47f7-b37d-c207a107728a None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:51.579055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 113/223] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:51.579924 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2ec16-bf41-4716-845a-9e6de53bd1aa None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:51.599773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:51.611604 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fa830-f15e-4181-894f-f916fe1afd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:51.612221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fa830-f15e-4181-894f-f916fe1afd13 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:51.612494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fa830-f15e-4181-894f-f916fe1afd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:51.612763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fa830-f15e-4181-894f-f916fe1afd13 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:51.613877 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fa830-f15e-4181-894f-f916fe1afd13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:51.614329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fa830-f15e-4181-894f-f916fe1afd13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:51.615951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fa830-f15e-4181-894f-f916fe1afd13 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:51.628049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 111/224] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:51.634732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fa830-f15e-4181-894f-f916fe1afd13 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:51.698833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2ec16-bf41-4716-845a-9e6de53bd1aa None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:51.699408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:51.736680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc4713-c568-48da-81c0-0a93b45628bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:51.737242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc4713-c568-48da-81c0-0a93b45628bf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:51.737514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc4713-c568-48da-81c0-0a93b45628bf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:51.737840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc4713-c568-48da-81c0-0a93b45628bf None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:51.739051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc4713-c568-48da-81c0-0a93b45628bf None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:51.740555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc4713-c568-48da-81c0-0a93b45628bf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:51.742808 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 114/225] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:51 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:51.745849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fa830-f15e-4181-894f-f916fe1afd13 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:51.755634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc4713-c568-48da-81c0-0a93b45628bf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:51.811596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5b55f-d2c0-480b-87e8-6d9d0f6b19d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:51.813913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5b55f-d2c0-480b-87e8-6d9d0f6b19d7 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:51.814433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5b55f-d2c0-480b-87e8-6d9d0f6b19d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:51.815384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5b55f-d2c0-480b-87e8-6d9d0f6b19d7 None admin] PATH_INFO: `/v3/users/7e2559c582e7432db114189569767b5e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:51.817862 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5b55f-d2c0-480b-87e8-6d9d0f6b19d7 None admin] RBAC: Authorizing `identity:get_user(user_id=7e2559c582e7432db114189569767b5e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:51.820572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5b55f-d2c0-480b-87e8-6d9d0f6b19d7 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:51.823524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 112/226] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:51 2022] GET /identity/v3/users/7e2559c582e7432db114189569767b5e => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:51.829580 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5b55f-d2c0-480b-87e8-6d9d0f6b19d7 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:51.895933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:51.922565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc4713-c568-48da-81c0-0a93b45628bf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:51.969374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5b55f-d2c0-480b-87e8-6d9d0f6b19d7 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:51.970868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7041734-2e88-49bb-885f-0cf019e13316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:51.974105 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7041734-2e88-49bb-885f-0cf019e13316 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:51.974495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7041734-2e88-49bb-885f-0cf019e13316 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:51.974883 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7041734-2e88-49bb-885f-0cf019e13316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:51.975718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7041734-2e88-49bb-885f-0cf019e13316 None admin] RBAC: Adding query filter params (role.id=6ba784d4bd374e1793729d1ff430e45f, scope.project.id=323eda8873b34125b0dc80cad45fb567, user.id=beb54459a4344ad6bb88bec382e3a17b) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:51.976141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7041734-2e88-49bb-885f-0cf019e13316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:51.977679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7041734-2e88-49bb-885f-0cf019e13316 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:51.985378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 115/227] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:51 2022] GET /identity/v3/role_assignments?user.id=beb54459a4344ad6bb88bec382e3a17b&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:51.986584 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7041734-2e88-49bb-885f-0cf019e13316 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:52.004967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:52.021895 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a269644-fe9e-46e9-bc31-0c0cc35823ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:52.024167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a269644-fe9e-46e9-bc31-0c0cc35823ab None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:52.027381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a269644-fe9e-46e9-bc31-0c0cc35823ab None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:52.027842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a269644-fe9e-46e9-bc31-0c0cc35823ab None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:52.029473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a269644-fe9e-46e9-bc31-0c0cc35823ab None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:52.034538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a269644-fe9e-46e9-bc31-0c0cc35823ab None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:52.037487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 113/228] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:51 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:52.043373 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a269644-fe9e-46e9-bc31-0c0cc35823ab None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:52.219287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7041734-2e88-49bb-885f-0cf019e13316 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:52.241233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a269644-fe9e-46e9-bc31-0c0cc35823ab None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:52.275819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a533c-2db0-4585-86b6-83e020985d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:52.277131 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a533c-2db0-4585-86b6-83e020985d0c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:52.277611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a533c-2db0-4585-86b6-83e020985d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:52.278081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a533c-2db0-4585-86b6-83e020985d0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:52.295926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a533c-2db0-4585-86b6-83e020985d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c16a533c-2db0-4585-86b6-83e020985d0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:52.302325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:52.303252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:52.304042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:52.309544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 116/229] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:58:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:52.316242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ea0d1-8c01-484b-8496-d057a0c33293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:52.317652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea0d1-8c01-484b-8496-d057a0c33293 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:52.318139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea0d1-8c01-484b-8496-d057a0c33293 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:52.318625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea0d1-8c01-484b-8496-d057a0c33293 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567/users/7e2559c582e7432db114189569767b5e/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:52.321082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ea0d1-8c01-484b-8496-d057a0c33293 None admin] RBAC: Authorizing `identity:create_grant(project_id=323eda8873b34125b0dc80cad45fb567, user_id=7e2559c582e7432db114189569767b5e, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:52.322952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ea0d1-8c01-484b-8496-d057a0c33293 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:52.327737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a533c-2db0-4585-86b6-83e020985d0c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:52.332805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:52.433277 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a533c-2db0-4585-86b6-83e020985d0c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:52.436865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 114/230] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:58:52 2022] PUT /identity/v3/projects/323eda8873b34125b0dc80cad45fb567/users/7e2559c582e7432db114189569767b5e/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:58:52.472401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38676b7d-de60-4318-b5b0-93e737e0e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:52.473008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38676b7d-de60-4318-b5b0-93e737e0e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:52.473293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38676b7d-de60-4318-b5b0-93e737e0e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:52.473605 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38676b7d-de60-4318-b5b0-93e737e0e5f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:52.474298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38676b7d-de60-4318-b5b0-93e737e0e5f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:52.474901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38676b7d-de60-4318-b5b0-93e737e0e5f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:52.476336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38676b7d-de60-4318-b5b0-93e737e0e5f9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:52.486169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 117/231] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:58:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:52.491827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ea0d1-8c01-484b-8496-d057a0c33293 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:52.594941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:52.658498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ea0d1-8c01-484b-8496-d057a0c33293 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:52.700873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089978d-e62b-4ba2-97f0-5f1cc78b2088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:52.701528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089978d-e62b-4ba2-97f0-5f1cc78b2088 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:52.701808 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089978d-e62b-4ba2-97f0-5f1cc78b2088 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:52.702079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089978d-e62b-4ba2-97f0-5f1cc78b2088 None admin] PATH_INFO: `/v3/users/7e2559c582e7432db114189569767b5e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:52.703282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089978d-e62b-4ba2-97f0-5f1cc78b2088 None admin] RBAC: Authorizing `identity:get_user(user_id=7e2559c582e7432db114189569767b5e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:52.704735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089978d-e62b-4ba2-97f0-5f1cc78b2088 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:52.706632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 115/232] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:52 2022] GET /identity/v3/users/7e2559c582e7432db114189569767b5e => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:52.715464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38676b7d-de60-4318-b5b0-93e737e0e5f9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:52.809962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:52.865542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38676b7d-de60-4318-b5b0-93e737e0e5f9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:52.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9acb8-99a3-4d3f-bd3b-98729c3d5acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:52.910027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9acb8-99a3-4d3f-bd3b-98729c3d5acd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:52.910308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9acb8-99a3-4d3f-bd3b-98729c3d5acd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:52.910580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9acb8-99a3-4d3f-bd3b-98729c3d5acd None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:52.911755 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9acb8-99a3-4d3f-bd3b-98729c3d5acd None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:52.913275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9acb8-99a3-4d3f-bd3b-98729c3d5acd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:52.915377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 118/233] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:52 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:52.921005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089978d-e62b-4ba2-97f0-5f1cc78b2088 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:53.058969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089978d-e62b-4ba2-97f0-5f1cc78b2088 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:53.086106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:53.100386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedf671-d78d-43b1-819c-bcb52aaf55df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:53.101156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedf671-d78d-43b1-819c-bcb52aaf55df None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:53.101371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedf671-d78d-43b1-819c-bcb52aaf55df None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:53.101644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedf671-d78d-43b1-819c-bcb52aaf55df None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567/users/7e2559c582e7432db114189569767b5e/roles/779e95b5df394f2a95fbdfa2a9fb58eb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:53.108491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedf671-d78d-43b1-819c-bcb52aaf55df None admin] RBAC: Authorizing `identity:create_grant(project_id=323eda8873b34125b0dc80cad45fb567, user_id=7e2559c582e7432db114189569767b5e, role_id=779e95b5df394f2a95fbdfa2a9fb58eb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:53.110627 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedf671-d78d-43b1-819c-bcb52aaf55df None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:53.210621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 116/234] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:58:52 2022] PUT /identity/v3/projects/323eda8873b34125b0dc80cad45fb567/users/7e2559c582e7432db114189569767b5e/roles/779e95b5df394f2a95fbdfa2a9fb58eb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:58:53.829212 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac624bd-c988-43b0-a127-71ed46f4d4c0 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:53.829728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac624bd-c988-43b0-a127-71ed46f4d4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:53.829728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac624bd-c988-43b0-a127-71ed46f4d4c0 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:53.831411 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 119/235] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:53.836719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6479e-4821-4b06-b944-7aaa492f8f2f None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:53.837110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6479e-4821-4b06-b944-7aaa492f8f2f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:53.837273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6479e-4821-4b06-b944-7aaa492f8f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:53.862934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-8fe6479e-4821-4b06-b944-7aaa492f8f2f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:53.864213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-8fe6479e-4821-4b06-b944-7aaa492f8f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:53.961992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 117/236] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:54.089506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48687-b65b-4217-b028-f3f7fe059845 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:54.089794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48687-b65b-4217-b028-f3f7fe059845 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:54.089974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48687-b65b-4217-b028-f3f7fe059845 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:54.091741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 120/237] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:54.096963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cbc13-47a8-4eb8-a6fa-c5402fc74701 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:54.097303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cbc13-47a8-4eb8-a6fa-c5402fc74701 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:54.097578 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cbc13-47a8-4eb8-a6fa-c5402fc74701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:54.120536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-e22cbc13-47a8-4eb8-a6fa-c5402fc74701 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:54.121788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e22cbc13-47a8-4eb8-a6fa-c5402fc74701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:54.193362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 118/238] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:54.367684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d48687-b65b-4217-b028-f3f7fe059845 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:54.482887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d48687-b65b-4217-b028-f3f7fe059845 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:54.518859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:54.523616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71755006-7597-4e88-98f4-abfff90009e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:54.524256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71755006-7597-4e88-98f4-abfff90009e7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:54.524544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71755006-7597-4e88-98f4-abfff90009e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:54.525121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71755006-7597-4e88-98f4-abfff90009e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:54.538621 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71755006-7597-4e88-98f4-abfff90009e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-71755006-7597-4e88-98f4-abfff90009e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:54.554897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:54.555756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:54.556549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 121/239] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:54.557200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cbc13-47a8-4eb8-a6fa-c5402fc74701 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:54.581002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71755006-7597-4e88-98f4-abfff90009e7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:54.639121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:54.721349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cbc13-47a8-4eb8-a6fa-c5402fc74701 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:54.742259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71755006-7597-4e88-98f4-abfff90009e7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:54.758437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ee6a9-1e3e-4ff2-9782-5f7addb5d1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:54.759090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ee6a9-1e3e-4ff2-9782-5f7addb5d1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:54.759363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ee6a9-1e3e-4ff2-9782-5f7addb5d1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:54.759629 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ee6a9-1e3e-4ff2-9782-5f7addb5d1e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:54.760291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ee6a9-1e3e-4ff2-9782-5f7addb5d1e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:54.760687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ee6a9-1e3e-4ff2-9782-5f7addb5d1e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:54.762177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ee6a9-1e3e-4ff2-9782-5f7addb5d1e7 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:54.771697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 119/240] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:54.772992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90effda7-82f5-486c-9c4a-8266bdc04874 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:54.773276 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90effda7-82f5-486c-9c4a-8266bdc04874 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:54.773547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90effda7-82f5-486c-9c4a-8266bdc04874 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:54.774902 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 120/241] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:54.777022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90effda7-82f5-486c-9c4a-8266bdc04874 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:54.790402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1f04d-3d35-467f-8fa0-e4513fdf117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:54.791472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f04d-3d35-467f-8fa0-e4513fdf117b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:54.791751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f04d-3d35-467f-8fa0-e4513fdf117b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:54.792022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f04d-3d35-467f-8fa0-e4513fdf117b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:54.793401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1f04d-3d35-467f-8fa0-e4513fdf117b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:54.795072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1f04d-3d35-467f-8fa0-e4513fdf117b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:54.797445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 122/242] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:54.798403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535a8c0-f17d-4391-8b1b-c764c5a81b5c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:54.798749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535a8c0-f17d-4391-8b1b-c764c5a81b5c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:54.799046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535a8c0-f17d-4391-8b1b-c764c5a81b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:54.820492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9535a8c0-f17d-4391-8b1b-c764c5a81b5c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:54.821673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9535a8c0-f17d-4391-8b1b-c764c5a81b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:54.888202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:54.892385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90effda7-82f5-486c-9c4a-8266bdc04874 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:54.901540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 123/243] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:54.902461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535a8c0-f17d-4391-8b1b-c764c5a81b5c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:54.948334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:55.020129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535a8c0-f17d-4391-8b1b-c764c5a81b5c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:55.020493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c12ad-474b-419e-91ea-0df9a0fbbabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:55.020974 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c12ad-474b-419e-91ea-0df9a0fbbabf None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:55.021259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c12ad-474b-419e-91ea-0df9a0fbbabf None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:55.021533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c12ad-474b-419e-91ea-0df9a0fbbabf None admin] PATH_INFO: `/v3/users/ecd2d35c41084116b54033244dfb30e6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:55.050251 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c12ad-474b-419e-91ea-0df9a0fbbabf None admin] RBAC: Authorizing `identity:get_user(user_id=ecd2d35c41084116b54033244dfb30e6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:55.059875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c12ad-474b-419e-91ea-0df9a0fbbabf None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:55.060102 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0842d62-1eb8-4299-9e33-3282b7535080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:55.060920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0842d62-1eb8-4299-9e33-3282b7535080 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:55.061353 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0842d62-1eb8-4299-9e33-3282b7535080 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:55.061610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 121/244] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:54 2022] GET /identity/v3/users/ecd2d35c41084116b54033244dfb30e6 => generated 297 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:55.062141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0842d62-1eb8-4299-9e33-3282b7535080 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:55.063096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0842d62-1eb8-4299-9e33-3282b7535080 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:55.064796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0842d62-1eb8-4299-9e33-3282b7535080 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:55.071559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c12ad-474b-419e-91ea-0df9a0fbbabf None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:55.137404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 124/245] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:58:54 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:58:55.142767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f124be0-4c62-4ab1-b728-49ce1829ca20 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:55.146709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f124be0-4c62-4ab1-b728-49ce1829ca20 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:55.147317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f124be0-4c62-4ab1-b728-49ce1829ca20 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:55.151406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 125/246] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:55.161185 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da67bd-823f-491c-868a-bd6244f7d84c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:55.161740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da67bd-823f-491c-868a-bd6244f7d84c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:55.162155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da67bd-823f-491c-868a-bd6244f7d84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:55.202570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-95da67bd-823f-491c-868a-bd6244f7d84c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:55.204374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-95da67bd-823f-491c-868a-bd6244f7d84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:55.251723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c12ad-474b-419e-91ea-0df9a0fbbabf None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:55.295423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:55.307719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa63fca-eca7-4a63-80b2-7af8856a3e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:55.308359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63fca-eca7-4a63-80b2-7af8856a3e5e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:55.308700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63fca-eca7-4a63-80b2-7af8856a3e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:55.308975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63fca-eca7-4a63-80b2-7af8856a3e5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:55.330489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 126/247] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:58:55.332026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da67bd-823f-491c-868a-bd6244f7d84c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:55.348981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:55.393769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa63fca-eca7-4a63-80b2-7af8856a3e5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:55.396579 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa63fca-eca7-4a63-80b2-7af8856a3e5e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:55.471696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da67bd-823f-491c-868a-bd6244f7d84c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:55.512849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 122/248] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:55.517070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d277bcd-2f5d-44c8-a6bb-b6437af5849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:55.517712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d277bcd-2f5d-44c8-a6bb-b6437af5849d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:55.517986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d277bcd-2f5d-44c8-a6bb-b6437af5849d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:55.518506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d277bcd-2f5d-44c8-a6bb-b6437af5849d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:55.520450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa63fca-eca7-4a63-80b2-7af8856a3e5e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:55.531314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d277bcd-2f5d-44c8-a6bb-b6437af5849d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0d277bcd-2f5d-44c8-a6bb-b6437af5849d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:55.537616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:55.538514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:55.539350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:58:55.542820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 127/249] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:55.544777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d277bcd-2f5d-44c8-a6bb-b6437af5849d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:55.586593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:55.618535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:55.679562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa63fca-eca7-4a63-80b2-7af8856a3e5e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:55.684013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d277bcd-2f5d-44c8-a6bb-b6437af5849d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:55.724054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc659af-677e-43f4-8295-09527e1a2e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:55.724726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc659af-677e-43f4-8295-09527e1a2e47 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:55.725006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc659af-677e-43f4-8295-09527e1a2e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:55.725278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc659af-677e-43f4-8295-09527e1a2e47 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:55.726728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc659af-677e-43f4-8295-09527e1a2e47 None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:55.728167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc659af-677e-43f4-8295-09527e1a2e47 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:55.729826 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 123/250] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:55 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:55.730590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc659af-677e-43f4-8295-09527e1a2e47 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:55.736175 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752a659-9132-4fb2-afa9-bb1a5a5a1d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:55.736793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752a659-9132-4fb2-afa9-bb1a5a5a1d4b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:55.737075 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752a659-9132-4fb2-afa9-bb1a5a5a1d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:55.737348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752a659-9132-4fb2-afa9-bb1a5a5a1d4b None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:55.738017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752a659-9132-4fb2-afa9-bb1a5a5a1d4b None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:55.738317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752a659-9132-4fb2-afa9-bb1a5a5a1d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:55.740406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752a659-9132-4fb2-afa9-bb1a5a5a1d4b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:55.750480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 128/251] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:55.751258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752a659-9132-4fb2-afa9-bb1a5a5a1d4b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:55.863772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc659af-677e-43f4-8295-09527e1a2e47 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:55.871362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:55.877558 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752a659-9132-4fb2-afa9-bb1a5a5a1d4b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:55.908271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:55.916835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222d47a-d960-40e6-af4d-f59904ffb1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:55.917991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222d47a-d960-40e6-af4d-f59904ffb1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:55.918374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222d47a-d960-40e6-af4d-f59904ffb1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:55.918880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222d47a-d960-40e6-af4d-f59904ffb1c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:55.931829 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a18f0-33dd-474f-88e9-4d60f06852e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:55.932464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a18f0-33dd-474f-88e9-4d60f06852e0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:55.932678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a18f0-33dd-474f-88e9-4d60f06852e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:55.932957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a18f0-33dd-474f-88e9-4d60f06852e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:55.933716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a18f0-33dd-474f-88e9-4d60f06852e0 None admin] RBAC: Adding query filter params (role.id=a970a114620e467295e3dd153a9f4321, scope.project.id=323eda8873b34125b0dc80cad45fb567, user.id=ecd2d35c41084116b54033244dfb30e6) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:55.934465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a18f0-33dd-474f-88e9-4d60f06852e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:55.936268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a18f0-33dd-474f-88e9-4d60f06852e0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:55.938440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222d47a-d960-40e6-af4d-f59904ffb1c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:55.943835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 129/252] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:55 2022] GET /identity/v3/role_assignments?user.id=ecd2d35c41084116b54033244dfb30e6&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=a970a114620e467295e3dd153a9f4321 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:55.944564 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a18f0-33dd-474f-88e9-4d60f06852e0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-2222d47a-d960-40e6-af4d-f59904ffb1c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:55.952772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:55.953780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:55.955693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 124/253] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:55.963274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222d47a-d960-40e6-af4d-f59904ffb1c2 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:56.151540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222d47a-d960-40e6-af4d-f59904ffb1c2 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:56.170603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a18f0-33dd-474f-88e9-4d60f06852e0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:56.198919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03cf17-6784-42bb-8705-584deb8e9145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:56.199568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03cf17-6784-42bb-8705-584deb8e9145 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:56.199847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03cf17-6784-42bb-8705-584deb8e9145 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:56.200120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03cf17-6784-42bb-8705-584deb8e9145 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:56.200796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03cf17-6784-42bb-8705-584deb8e9145 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:56.201102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03cf17-6784-42bb-8705-584deb8e9145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:56.202569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03cf17-6784-42bb-8705-584deb8e9145 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:56.217051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 125/254] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:56.217051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a808e-f1d0-4e69-89a7-a1861332fb42 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:56.217285 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a808e-f1d0-4e69-89a7-a1861332fb42 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:56.217547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a808e-f1d0-4e69-89a7-a1861332fb42 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:56.219658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 126/255] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:56.222737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a808e-f1d0-4e69-89a7-a1861332fb42 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:56.234840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d080e-107d-4f64-b200-622fd0e4c2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:56.235739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d080e-107d-4f64-b200-622fd0e4c2bf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:56.236569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d080e-107d-4f64-b200-622fd0e4c2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:56.236987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d080e-107d-4f64-b200-622fd0e4c2bf None admin] PATH_INFO: `/v3/users/beb54459a4344ad6bb88bec382e3a17b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:56.238570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d080e-107d-4f64-b200-622fd0e4c2bf None admin] RBAC: Authorizing `identity:get_user(user_id=beb54459a4344ad6bb88bec382e3a17b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:56.240535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d080e-107d-4f64-b200-622fd0e4c2bf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:56.242284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 130/256] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:55 2022] GET /identity/v3/users/beb54459a4344ad6bb88bec382e3a17b => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:56.244430 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f565ad-7ac5-4c83-9f6a-720894f415a2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:56.244861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f565ad-7ac5-4c83-9f6a-720894f415a2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:56.245295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f565ad-7ac5-4c83-9f6a-720894f415a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:56.266877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b0f565ad-7ac5-4c83-9f6a-720894f415a2 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:56.269119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b0f565ad-7ac5-4c83-9f6a-720894f415a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:56.286625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:56.304554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:56.357574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a808e-f1d0-4e69-89a7-a1861332fb42 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:56.387566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 131/257] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:56.388444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f565ad-7ac5-4c83-9f6a-720894f415a2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:56.436059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77120f39-1af3-43bd-b047-1c5b421eebb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:56.436717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120f39-1af3-43bd-b047-1c5b421eebb6 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:56.437052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120f39-1af3-43bd-b047-1c5b421eebb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:56.437322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120f39-1af3-43bd-b047-1c5b421eebb6 None admin] PATH_INFO: `/v3/users/7e2559c582e7432db114189569767b5e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:56.440236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77120f39-1af3-43bd-b047-1c5b421eebb6 None admin] RBAC: Authorizing `identity:get_user(user_id=7e2559c582e7432db114189569767b5e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:56.441722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77120f39-1af3-43bd-b047-1c5b421eebb6 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:56.443897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 127/258] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:56 2022] GET /identity/v3/users/7e2559c582e7432db114189569767b5e => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:56.449135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77120f39-1af3-43bd-b047-1c5b421eebb6 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:56.605171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f565ad-7ac5-4c83-9f6a-720894f415a2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:56.617272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77120f39-1af3-43bd-b047-1c5b421eebb6 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:56.683321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:56.694775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4229a34-3f0b-48bc-ac22-07905d51a861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:56.695749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4229a34-3f0b-48bc-ac22-07905d51a861 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:56.696171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4229a34-3f0b-48bc-ac22-07905d51a861 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:56.696586 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4229a34-3f0b-48bc-ac22-07905d51a861 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:56.698146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4229a34-3f0b-48bc-ac22-07905d51a861 None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:56.703801 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4229a34-3f0b-48bc-ac22-07905d51a861 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:56.703801 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 132/259] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:56 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:56.709270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eeab8-63a2-428c-b907-7dc17e84a751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:56.709891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eeab8-63a2-428c-b907-7dc17e84a751 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:56.710167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eeab8-63a2-428c-b907-7dc17e84a751 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:56.710442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eeab8-63a2-428c-b907-7dc17e84a751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:56.716062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4229a34-3f0b-48bc-ac22-07905d51a861 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:56.775717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:56.834996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eeab8-63a2-428c-b907-7dc17e84a751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:56.836474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eeab8-63a2-428c-b907-7dc17e84a751 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:56.924070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4229a34-3f0b-48bc-ac22-07905d51a861 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:57.004705 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc796e-c0c4-4213-9eca-a765d3b76588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:57.005319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc796e-c0c4-4213-9eca-a765d3b76588 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:57.005587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc796e-c0c4-4213-9eca-a765d3b76588 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:57.005835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc796e-c0c4-4213-9eca-a765d3b76588 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567/users/beb54459a4344ad6bb88bec382e3a17b/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:57.011238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc796e-c0c4-4213-9eca-a765d3b76588 None admin] RBAC: Authorizing `identity:create_grant(project_id=323eda8873b34125b0dc80cad45fb567, user_id=beb54459a4344ad6bb88bec382e3a17b, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:57.012741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc796e-c0c4-4213-9eca-a765d3b76588 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:57.033189 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 128/260] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:57.034060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eeab8-63a2-428c-b907-7dc17e84a751 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:57.063074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:57.107826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 133/261] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:58:56 2022] PUT /identity/v3/projects/323eda8873b34125b0dc80cad45fb567/users/beb54459a4344ad6bb88bec382e3a17b/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:58:57.108707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc796e-c0c4-4213-9eca-a765d3b76588 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:57.192849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eeab8-63a2-428c-b907-7dc17e84a751 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:57.243036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:57.255418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc796e-c0c4-4213-9eca-a765d3b76588 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:57.295420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4179d4-e304-4222-b060-91751e050cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:57.295788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1bf35-b9e6-406f-b5f8-89101f73f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:57.296094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4179d4-e304-4222-b060-91751e050cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:57.296922 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4179d4-e304-4222-b060-91751e050cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:57.297197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4179d4-e304-4222-b060-91751e050cd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:57.297686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1bf35-b9e6-406f-b5f8-89101f73f679 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:57.298108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1bf35-b9e6-406f-b5f8-89101f73f679 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:57.298534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1bf35-b9e6-406f-b5f8-89101f73f679 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:57.300328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1bf35-b9e6-406f-b5f8-89101f73f679 None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:57.302519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1bf35-b9e6-406f-b5f8-89101f73f679 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:57.305130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 134/262] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:57 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:57.310586 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1bf35-b9e6-406f-b5f8-89101f73f679 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:57.325894 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4179d4-e304-4222-b060-91751e050cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-6c4179d4-e304-4222-b060-91751e050cd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:57.330941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:57.332165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:58:57.333156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:57.337969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 129/263] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:58:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:57.339244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4179d4-e304-4222-b060-91751e050cd0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:57.456653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1bf35-b9e6-406f-b5f8-89101f73f679 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:57.523209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:57.533523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4179d4-e304-4222-b060-91751e050cd0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:57.564407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927988d-b7b5-4f0b-ba6b-fafe142e3b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:57.565032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927988d-b7b5-4f0b-ba6b-fafe142e3b5c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:57.565317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927988d-b7b5-4f0b-ba6b-fafe142e3b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:57.565591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927988d-b7b5-4f0b-ba6b-fafe142e3b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:57.566326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927988d-b7b5-4f0b-ba6b-fafe142e3b5c None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=323eda8873b34125b0dc80cad45fb567, user.id=7e2559c582e7432db114189569767b5e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:57.566640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927988d-b7b5-4f0b-ba6b-fafe142e3b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:57.568114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927988d-b7b5-4f0b-ba6b-fafe142e3b5c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:57.572030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650755a-cf76-457e-a784-1e8a071667d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:57.572648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650755a-cf76-457e-a784-1e8a071667d6 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:57.572930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650755a-cf76-457e-a784-1e8a071667d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:57.573203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650755a-cf76-457e-a784-1e8a071667d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:57.573865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650755a-cf76-457e-a784-1e8a071667d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:57.574164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650755a-cf76-457e-a784-1e8a071667d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:57.576155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650755a-cf76-457e-a784-1e8a071667d6 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:57.584930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 130/265] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:58:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:57.585092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 135/265] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:57 2022] GET /identity/v3/role_assignments?user.id=7e2559c582e7432db114189569767b5e&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=519b356d36364663a59265dc7eeff0b8 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:57.590751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650755a-cf76-457e-a784-1e8a071667d6 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:57.741799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650755a-cf76-457e-a784-1e8a071667d6 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:57.793148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5268-abb0-4add-a7d2-27a72a1a662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:57.793714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5268-abb0-4add-a7d2-27a72a1a662b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:57.793991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5268-abb0-4add-a7d2-27a72a1a662b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:57.794265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5268-abb0-4add-a7d2-27a72a1a662b None admin] PATH_INFO: `/v3/users/7e2559c582e7432db114189569767b5e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:57.795539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e5268-abb0-4add-a7d2-27a72a1a662b None admin] RBAC: Authorizing `identity:get_user(user_id=7e2559c582e7432db114189569767b5e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:57.797644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e5268-abb0-4add-a7d2-27a72a1a662b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:57.799505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 131/266] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:57 2022] GET /identity/v3/users/7e2559c582e7432db114189569767b5e => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:57.805115 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927988d-b7b5-4f0b-ba6b-fafe142e3b5c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:57.855531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:58.011583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927988d-b7b5-4f0b-ba6b-fafe142e3b5c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:58.056334 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae64365-3699-488a-aef7-b35646337607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:58.057240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae64365-3699-488a-aef7-b35646337607 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:58.057660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae64365-3699-488a-aef7-b35646337607 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:58.058077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae64365-3699-488a-aef7-b35646337607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:58.132592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae64365-3699-488a-aef7-b35646337607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:58.134304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae64365-3699-488a-aef7-b35646337607 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:58.157837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:58.246294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 136/267] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:58:58.255766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5268-abb0-4add-a7d2-27a72a1a662b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:58.278720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:58.425798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5268-abb0-4add-a7d2-27a72a1a662b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:58.446415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649f49f-7f04-41e3-9f22-78b4de1c0e2f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:58.447138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649f49f-7f04-41e3-9f22-78b4de1c0e2f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:58.447559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649f49f-7f04-41e3-9f22-78b4de1c0e2f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:58.449990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 137/268] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:58.456542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364cb67-f802-4873-8a6c-a8a614360768 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:58.457024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364cb67-f802-4873-8a6c-a8a614360768 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:58.457450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364cb67-f802-4873-8a6c-a8a614360768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:58.477824 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f364cb67-f802-4873-8a6c-a8a614360768 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:58.479482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f364cb67-f802-4873-8a6c-a8a614360768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:58.480351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ccbbb-2546-4699-8fd8-4965deafa917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:58.481003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ccbbb-2546-4699-8fd8-4965deafa917 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:58.481287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ccbbb-2546-4699-8fd8-4965deafa917 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:58.481567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ccbbb-2546-4699-8fd8-4965deafa917 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:58.483171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ccbbb-2546-4699-8fd8-4965deafa917 None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:58.484788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ccbbb-2546-4699-8fd8-4965deafa917 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:58.486467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 132/269] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:58:58 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:58.494803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ccbbb-2546-4699-8fd8-4965deafa917 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:58.574529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 138/270] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:58.578854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2a5d2-8529-46e1-acc4-022310adb866 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:58.578854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2a5d2-8529-46e1-acc4-022310adb866 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:58.578854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2a5d2-8529-46e1-acc4-022310adb866 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:58.582339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 139/271] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:58.583583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37b8f-9557-4318-aa6a-5e1749bbdfa6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:58.583860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37b8f-9557-4318-aa6a-5e1749bbdfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:58.584127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37b8f-9557-4318-aa6a-5e1749bbdfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:58.615223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2cd37b8f-9557-4318-aa6a-5e1749bbdfa6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:58.616427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2cd37b8f-9557-4318-aa6a-5e1749bbdfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:58.620960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:58.652100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ccbbb-2546-4699-8fd8-4965deafa917 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:58.706311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:58.718872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1daea-9d65-406b-b0f5-fdfef8be9f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:58.719483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1daea-9d65-406b-b0f5-fdfef8be9f83 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:58.719756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1daea-9d65-406b-b0f5-fdfef8be9f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:58.720022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1daea-9d65-406b-b0f5-fdfef8be9f83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:58.720749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1daea-9d65-406b-b0f5-fdfef8be9f83 None admin] RBAC: Adding query filter params (role.id=779e95b5df394f2a95fbdfa2a9fb58eb, scope.project.id=323eda8873b34125b0dc80cad45fb567, user.id=7e2559c582e7432db114189569767b5e) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:58.721057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1daea-9d65-406b-b0f5-fdfef8be9f83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:58.723735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1daea-9d65-406b-b0f5-fdfef8be9f83 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:58.731654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 133/272] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:58:58 2022] GET /identity/v3/role_assignments?user.id=7e2559c582e7432db114189569767b5e&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=779e95b5df394f2a95fbdfa2a9fb58eb => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:58.756615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 140/273] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:58:58.883781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a09283-e33e-46a6-b9a0-211a3094e0ac None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:58.884447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a09283-e33e-46a6-b9a0-211a3094e0ac None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:58.884928 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a09283-e33e-46a6-b9a0-211a3094e0ac None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:58.886939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 134/274] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:58:58.891758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6e46-0b2e-426b-a66a-4fc63be60d50 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:58.892039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6e46-0b2e-426b-a66a-4fc63be60d50 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:58.892313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6e46-0b2e-426b-a66a-4fc63be60d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:58.910128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a09283-e33e-46a6-b9a0-211a3094e0ac None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:58.923672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bf0d6e46-0b2e-426b-a66a-4fc63be60d50 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:58:58.924892 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bf0d6e46-0b2e-426b-a66a-4fc63be60d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:58:59.041204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 141/275] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:58:59.067125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a09283-e33e-46a6-b9a0-211a3094e0ac None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:59.105446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf7f96-24b4-4de8-b6de-59d2502a75d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:59.106078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7f96-24b4-4de8-b6de-59d2502a75d9 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:59.106397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7f96-24b4-4de8-b6de-59d2502a75d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:59.106683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf7f96-24b4-4de8-b6de-59d2502a75d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:59.118949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d6e46-0b2e-426b-a66a-4fc63be60d50 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:59.124275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf7f96-24b4-4de8-b6de-59d2502a75d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-4bdf7f96-24b4-4de8-b6de-59d2502a75d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:59.129246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:59.130118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:59.130939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 135/276] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:58:59.136251 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf7f96-24b4-4de8-b6de-59d2502a75d9 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:59.143926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:59.266559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d6e46-0b2e-426b-a66a-4fc63be60d50 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:59.267867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf7f96-24b4-4de8-b6de-59d2502a75d9 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:59.279231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:59.305908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba99d30-835f-4e1f-a92a-4b9f80a9a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:59.306625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd66f91-8ecb-444a-9239-9d00d8942396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:59.306965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99d30-835f-4e1f-a92a-4b9f80a9a977 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:59.307278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66f91-8ecb-444a-9239-9d00d8942396 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:59.307537 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99d30-835f-4e1f-a92a-4b9f80a9a977 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:59.307657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66f91-8ecb-444a-9239-9d00d8942396 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:59.307804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66f91-8ecb-444a-9239-9d00d8942396 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:59.308183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba99d30-835f-4e1f-a92a-4b9f80a9a977 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:59.308982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba99d30-835f-4e1f-a92a-4b9f80a9a977 None admin] RBAC: Adding query filter params (name=member) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:59.309090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd66f91-8ecb-444a-9239-9d00d8942396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:59.309520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba99d30-835f-4e1f-a92a-4b9f80a9a977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:59.310737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd66f91-8ecb-444a-9239-9d00d8942396 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:59.311215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba99d30-835f-4e1f-a92a-4b9f80a9a977 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:59.313888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 142/277] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:58:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:59.319645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd66f91-8ecb-444a-9239-9d00d8942396 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:59.322135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 136/278] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:59.327845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba99d30-835f-4e1f-a92a-4b9f80a9a977 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:59.395498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:59.436145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba99d30-835f-4e1f-a92a-4b9f80a9a977 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:59.436551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd66f91-8ecb-444a-9239-9d00d8942396 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:59.471649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc750f-d83d-42df-9a19-819bff71ff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:59.472210 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fcb57-9650-400b-9161-a44cad1d0ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:59.472679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc750f-d83d-42df-9a19-819bff71ff1a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:59.472817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcb57-9650-400b-9161-a44cad1d0ea6 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:59.473095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcb57-9650-400b-9161-a44cad1d0ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:59.473368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcb57-9650-400b-9161-a44cad1d0ea6 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:59.473579 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc750f-d83d-42df-9a19-819bff71ff1a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:59.473980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc750f-d83d-42df-9a19-819bff71ff1a None admin] PATH_INFO: `/v3/users/7a1c2cf61b5340bd84202b726714e379` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:59.474084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fcb57-9650-400b-9161-a44cad1d0ea6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:59.475539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fcb57-9650-400b-9161-a44cad1d0ea6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:59.488379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc750f-d83d-42df-9a19-819bff71ff1a None admin] RBAC: Authorizing `identity:get_user(user_id=7a1c2cf61b5340bd84202b726714e379)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:59.489823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc750f-d83d-42df-9a19-819bff71ff1a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:59.491496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 137/279] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:59 2022] GET /identity/v3/users/7a1c2cf61b5340bd84202b726714e379 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:59.492253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc750f-d83d-42df-9a19-819bff71ff1a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:59.591367 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc750f-d83d-42df-9a19-819bff71ff1a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:59.605025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 143/280] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:58:59 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 15:58:59.606050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fcb57-9650-400b-9161-a44cad1d0ea6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:59.636497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:59.646919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:58:59.652873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173ba1-2402-4034-bc6b-7d4166187b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:59.654520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173ba1-2402-4034-bc6b-7d4166187b37 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:59.655095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173ba1-2402-4034-bc6b-7d4166187b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:59.656155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173ba1-2402-4034-bc6b-7d4166187b37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:59.671952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f173ba1-2402-4034-bc6b-7d4166187b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-8f173ba1-2402-4034-bc6b-7d4166187b37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:58:59.679693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:58:59.680761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:58:59.681741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:58:59.689167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 138/281] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:58:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:58:59.690038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173ba1-2402-4034-bc6b-7d4166187b37 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:58:59.740227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fcb57-9650-400b-9161-a44cad1d0ea6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:59.783192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2cf7e-43d2-4b86-9d28-6045bacc074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:59.783823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2cf7e-43d2-4b86-9d28-6045bacc074b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:59.784098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2cf7e-43d2-4b86-9d28-6045bacc074b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:59.784366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2cf7e-43d2-4b86-9d28-6045bacc074b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:59.785111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2cf7e-43d2-4b86-9d28-6045bacc074b None admin] RBAC: Adding query filter params (role.id=6ba784d4bd374e1793729d1ff430e45f, user.id=7a1c2cf61b5340bd84202b726714e379, scope.system=all) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:59.785417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2cf7e-43d2-4b86-9d28-6045bacc074b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:59.787036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2cf7e-43d2-4b86-9d28-6045bacc074b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:59.799920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 144/282] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Sep 8 15:58:59 2022] GET /identity/v3/role_assignments?user.id=7a1c2cf61b5340bd84202b726714e379&scope.system=all&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:58:59.832300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173ba1-2402-4034-bc6b-7d4166187b37 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:58:59.870770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00701fbe-6fd9-42f0-b799-c445157645c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:58:59.871387 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701fbe-6fd9-42f0-b799-c445157645c7 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:58:59.871668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701fbe-6fd9-42f0-b799-c445157645c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:58:59.871942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00701fbe-6fd9-42f0-b799-c445157645c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:58:59.872626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00701fbe-6fd9-42f0-b799-c445157645c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:58:59.872933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00701fbe-6fd9-42f0-b799-c445157645c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:58:59.874934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00701fbe-6fd9-42f0-b799-c445157645c7 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:58:59.885021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 139/283] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:58:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:58:59.892008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2cf7e-43d2-4b86-9d28-6045bacc074b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:00.013217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:00.017666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2cf7e-43d2-4b86-9d28-6045bacc074b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:00.055518 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc41b5-650f-46c2-a1ec-a7153a82cb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:00.056252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc41b5-650f-46c2-a1ec-a7153a82cb04 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:00.056479 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc41b5-650f-46c2-a1ec-a7153a82cb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:00.056757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc41b5-650f-46c2-a1ec-a7153a82cb04 None admin] PATH_INFO: `/v3/users/ecd2d35c41084116b54033244dfb30e6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:00.057907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc41b5-650f-46c2-a1ec-a7153a82cb04 None admin] RBAC: Authorizing `identity:get_user(user_id=ecd2d35c41084116b54033244dfb30e6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:00.059419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc41b5-650f-46c2-a1ec-a7153a82cb04 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:00.061260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 145/284] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:58:59 2022] GET /identity/v3/users/ecd2d35c41084116b54033244dfb30e6 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:00.067192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00701fbe-6fd9-42f0-b799-c445157645c7 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:00.099535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba130dd8-700f-402b-ad7d-5b3e55cbd0b3 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:00.099843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba130dd8-700f-402b-ad7d-5b3e55cbd0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:00.100097 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba130dd8-700f-402b-ad7d-5b3e55cbd0b3 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:00.101625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 146/285] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:00.106632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678878de-e209-470a-a34c-17337dfd9f4a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:00.106947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678878de-e209-470a-a34c-17337dfd9f4a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:00.107223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678878de-e209-470a-a34c-17337dfd9f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:00.129149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-678878de-e209-470a-a34c-17337dfd9f4a None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:00.130283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-678878de-e209-470a-a34c-17337dfd9f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:00.132074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:00.199039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00701fbe-6fd9-42f0-b799-c445157645c7 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:00.215028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 147/286] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:59:00.237159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199b347-76dc-4f58-addf-957431a22148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:00.237801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199b347-76dc-4f58-addf-957431a22148 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:00.238080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199b347-76dc-4f58-addf-957431a22148 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:00.238353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199b347-76dc-4f58-addf-957431a22148 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:00.239522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199b347-76dc-4f58-addf-957431a22148 None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:00.240978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199b347-76dc-4f58-addf-957431a22148 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:00.242912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 140/287] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:00 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:00.248467 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678878de-e209-470a-a34c-17337dfd9f4a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:00.375770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:00.381986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678878de-e209-470a-a34c-17337dfd9f4a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:00.432413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3d19f-1cff-41a0-8954-58e0cd54c27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:00.433292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3d19f-1cff-41a0-8954-58e0cd54c27c None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:00.433758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3d19f-1cff-41a0-8954-58e0cd54c27c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:00.434384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3d19f-1cff-41a0-8954-58e0cd54c27c None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567/users/ecd2d35c41084116b54033244dfb30e6/roles/a970a114620e467295e3dd153a9f4321` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:00.439963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3d19f-1cff-41a0-8954-58e0cd54c27c None admin] RBAC: Authorizing `identity:create_grant(project_id=323eda8873b34125b0dc80cad45fb567, user_id=ecd2d35c41084116b54033244dfb30e6, role_id=a970a114620e467295e3dd153a9f4321)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:00.441419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3d19f-1cff-41a0-8954-58e0cd54c27c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:00.515823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199b347-76dc-4f58-addf-957431a22148 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:00.537350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 148/288] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:59:00 2022] PUT /identity/v3/projects/323eda8873b34125b0dc80cad45fb567/users/ecd2d35c41084116b54033244dfb30e6/roles/a970a114620e467295e3dd153a9f4321 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:59:00.657447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199b347-76dc-4f58-addf-957431a22148 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:00.684315 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:00.729595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfd5cb-c0de-44c7-96bc-23960cb9ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:00.730253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd5cb-c0de-44c7-96bc-23960cb9ca75 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:00.730536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd5cb-c0de-44c7-96bc-23960cb9ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:00.730843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd5cb-c0de-44c7-96bc-23960cb9ca75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:00.744220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfd5cb-c0de-44c7-96bc-23960cb9ca75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-5ecfd5cb-c0de-44c7-96bc-23960cb9ca75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:00.750036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:00.750948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:00.751737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:00.754416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 141/289] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:00.760597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3d19f-1cff-41a0-8954-58e0cd54c27c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:00.869253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3d19f-1cff-41a0-8954-58e0cd54c27c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:00.906302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667da903-d99f-4819-bff1-397b69e1b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:00.907297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da903-d99f-4819-bff1-397b69e1b65c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:00.907938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da903-d99f-4819-bff1-397b69e1b65c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:00.908410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da903-d99f-4819-bff1-397b69e1b65c None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:00.909273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667da903-d99f-4819-bff1-397b69e1b65c None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:00.909774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667da903-d99f-4819-bff1-397b69e1b65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:00.911392 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667da903-d99f-4819-bff1-397b69e1b65c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:00.922107 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 149/290] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:00.928605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfd5cb-c0de-44c7-96bc-23960cb9ca75 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:01.061141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfd5cb-c0de-44c7-96bc-23960cb9ca75 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:01.099409 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873901a9-430d-475f-ac30-69d8dfc7bf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:01.100437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873901a9-430d-475f-ac30-69d8dfc7bf04 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:01.100989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873901a9-430d-475f-ac30-69d8dfc7bf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:01.101466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873901a9-430d-475f-ac30-69d8dfc7bf04 None admin] PATH_INFO: `/v3/users/beb54459a4344ad6bb88bec382e3a17b` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:01.102835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873901a9-430d-475f-ac30-69d8dfc7bf04 None admin] RBAC: Authorizing `identity:get_user(user_id=beb54459a4344ad6bb88bec382e3a17b)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:01.104498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873901a9-430d-475f-ac30-69d8dfc7bf04 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:01.106602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 142/291] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:59:00 2022] GET /identity/v3/users/beb54459a4344ad6bb88bec382e3a17b => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:01.112511 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667da903-d99f-4819-bff1-397b69e1b65c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:01.133925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:01.219873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667da903-d99f-4819-bff1-397b69e1b65c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:01.255168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ea16e-7305-414c-930d-8afef207bc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:01.256108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ea16e-7305-414c-930d-8afef207bc11 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:01.256623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ea16e-7305-414c-930d-8afef207bc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:01.257113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ea16e-7305-414c-930d-8afef207bc11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:01.330577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ea16e-7305-414c-930d-8afef207bc11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:01.332452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ea16e-7305-414c-930d-8afef207bc11 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:01.352241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:01.438464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 150/292] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:01.444618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873901a9-430d-475f-ac30-69d8dfc7bf04 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:01.492497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:01.554206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873901a9-430d-475f-ac30-69d8dfc7bf04 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:01.591918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232ac07-ed6a-43af-ad37-0fcaf962277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:01.592986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ac07-ed6a-43af-ad37-0fcaf962277d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:01.593469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ac07-ed6a-43af-ad37-0fcaf962277d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:01.593944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ac07-ed6a-43af-ad37-0fcaf962277d None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:01.595428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232ac07-ed6a-43af-ad37-0fcaf962277d None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:01.597185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232ac07-ed6a-43af-ad37-0fcaf962277d None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:01.599423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 143/293] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:01 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:01.605371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ea16e-7305-414c-930d-8afef207bc11 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:01.710616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ea16e-7305-414c-930d-8afef207bc11 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:01.728698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:01.746593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c898c1-ad79-47e3-9031-24936528fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:01.747181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c898c1-ad79-47e3-9031-24936528fd88 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:01.747452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c898c1-ad79-47e3-9031-24936528fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:01.747723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c898c1-ad79-47e3-9031-24936528fd88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:01.748448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c898c1-ad79-47e3-9031-24936528fd88 None admin] RBAC: Adding query filter params (role.id=6ba784d4bd374e1793729d1ff430e45f, scope.project.id=323eda8873b34125b0dc80cad45fb567, user.id=beb54459a4344ad6bb88bec382e3a17b) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:01.748756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c898c1-ad79-47e3-9031-24936528fd88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:01.750780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c898c1-ad79-47e3-9031-24936528fd88 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:01.757252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 151/294] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:01 2022] GET /identity/v3/role_assignments?user.id=beb54459a4344ad6bb88bec382e3a17b&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:02.460569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1050a1-ae18-4f5f-ad8e-da502f09527a None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:02.460859 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1050a1-ae18-4f5f-ad8e-da502f09527a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:02.461141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1050a1-ae18-4f5f-ad8e-da502f09527a None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:02.462480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 144/295] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:02.468488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6f5b-4ddb-4aca-ac4f-92394c284491 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:02.469337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6f5b-4ddb-4aca-ac4f-92394c284491 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:02.469811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6f5b-4ddb-4aca-ac4f-92394c284491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:02.491385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae3403-d47a-432d-91e5-2b0864ec8b24 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:02.492014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae3403-d47a-432d-91e5-2b0864ec8b24 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:02.492478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae3403-d47a-432d-91e5-2b0864ec8b24 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:02.492579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2c0b6f5b-4ddb-4aca-ac4f-92394c284491 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:02.493727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2c0b6f5b-4ddb-4aca-ac4f-92394c284491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:02.495884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 145/296] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:02.501008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dcb04-08b6-49b1-8dc9-547556627840 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:02.501292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dcb04-08b6-49b1-8dc9-547556627840 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:02.501566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dcb04-08b6-49b1-8dc9-547556627840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:02.525289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-152dcb04-08b6-49b1-8dc9-547556627840 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:02.526487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-152dcb04-08b6-49b1-8dc9-547556627840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:02.587985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 152/297] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:02.603791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 146/298] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:59:02.688260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac3d6e-0a5a-4491-a6c2-6fb0b2cde6ed None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:02.688579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac3d6e-0a5a-4491-a6c2-6fb0b2cde6ed None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:02.688807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac3d6e-0a5a-4491-a6c2-6fb0b2cde6ed None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:02.690289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 153/299] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:02.695877 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614be6c-85da-4af9-92d1-f2e5dd46dc40 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:02.696393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614be6c-85da-4af9-92d1-f2e5dd46dc40 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:02.696865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614be6c-85da-4af9-92d1-f2e5dd46dc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:02.716005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c614be6c-85da-4af9-92d1-f2e5dd46dc40 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:02.717477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c614be6c-85da-4af9-92d1-f2e5dd46dc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:02.753687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:02.787025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 147/300] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:02.859834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac3d6e-0a5a-4491-a6c2-6fb0b2cde6ed None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:02.893931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614be6c-85da-4af9-92d1-f2e5dd46dc40 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:02.976992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac3d6e-0a5a-4491-a6c2-6fb0b2cde6ed None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:02.994749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:03.005160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614be6c-85da-4af9-92d1-f2e5dd46dc40 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:03.024222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a4f5e-bca6-46cd-a7c2-f742b0bb057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:03.025134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a4f5e-bca6-46cd-a7c2-f742b0bb057a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.025611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a4f5e-bca6-46cd-a7c2-f742b0bb057a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.026109 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a4f5e-bca6-46cd-a7c2-f742b0bb057a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.038292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a4f5e-bca6-46cd-a7c2-f742b0bb057a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:03.041037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c443cc9-2310-4bb4-bf42-cf28b984b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:03.041838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c443cc9-2310-4bb4-bf42-cf28b984b63e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.042317 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c443cc9-2310-4bb4-bf42-cf28b984b63e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.042812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c443cc9-2310-4bb4-bf42-cf28b984b63e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.044120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c443cc9-2310-4bb4-bf42-cf28b984b63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-cf4a4f5e-bca6-46cd-a7c2-f742b0bb057a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:03.044387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:03.045323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:03.050975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 154/301] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:03.051691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c443cc9-2310-4bb4-bf42-cf28b984b63e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:03.051691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 148/302] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:03.054397 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a4f5e-bca6-46cd-a7c2-f742b0bb057a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:03.054883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c443cc9-2310-4bb4-bf42-cf28b984b63e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:03.100748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:03.162262 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c443cc9-2310-4bb4-bf42-cf28b984b63e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:03.164088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a4f5e-bca6-46cd-a7c2-f742b0bb057a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:03.196588 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7edbd6-3cd1-453a-80c1-cd77f1a4c824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:03.197193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7edbd6-3cd1-453a-80c1-cd77f1a4c824 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.197468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7edbd6-3cd1-453a-80c1-cd77f1a4c824 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.197735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7edbd6-3cd1-453a-80c1-cd77f1a4c824 None admin] PATH_INFO: `/v3/groups` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.198357 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7edbd6-3cd1-453a-80c1-cd77f1a4c824 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:03.199848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7edbd6-3cd1-453a-80c1-cd77f1a4c824 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:03.204074 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dddfc6-2c5e-4f4d-8422-935973763e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:03.204796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddfc6-2c5e-4f4d-8422-935973763e81 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.205077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddfc6-2c5e-4f4d-8422-935973763e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.205351 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddfc6-2c5e-4f4d-8422-935973763e81 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.206047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dddfc6-2c5e-4f4d-8422-935973763e81 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:03.206336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dddfc6-2c5e-4f4d-8422-935973763e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:03.207946 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dddfc6-2c5e-4f4d-8422-935973763e81 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:03.218859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 155/303] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:03.218859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dddfc6-2c5e-4f4d-8422-935973763e81 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:03.260676 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:03.284333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 149/304] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Sep 8 15:59:03 2022] POST /identity/v3/groups => generated 229 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:59:03.290580 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7edbd6-3cd1-453a-80c1-cd77f1a4c824 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:03.330719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dddfc6-2c5e-4f4d-8422-935973763e81 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:03.375459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04519a40-4dc0-4825-a2e3-f6e9aafd332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:03.376111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519a40-4dc0-4825-a2e3-f6e9aafd332b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.376396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519a40-4dc0-4825-a2e3-f6e9aafd332b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.376662 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519a40-4dc0-4825-a2e3-f6e9aafd332b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.389718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04519a40-4dc0-4825-a2e3-f6e9aafd332b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-04519a40-4dc0-4825-a2e3-f6e9aafd332b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:03.395250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:03.396164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:03.397038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 156/305] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:03.398733 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c65316-7928-45ce-a480-28535c99980a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.398733 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c65316-7928-45ce-a480-28535c99980a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.398733 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c65316-7928-45ce-a480-28535c99980a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.399637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 157/306] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:03.404608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c65316-7928-45ce-a480-28535c99980a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:03.429760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:03.434740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7edbd6-3cd1-453a-80c1-cd77f1a4c824 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:03.474082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5f9fe-dae7-4d6b-b9c5-3c247cd88948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:03.475170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f9fe-dae7-4d6b-b9c5-3c247cd88948 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.475515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f9fe-dae7-4d6b-b9c5-3c247cd88948 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.476419 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f9fe-dae7-4d6b-b9c5-3c247cd88948 None admin] PATH_INFO: `/v3/users/7a1c2cf61b5340bd84202b726714e379` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.477721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5f9fe-dae7-4d6b-b9c5-3c247cd88948 None admin] RBAC: Authorizing `identity:get_user(user_id=7a1c2cf61b5340bd84202b726714e379)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:03.479831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5f9fe-dae7-4d6b-b9c5-3c247cd88948 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:03.482827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 150/307] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:59:03 2022] GET /identity/v3/users/7a1c2cf61b5340bd84202b726714e379 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:03.483079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e5e9e-222f-4cdb-be7d-dd0c6b37c03e None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.483901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e5e9e-222f-4cdb-be7d-dd0c6b37c03e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.484172 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e5e9e-222f-4cdb-be7d-dd0c6b37c03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.502701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c30e5e9e-222f-4cdb-be7d-dd0c6b37c03e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:03.504091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c30e5e9e-222f-4cdb-be7d-dd0c6b37c03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:03.510932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:03.520007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c65316-7928-45ce-a480-28535c99980a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:03.556111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c0103-2fcf-453a-85ca-31b1ca69826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:03.556724 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0103-2fcf-453a-85ca-31b1ca69826c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.557010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0103-2fcf-453a-85ca-31b1ca69826c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.557281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c0103-2fcf-453a-85ca-31b1ca69826c None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.558303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c0103-2fcf-453a-85ca-31b1ca69826c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:03.558970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c0103-2fcf-453a-85ca-31b1ca69826c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:03.561184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c0103-2fcf-453a-85ca-31b1ca69826c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:03.569498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 158/308] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:03.570186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c0103-2fcf-453a-85ca-31b1ca69826c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:03.576208 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 151/309] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:03.577442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e5e9e-222f-4cdb-be7d-dd0c6b37c03e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:03.679233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:03.686345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e5e9e-222f-4cdb-be7d-dd0c6b37c03e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:03.693893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c0103-2fcf-453a-85ca-31b1ca69826c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:03.726461 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c880cc8-c5ce-47e7-8db9-010b399f60fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:03.727130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c880cc8-c5ce-47e7-8db9-010b399f60fe None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.727403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c880cc8-c5ce-47e7-8db9-010b399f60fe None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.727670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c880cc8-c5ce-47e7-8db9-010b399f60fe None admin] PATH_INFO: `/v3/users/9c9ba1e2990a4035b8bc2021725bfa4f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.737152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f43613-a340-4efb-95e3-7bc31bd39612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:03.738095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f43613-a340-4efb-95e3-7bc31bd39612 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.738569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f43613-a340-4efb-95e3-7bc31bd39612 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.739078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f43613-a340-4efb-95e3-7bc31bd39612 None admin] PATH_INFO: `/v3/system/users/7a1c2cf61b5340bd84202b726714e379/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.741409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f43613-a340-4efb-95e3-7bc31bd39612 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7a1c2cf61b5340bd84202b726714e379, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:03.743065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c880cc8-c5ce-47e7-8db9-010b399f60fe None admin] RBAC: Authorizing `identity:get_user(user_id=9c9ba1e2990a4035b8bc2021725bfa4f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:03.743600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f43613-a340-4efb-95e3-7bc31bd39612 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:03.744523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c880cc8-c5ce-47e7-8db9-010b399f60fe None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:03.746166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 152/310] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:59:03 2022] GET /identity/v3/users/9c9ba1e2990a4035b8bc2021725bfa4f => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:03.751968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c880cc8-c5ce-47e7-8db9-010b399f60fe None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:03.822977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 159/311] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Sep 8 15:59:03 2022] PUT /identity/v3/system/users/7a1c2cf61b5340bd84202b726714e379/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:59:03.854299 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f43613-a340-4efb-95e3-7bc31bd39612 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:03.865509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c880cc8-c5ce-47e7-8db9-010b399f60fe None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:03.902943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a70971-f029-41e3-9e26-18b8bfafc526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:03.903566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a70971-f029-41e3-9e26-18b8bfafc526 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:03.903843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a70971-f029-41e3-9e26-18b8bfafc526 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:03.904112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a70971-f029-41e3-9e26-18b8bfafc526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:03.904852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a70971-f029-41e3-9e26-18b8bfafc526 None admin] RBAC: Adding query filter params (role.id=a970a114620e467295e3dd153a9f4321, user.id=9c9ba1e2990a4035b8bc2021725bfa4f, scope.system=all) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:03.905697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a70971-f029-41e3-9e26-18b8bfafc526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:03.910758 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a70971-f029-41e3-9e26-18b8bfafc526 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:03.911313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:03.916661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 153/312] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Sep 8 15:59:03 2022] GET /identity/v3/role_assignments?user.id=9c9ba1e2990a4035b8bc2021725bfa4f&scope.system=all&role.id=a970a114620e467295e3dd153a9f4321 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:04.024531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f43613-a340-4efb-95e3-7bc31bd39612 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:04.065776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d822228-0152-42d7-90c0-397ed64b4818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:04.066434 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d822228-0152-42d7-90c0-397ed64b4818 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:04.067506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d822228-0152-42d7-90c0-397ed64b4818 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:04.067506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d822228-0152-42d7-90c0-397ed64b4818 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:04.081743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d822228-0152-42d7-90c0-397ed64b4818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8d822228-0152-42d7-90c0-397ed64b4818 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:04.087663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:04.088589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:59:04.089399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:04.090472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 160/313] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:04.096719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a70971-f029-41e3-9e26-18b8bfafc526 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:04.117721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:04.201737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a70971-f029-41e3-9e26-18b8bfafc526 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:04.238890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef876686-c413-4e7b-8f2f-0b9f97bad0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:04.239525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef876686-c413-4e7b-8f2f-0b9f97bad0af None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:04.239799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef876686-c413-4e7b-8f2f-0b9f97bad0af None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:04.240064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef876686-c413-4e7b-8f2f-0b9f97bad0af None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:04.240747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef876686-c413-4e7b-8f2f-0b9f97bad0af None admin] RBAC: Adding query filter params (name=reader) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:04.241045 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef876686-c413-4e7b-8f2f-0b9f97bad0af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:04.242550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef876686-c413-4e7b-8f2f-0b9f97bad0af None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:04.256774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 154/314] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:04.258123 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d822228-0152-42d7-90c0-397ed64b4818 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:04.342476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:04.361068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d822228-0152-42d7-90c0-397ed64b4818 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:04.397328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131684a-f223-4184-910b-4ccb5b0ee87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:04.398303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131684a-f223-4184-910b-4ccb5b0ee87f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:04.398779 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131684a-f223-4184-910b-4ccb5b0ee87f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:04.399224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131684a-f223-4184-910b-4ccb5b0ee87f None admin] PATH_INFO: `/v3/users/ecd2d35c41084116b54033244dfb30e6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:04.400540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131684a-f223-4184-910b-4ccb5b0ee87f None admin] RBAC: Authorizing `identity:get_user(user_id=ecd2d35c41084116b54033244dfb30e6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:04.402160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131684a-f223-4184-910b-4ccb5b0ee87f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:04.404266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 161/315] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:59:04 2022] GET /identity/v3/users/ecd2d35c41084116b54033244dfb30e6 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:04.412238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef876686-c413-4e7b-8f2f-0b9f97bad0af None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:04.502183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:04.522715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef876686-c413-4e7b-8f2f-0b9f97bad0af None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:04.556867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c3a26-0b9c-44cf-b442-9d8185d631ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:04.557474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3a26-0b9c-44cf-b442-9d8185d631ad None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:04.557746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3a26-0b9c-44cf-b442-9d8185d631ad None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:04.558014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3a26-0b9c-44cf-b442-9d8185d631ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:04.627429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c3a26-0b9c-44cf-b442-9d8185d631ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:04.628817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c3a26-0b9c-44cf-b442-9d8185d631ad None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:04.715417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:04.735443 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 155/316] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:04.741150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131684a-f223-4184-910b-4ccb5b0ee87f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:04.852608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131684a-f223-4184-910b-4ccb5b0ee87f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:04.889138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4a58e-a6d2-4e5d-8cdd-3e34d4d2f85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:04.889778 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4a58e-a6d2-4e5d-8cdd-3e34d4d2f85f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:04.890056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4a58e-a6d2-4e5d-8cdd-3e34d4d2f85f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:04.890329 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4a58e-a6d2-4e5d-8cdd-3e34d4d2f85f None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:04.891476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4a58e-a6d2-4e5d-8cdd-3e34d4d2f85f None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:04.892918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4a58e-a6d2-4e5d-8cdd-3e34d4d2f85f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:04.895128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 162/317] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:04 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:04.900631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c3a26-0b9c-44cf-b442-9d8185d631ad None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:05.000042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c3a26-0b9c-44cf-b442-9d8185d631ad None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:05.034699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d32f20-c1b4-4391-82d6-675ce7af9ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:05.035322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d32f20-c1b4-4391-82d6-675ce7af9ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:05.035599 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d32f20-c1b4-4391-82d6-675ce7af9ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:05.035871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d32f20-c1b4-4391-82d6-675ce7af9ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:05.036595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d32f20-c1b4-4391-82d6-675ce7af9ce0 None admin] RBAC: Adding query filter params (role.id=a970a114620e467295e3dd153a9f4321, scope.project.id=323eda8873b34125b0dc80cad45fb567, user.id=ecd2d35c41084116b54033244dfb30e6) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:05.036903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d32f20-c1b4-4391-82d6-675ce7af9ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:05.038352 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d32f20-c1b4-4391-82d6-675ce7af9ce0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:05.044515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 156/318] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:04 2022] GET /identity/v3/role_assignments?user.id=ecd2d35c41084116b54033244dfb30e6&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=a970a114620e467295e3dd153a9f4321 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:05.634333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edad3e-84f2-4389-8cc4-cd859895246e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:05.634615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edad3e-84f2-4389-8cc4-cd859895246e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:05.635086 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edad3e-84f2-4389-8cc4-cd859895246e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:05.636422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 163/319] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:05.642233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d7806-3ff4-482c-bd77-33f450f045ab None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:05.642519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d7806-3ff4-482c-bd77-33f450f045ab None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:05.642831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d7806-3ff4-482c-bd77-33f450f045ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:05.661513 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-412d7806-3ff4-482c-bd77-33f450f045ab None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:05.662745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-412d7806-3ff4-482c-bd77-33f450f045ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:05.701736 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:05.728147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 157/320] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:05.995994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edad3e-84f2-4389-8cc4-cd859895246e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:06.017962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:06.108358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edad3e-84f2-4389-8cc4-cd859895246e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:06.116386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2c19-5e76-4be5-8fbc-d35ffb18e1f0 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:06.116675 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2c19-5e76-4be5-8fbc-d35ffb18e1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:06.116956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2c19-5e76-4be5-8fbc-d35ffb18e1f0 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:06.118306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 158/321] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:06.123384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473c0d-66ce-457d-bf51-185582911efb None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:06.123674 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473c0d-66ce-457d-bf51-185582911efb None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:06.124439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473c0d-66ce-457d-bf51-185582911efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:06.142944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-40473c0d-66ce-457d-bf51-185582911efb None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:06.144700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-40473c0d-66ce-457d-bf51-185582911efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:06.146964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473410d-fd38-4e4f-a274-0e8356a42a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:06.148387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473410d-fd38-4e4f-a274-0e8356a42a12 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:06.148667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473410d-fd38-4e4f-a274-0e8356a42a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:06.148938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473410d-fd38-4e4f-a274-0e8356a42a12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:06.150035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473410d-fd38-4e4f-a274-0e8356a42a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:06.151494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473410d-fd38-4e4f-a274-0e8356a42a12 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:06.153476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 164/322] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:06.155156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5671ba-54a5-427e-8842-c653b9d31b6e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:06.155741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5671ba-54a5-427e-8842-c653b9d31b6e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:06.156028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5671ba-54a5-427e-8842-c653b9d31b6e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:06.157339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 165/323] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:06.159534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5671ba-54a5-427e-8842-c653b9d31b6e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:06.211506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 159/324] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:59:06.212739 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c5679-24f3-4685-a948-9f9fcba257c9 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:06.213205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c5679-24f3-4685-a948-9f9fcba257c9 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:06.213641 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c5679-24f3-4685-a948-9f9fcba257c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:06.230935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-476c5679-24f3-4685-a948-9f9fcba257c9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:06.232139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-476c5679-24f3-4685-a948-9f9fcba257c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:06.249924 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:06.269553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5671ba-54a5-427e-8842-c653b9d31b6e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:06.303911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 160/325] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:06.308201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24920d21-3c2a-4de6-8328-a6a1adc44bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:06.308816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24920d21-3c2a-4de6-8328-a6a1adc44bbd None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:06.309096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24920d21-3c2a-4de6-8328-a6a1adc44bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:06.309368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24920d21-3c2a-4de6-8328-a6a1adc44bbd None admin] PATH_INFO: `/v3/groups` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:06.310008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24920d21-3c2a-4de6-8328-a6a1adc44bbd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:06.312037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24920d21-3c2a-4de6-8328-a6a1adc44bbd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:06.392719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 166/326] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Sep 8 15:59:06 2022] POST /identity/v3/groups => generated 226 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 15:59:06.481149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c5679-24f3-4685-a948-9f9fcba257c9 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:06.518351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:06.583307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24920d21-3c2a-4de6-8328-a6a1adc44bbd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:06.589874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c5679-24f3-4685-a948-9f9fcba257c9 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:06.627135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c71c5-4df3-49db-a828-18b0b42065c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:06.628011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c71c5-4df3-49db-a828-18b0b42065c4 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:06.628292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c71c5-4df3-49db-a828-18b0b42065c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:06.628587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c71c5-4df3-49db-a828-18b0b42065c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:06.639511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c71c5-4df3-49db-a828-18b0b42065c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-ea6c71c5-4df3-49db-a828-18b0b42065c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:06.644697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:06.645770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:06.646655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 161/327] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:06.651867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c71c5-4df3-49db-a828-18b0b42065c4 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:06.716109 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24920d21-3c2a-4de6-8328-a6a1adc44bbd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:06.756078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f17002-671b-4a17-b6b5-7a85ea3eb7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:06.756897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f17002-671b-4a17-b6b5-7a85ea3eb7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:06.757236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f17002-671b-4a17-b6b5-7a85ea3eb7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:06.757593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f17002-671b-4a17-b6b5-7a85ea3eb7e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:06.770633 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f17002-671b-4a17-b6b5-7a85ea3eb7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-80f17002-671b-4a17-b6b5-7a85ea3eb7e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:06.776629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:06.777713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:59:06.778685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:06.781004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 167/328] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:06.782605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:06.785274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f17002-671b-4a17-b6b5-7a85ea3eb7e9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:06.789149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:06.795509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c71c5-4df3-49db-a828-18b0b42065c4 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:06.850138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05579da5-55a8-4d02-afc9-502a94641dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:06.851148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05579da5-55a8-4d02-afc9-502a94641dcb None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:06.851435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05579da5-55a8-4d02-afc9-502a94641dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:06.851712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05579da5-55a8-4d02-afc9-502a94641dcb None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:06.852732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05579da5-55a8-4d02-afc9-502a94641dcb None admin] RBAC: Adding query filter params (name=member) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:06.853042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05579da5-55a8-4d02-afc9-502a94641dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:06.855955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05579da5-55a8-4d02-afc9-502a94641dcb None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:06.867961 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 162/329] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:06.875470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05579da5-55a8-4d02-afc9-502a94641dcb None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:06.907146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f17002-671b-4a17-b6b5-7a85ea3eb7e9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:06.951406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90be9-598f-41d1-a4f5-181feabfbceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:06.952519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90be9-598f-41d1-a4f5-181feabfbceb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:06.952793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90be9-598f-41d1-a4f5-181feabfbceb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:06.953350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90be9-598f-41d1-a4f5-181feabfbceb None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:06.954020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb90be9-598f-41d1-a4f5-181feabfbceb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:06.954321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb90be9-598f-41d1-a4f5-181feabfbceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:06.956350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb90be9-598f-41d1-a4f5-181feabfbceb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:06.966572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 168/330] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:06.972125 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90be9-598f-41d1-a4f5-181feabfbceb None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:07.007657 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05579da5-55a8-4d02-afc9-502a94641dcb None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:07.047848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a0658-6708-4d54-8077-e8f8a3995e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:07.048565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a0658-6708-4d54-8077-e8f8a3995e08 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:07.049054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:07.049502 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a0658-6708-4d54-8077-e8f8a3995e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:07.049633 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a0658-6708-4d54-8077-e8f8a3995e08 None admin] PATH_INFO: `/v3/users/7a1c2cf61b5340bd84202b726714e379` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:07.051154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a0658-6708-4d54-8077-e8f8a3995e08 None admin] RBAC: Authorizing `identity:get_user(user_id=7a1c2cf61b5340bd84202b726714e379)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:07.053149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a0658-6708-4d54-8077-e8f8a3995e08 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:07.055537 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 163/331] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:59:06 2022] GET /identity/v3/users/7a1c2cf61b5340bd84202b726714e379 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:07.061880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a0658-6708-4d54-8077-e8f8a3995e08 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:07.091450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90be9-598f-41d1-a4f5-181feabfbceb None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:07.102230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:07.135286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c3c24-e689-4823-b14b-1d9fc12be42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:07.136538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c3c24-e689-4823-b14b-1d9fc12be42a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:07.136990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c3c24-e689-4823-b14b-1d9fc12be42a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:07.137431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c3c24-e689-4823-b14b-1d9fc12be42a None admin] PATH_INFO: `/v3/users/9c9ba1e2990a4035b8bc2021725bfa4f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:07.138775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c3c24-e689-4823-b14b-1d9fc12be42a None admin] RBAC: Authorizing `identity:get_user(user_id=9c9ba1e2990a4035b8bc2021725bfa4f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:07.140255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c3c24-e689-4823-b14b-1d9fc12be42a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:07.142193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 169/332] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:59:06 2022] GET /identity/v3/users/9c9ba1e2990a4035b8bc2021725bfa4f => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:07.148161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c3c24-e689-4823-b14b-1d9fc12be42a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:07.215568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a0658-6708-4d54-8077-e8f8a3995e08 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:07.261325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39b6c7-9470-4aaf-a9aa-321bd900f3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:07.262870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39b6c7-9470-4aaf-a9aa-321bd900f3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:07.263617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39b6c7-9470-4aaf-a9aa-321bd900f3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:07.264097 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39b6c7-9470-4aaf-a9aa-321bd900f3f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:07.265547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39b6c7-9470-4aaf-a9aa-321bd900f3f0 None admin] RBAC: Adding query filter params (role.id=6ba784d4bd374e1793729d1ff430e45f, user.id=7a1c2cf61b5340bd84202b726714e379, scope.system=all) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:07.266213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39b6c7-9470-4aaf-a9aa-321bd900f3f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:07.268482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39b6c7-9470-4aaf-a9aa-321bd900f3f0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:07.274879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c3c24-e689-4823-b14b-1d9fc12be42a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:07.285044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 164/333] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Sep 8 15:59:07 2022] GET /identity/v3/role_assignments?user.id=7a1c2cf61b5340bd84202b726714e379&scope.system=all&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:07.335137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f600f8-83fe-4020-b29d-02a46759383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:07.335738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f600f8-83fe-4020-b29d-02a46759383f None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:07.336013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f600f8-83fe-4020-b29d-02a46759383f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:07.336282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f600f8-83fe-4020-b29d-02a46759383f None admin] PATH_INFO: `/v3/system/users/9c9ba1e2990a4035b8bc2021725bfa4f/roles/a970a114620e467295e3dd153a9f4321` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:07.337757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f600f8-83fe-4020-b29d-02a46759383f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9c9ba1e2990a4035b8bc2021725bfa4f, role_id=a970a114620e467295e3dd153a9f4321)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:07.339247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f600f8-83fe-4020-b29d-02a46759383f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:07.341069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:07.425475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 170/334] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Sep 8 15:59:07 2022] PUT /identity/v3/system/users/9c9ba1e2990a4035b8bc2021725bfa4f/roles/a970a114620e467295e3dd153a9f4321 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 15:59:08.879670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a20f-e738-419f-a436-426131ddfdad None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:08.889602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a20f-e738-419f-a436-426131ddfdad None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:08.889602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a20f-e738-419f-a436-426131ddfdad None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:08.889602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 165/335] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:08.889876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae9e8-197a-400b-9486-2e059f18be76 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:08.889876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae9e8-197a-400b-9486-2e059f18be76 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:08.889876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae9e8-197a-400b-9486-2e059f18be76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:08.915716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-425ae9e8-197a-400b-9486-2e059f18be76 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:08.917183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-425ae9e8-197a-400b-9486-2e059f18be76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:08.996445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 171/336] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:09.357683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9a20f-e738-419f-a436-426131ddfdad None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:09.403261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a2a20-6485-4005-be15-a7ff57336c73 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:09.403878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a2a20-6485-4005-be15-a7ff57336c73 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:09.404369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a2a20-6485-4005-be15-a7ff57336c73 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:09.406544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 172/337] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:59:09.425093 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202b5f1-3f2a-4c6f-8802-0c527ea99e8c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:09.425608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202b5f1-3f2a-4c6f-8802-0c527ea99e8c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:09.426076 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202b5f1-3f2a-4c6f-8802-0c527ea99e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:09.457330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d202b5f1-3f2a-4c6f-8802-0c527ea99e8c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:09.460338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d202b5f1-3f2a-4c6f-8802-0c527ea99e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:09.533951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:09.578807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9a20f-e738-419f-a436-426131ddfdad None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:09.608819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 173/338] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:09.631519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98869d88-90a6-4bb4-a9cb-e90e53a0d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:09.632156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98869d88-90a6-4bb4-a9cb-e90e53a0d4db None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:09.632433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98869d88-90a6-4bb4-a9cb-e90e53a0d4db None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:09.632707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98869d88-90a6-4bb4-a9cb-e90e53a0d4db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:09.649969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98869d88-90a6-4bb4-a9cb-e90e53a0d4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-98869d88-90a6-4bb4-a9cb-e90e53a0d4db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:09.655072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:09.655931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:09.656731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 166/339] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:09.661914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202b5f1-3f2a-4c6f-8802-0c527ea99e8c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:09.728559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:09.775835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202b5f1-3f2a-4c6f-8802-0c527ea99e8c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:09.814481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126f43f-cd31-448c-aced-286287d3892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:09.815137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f43f-cd31-448c-aced-286287d3892d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:09.815412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f43f-cd31-448c-aced-286287d3892d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:09.815681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126f43f-cd31-448c-aced-286287d3892d None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:09.816350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126f43f-cd31-448c-aced-286287d3892d None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:09.816649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126f43f-cd31-448c-aced-286287d3892d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:09.818087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126f43f-cd31-448c-aced-286287d3892d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:09.828452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 174/340] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:09.833724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98869d88-90a6-4bb4-a9cb-e90e53a0d4db None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:09.954406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98869d88-90a6-4bb4-a9cb-e90e53a0d4db None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:10.000892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4c128-dfe1-4b3a-9f9b-1e147f74f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:10.001509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c128-dfe1-4b3a-9f9b-1e147f74f236 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:10.001787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c128-dfe1-4b3a-9f9b-1e147f74f236 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:10.002057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4c128-dfe1-4b3a-9f9b-1e147f74f236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:10.019843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:10.089717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4c128-dfe1-4b3a-9f9b-1e147f74f236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:10.091311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4c128-dfe1-4b3a-9f9b-1e147f74f236 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:10.175643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3898f2-3982-43fd-a717-6f6ec9cd141b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:10.176141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3898f2-3982-43fd-a717-6f6ec9cd141b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:10.176216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3898f2-3982-43fd-a717-6f6ec9cd141b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:10.177661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 175/341] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:59:10.186718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3898f2-3982-43fd-a717-6f6ec9cd141b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:10.229806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 167/342] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 15:59:10.236253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac3ec-1503-4a05-aeac-1d91d2d386da None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:10.237087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac3ec-1503-4a05-aeac-1d91d2d386da None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:10.238190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac3ec-1503-4a05-aeac-1d91d2d386da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:10.275928 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-960ac3ec-1503-4a05-aeac-1d91d2d386da None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:10.278400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-960ac3ec-1503-4a05-aeac-1d91d2d386da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:10.335108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:10.367486 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 168/343] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:10.368910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ac3ec-1503-4a05-aeac-1d91d2d386da None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:10.416560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3898f2-3982-43fd-a717-6f6ec9cd141b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:10.456424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:10.486043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde1b35-1d1c-46b4-acae-0e674966ed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:10.486790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1b35-1d1c-46b4-acae-0e674966ed20 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:10.487169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1b35-1d1c-46b4-acae-0e674966ed20 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:10.487444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1b35-1d1c-46b4-acae-0e674966ed20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:10.508264 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde1b35-1d1c-46b4-acae-0e674966ed20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-acde1b35-1d1c-46b4-acae-0e674966ed20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:10.518160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:10.519121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:10.519909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 176/344] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:59:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:10.526286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde1b35-1d1c-46b4-acae-0e674966ed20 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:10.540540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ac3ec-1503-4a05-aeac-1d91d2d386da None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:10.585757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e877843-01e7-47ca-a88a-f117ce0335a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:10.586406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e877843-01e7-47ca-a88a-f117ce0335a5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:10.586693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e877843-01e7-47ca-a88a-f117ce0335a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:10.586997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e877843-01e7-47ca-a88a-f117ce0335a5 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:10.588139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e877843-01e7-47ca-a88a-f117ce0335a5 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:10.589635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e877843-01e7-47ca-a88a-f117ce0335a5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:10.591718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 169/345] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:10 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:10.597555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e877843-01e7-47ca-a88a-f117ce0335a5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:10.678838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:10.738087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde1b35-1d1c-46b4-acae-0e674966ed20 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:10.785150 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e877843-01e7-47ca-a88a-f117ce0335a5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:10.809294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f7f25-191d-4ba5-a8c3-ea7ddf1f9bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:10.810261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7f25-191d-4ba5-a8c3-ea7ddf1f9bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:10.810702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7f25-191d-4ba5-a8c3-ea7ddf1f9bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:10.811686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7f25-191d-4ba5-a8c3-ea7ddf1f9bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:10.812527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f7f25-191d-4ba5-a8c3-ea7ddf1f9bb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:10.814391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f7f25-191d-4ba5-a8c3-ea7ddf1f9bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:10.816035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f7f25-191d-4ba5-a8c3-ea7ddf1f9bb4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:10.837844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 177/346] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:10.839008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f7f25-191d-4ba5-a8c3-ea7ddf1f9bb4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:10.880749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b050daf-dff2-4613-a63c-714e4c22b991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:10.880966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b050daf-dff2-4613-a63c-714e4c22b991 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:10.881233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b050daf-dff2-4613-a63c-714e4c22b991 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:10.881503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b050daf-dff2-4613-a63c-714e4c22b991 None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:10.889822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:10.907380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b050daf-dff2-4613-a63c-714e4c22b991 None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:10.908833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b050daf-dff2-4613-a63c-714e4c22b991 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:10.912702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 170/347] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:10 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:10.912702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b050daf-dff2-4613-a63c-714e4c22b991 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:10.956911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f7f25-191d-4ba5-a8c3-ea7ddf1f9bb4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:10.999136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af43df4-ef00-4c0c-80e0-c07d039e6589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:11.000076 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af43df4-ef00-4c0c-80e0-c07d039e6589 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.000356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af43df4-ef00-4c0c-80e0-c07d039e6589 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.000632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af43df4-ef00-4c0c-80e0-c07d039e6589 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.014906 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af43df4-ef00-4c0c-80e0-c07d039e6589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9af43df4-ef00-4c0c-80e0-c07d039e6589 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:11.020937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:11.021866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 178/348] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:11.023805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af43df4-ef00-4c0c-80e0-c07d039e6589 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:11.067152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b050daf-dff2-4613-a63c-714e4c22b991 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:11.070400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:11.106492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71679df-e3ec-4447-b44d-da21c1b4af6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:11.107321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71679df-e3ec-4447-b44d-da21c1b4af6f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.108361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71679df-e3ec-4447-b44d-da21c1b4af6f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.108745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71679df-e3ec-4447-b44d-da21c1b4af6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.149045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af43df4-ef00-4c0c-80e0-c07d039e6589 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:11.151081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:11.193377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71679df-e3ec-4447-b44d-da21c1b4af6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:11.195108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71679df-e3ec-4447-b44d-da21c1b4af6f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:11.196063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdb1cd-b2d6-459a-85f7-ef27a05ff60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:11.197432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdb1cd-b2d6-459a-85f7-ef27a05ff60d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.197894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdb1cd-b2d6-459a-85f7-ef27a05ff60d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.199087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdb1cd-b2d6-459a-85f7-ef27a05ff60d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.199827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdb1cd-b2d6-459a-85f7-ef27a05ff60d None admin] RBAC: Adding query filter params (group.id=8b1729e1a6b04785a1cc06472b91c9ad, role.id=6ba784d4bd374e1793729d1ff430e45f, scope.project.id=680231dab5b3448499d71c6cba44d7c6) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:11.200140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdb1cd-b2d6-459a-85f7-ef27a05ff60d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:11.201604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdb1cd-b2d6-459a-85f7-ef27a05ff60d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:11.207760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 179/349] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Sep 8 15:59:11 2022] GET /identity/v3/role_assignments?group.id=8b1729e1a6b04785a1cc06472b91c9ad&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:11.209052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063cd41-e698-43b8-b196-5a2b87eae104 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.209393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063cd41-e698-43b8-b196-5a2b87eae104 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.209677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063cd41-e698-43b8-b196-5a2b87eae104 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.211246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 180/350] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:11.212049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063cd41-e698-43b8-b196-5a2b87eae104 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:11.338081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063cd41-e698-43b8-b196-5a2b87eae104 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:11.383140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c410e0e-ad6d-4d44-8284-b3bd3dfea724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:11.383764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c410e0e-ad6d-4d44-8284-b3bd3dfea724 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.384036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c410e0e-ad6d-4d44-8284-b3bd3dfea724 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.384300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c410e0e-ad6d-4d44-8284-b3bd3dfea724 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.385560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c410e0e-ad6d-4d44-8284-b3bd3dfea724 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:11.385870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c410e0e-ad6d-4d44-8284-b3bd3dfea724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:11.387629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c410e0e-ad6d-4d44-8284-b3bd3dfea724 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:11.398352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 181/351] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:11.399733 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c924f5-110b-4e79-9ed7-0f79fff4bd96 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.400017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c924f5-110b-4e79-9ed7-0f79fff4bd96 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.400287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c924f5-110b-4e79-9ed7-0f79fff4bd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.428606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 171/352] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:11.429483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71679df-e3ec-4447-b44d-da21c1b4af6f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:11.438858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-42c924f5-110b-4e79-9ed7-0f79fff4bd96 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:11.440068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-42c924f5-110b-4e79-9ed7-0f79fff4bd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:11.441633 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:11.480555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:11.547466 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 182/353] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:11.548655 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c924f5-110b-4e79-9ed7-0f79fff4bd96 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:11.598402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71679df-e3ec-4447-b44d-da21c1b4af6f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:11.652873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb29a0-d951-4715-81e9-529989d9efac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:11.653488 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb29a0-d951-4715-81e9-529989d9efac None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.653762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb29a0-d951-4715-81e9-529989d9efac None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.654140 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb29a0-d951-4715-81e9-529989d9efac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.680850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c924f5-110b-4e79-9ed7-0f79fff4bd96 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:11.722678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a4c6-7a78-4142-b50e-40897b333753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:11.723935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a4c6-7a78-4142-b50e-40897b333753 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.724839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a4c6-7a78-4142-b50e-40897b333753 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.725583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a4c6-7a78-4142-b50e-40897b333753 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.726966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a4c6-7a78-4142-b50e-40897b333753 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:11.728827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a4c6-7a78-4142-b50e-40897b333753 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:11.731022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb29a0-d951-4715-81e9-529989d9efac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:11.731249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 183/354] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:11 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:11.732575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb29a0-d951-4715-81e9-529989d9efac None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:11.732899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018e329-d51a-40ab-9ab4-e0dfea4cb885 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.733446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018e329-d51a-40ab-9ab4-e0dfea4cb885 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.733914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018e329-d51a-40ab-9ab4-e0dfea4cb885 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.736335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:11.737540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 184/355] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:11.738841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed62bd0-1e86-40d2-96e2-7618ebd633a0 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.739322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed62bd0-1e86-40d2-96e2-7618ebd633a0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.739789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed62bd0-1e86-40d2-96e2-7618ebd633a0 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.741224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 185/356] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:11.742118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed62bd0-1e86-40d2-96e2-7618ebd633a0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:11.783504 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:11.866333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 172/357] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:11.868124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f9356-d578-4944-98f9-919e3b2b9ad1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.868661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f9356-d578-4944-98f9-919e3b2b9ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.869131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f9356-d578-4944-98f9-919e3b2b9ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.892447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-8a4f9356-d578-4944-98f9-919e3b2b9ad1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:11.894318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-8a4f9356-d578-4944-98f9-919e3b2b9ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:11.894751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed62bd0-1e86-40d2-96e2-7618ebd633a0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:11.935542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7232c0-f6eb-4669-bc3b-227eebc38427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:11.937350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7232c0-f6eb-4669-bc3b-227eebc38427 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.937857 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7232c0-f6eb-4669-bc3b-227eebc38427 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.938302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7232c0-f6eb-4669-bc3b-227eebc38427 None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.939614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7232c0-f6eb-4669-bc3b-227eebc38427 None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:11.941233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7232c0-f6eb-4669-bc3b-227eebc38427 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:11.942837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 186/358] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:11 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:11.944096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4e13-1f6c-4d7a-a4e6-321b8ef02591 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:11.944379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4e13-1f6c-4d7a-a4e6-321b8ef02591 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:11.944648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4e13-1f6c-4d7a-a4e6-321b8ef02591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:11.964683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-92cc4e13-1f6c-4d7a-a4e6-321b8ef02591 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:11.966075 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-92cc4e13-1f6c-4d7a-a4e6-321b8ef02591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:11.978038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 173/359] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:11.979185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f9356-d578-4944-98f9-919e3b2b9ad1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:12.026519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:12.047612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 187/360] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:12.048775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc4e13-1f6c-4d7a-a4e6-321b8ef02591 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:12.108051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f9356-d578-4944-98f9-919e3b2b9ad1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:12.127711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:12.148449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeba322-81b4-4903-bd54-15734412e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:12.149389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeba322-81b4-4903-bd54-15734412e106 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:12.149795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeba322-81b4-4903-bd54-15734412e106 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:12.150190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeba322-81b4-4903-bd54-15734412e106 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:12.151592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeba322-81b4-4903-bd54-15734412e106 None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:12.153258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeba322-81b4-4903-bd54-15734412e106 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:12.155191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 174/361] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:11 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:12.156210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeba322-81b4-4903-bd54-15734412e106 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:12.266087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeba322-81b4-4903-bd54-15734412e106 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:12.268341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:12.294569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc4e13-1f6c-4d7a-a4e6-321b8ef02591 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:12.304912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069d532-47dc-4d43-ae74-bb55bb6e9d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:12.305807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069d532-47dc-4d43-ae74-bb55bb6e9d2a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:12.306283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069d532-47dc-4d43-ae74-bb55bb6e9d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:12.306843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069d532-47dc-4d43-ae74-bb55bb6e9d2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:12.307943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069d532-47dc-4d43-ae74-bb55bb6e9d2a None admin] RBAC: Adding query filter params (group.id=8b1729e1a6b04785a1cc06472b91c9ad, role.id=779e95b5df394f2a95fbdfa2a9fb58eb, scope.project.id=680231dab5b3448499d71c6cba44d7c6) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:12.308455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069d532-47dc-4d43-ae74-bb55bb6e9d2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:12.310234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069d532-47dc-4d43-ae74-bb55bb6e9d2a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:12.317942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 175/362] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Sep 8 15:59:12 2022] GET /identity/v3/role_assignments?group.id=8b1729e1a6b04785a1cc06472b91c9ad&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=779e95b5df394f2a95fbdfa2a9fb58eb => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:12.319188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069d532-47dc-4d43-ae74-bb55bb6e9d2a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:12.399614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce4732-61d2-421c-875e-8f1f9355c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:12.400168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4732-61d2-421c-875e-8f1f9355c631 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:12.400443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4732-61d2-421c-875e-8f1f9355c631 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:12.400714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4732-61d2-421c-875e-8f1f9355c631 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:12.432420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce4732-61d2-421c-875e-8f1f9355c631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8dce4732-61d2-421c-875e-8f1f9355c631 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:12.439646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:12.440667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 15:59:12.441454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:12.442429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 188/363] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:12.445549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069d532-47dc-4d43-ae74-bb55bb6e9d2a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:12.447106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce4732-61d2-421c-875e-8f1f9355c631 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:12.489526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e35089-0b2a-432c-8a42-43e3cb0b6b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:12.490523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35089-0b2a-432c-8a42-43e3cb0b6b4f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:12.490998 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35089-0b2a-432c-8a42-43e3cb0b6b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:12.491468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35089-0b2a-432c-8a42-43e3cb0b6b4f None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:12.493492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e35089-0b2a-432c-8a42-43e3cb0b6b4f None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:12.495156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e35089-0b2a-432c-8a42-43e3cb0b6b4f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:12.497313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 176/364] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:12 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:12.498347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e35089-0b2a-432c-8a42-43e3cb0b6b4f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:12.545112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:12.565176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:12.589526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce4732-61d2-421c-875e-8f1f9355c631 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:12.637042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1087-c1e3-4ead-8f92-9b36f1c0c464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:12.637685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1087-c1e3-4ead-8f92-9b36f1c0c464 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:12.637958 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1087-c1e3-4ead-8f92-9b36f1c0c464 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:12.638228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1087-c1e3-4ead-8f92-9b36f1c0c464 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:12.638589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e35089-0b2a-432c-8a42-43e3cb0b6b4f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:12.656743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d1087-c1e3-4ead-8f92-9b36f1c0c464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-632d1087-c1e3-4ead-8f92-9b36f1c0c464 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:12.662949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:12.663840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:12.664657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 189/365] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:59:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:12.665317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1087-c1e3-4ead-8f92-9b36f1c0c464 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:12.686891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643711a2-99fe-42bf-9efd-3d4eadc6063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:12.688306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643711a2-99fe-42bf-9efd-3d4eadc6063a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:12.689119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643711a2-99fe-42bf-9efd-3d4eadc6063a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:12.689589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643711a2-99fe-42bf-9efd-3d4eadc6063a None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:12.690772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643711a2-99fe-42bf-9efd-3d4eadc6063a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:12.691547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643711a2-99fe-42bf-9efd-3d4eadc6063a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:12.693198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643711a2-99fe-42bf-9efd-3d4eadc6063a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:12.704454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 177/366] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:12.705872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643711a2-99fe-42bf-9efd-3d4eadc6063a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:12.805291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1087-c1e3-4ead-8f92-9b36f1c0c464 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:12.814529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:12.821103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643711a2-99fe-42bf-9efd-3d4eadc6063a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:12.846111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73ed9d-fc16-4f3f-a25a-0a5f81fc0718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:12.847147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ed9d-fc16-4f3f-a25a-0a5f81fc0718 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:12.847685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ed9d-fc16-4f3f-a25a-0a5f81fc0718 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:12.848207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ed9d-fc16-4f3f-a25a-0a5f81fc0718 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:12.862157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73ed9d-fc16-4f3f-a25a-0a5f81fc0718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0d73ed9d-fc16-4f3f-a25a-0a5f81fc0718 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:12.869144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:12.870043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:12.870875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:12.872732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 190/367] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:59:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:12.873546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73ed9d-fc16-4f3f-a25a-0a5f81fc0718 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:12.875388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf095e8-abbd-423f-bc82-2609283b5571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:12.876015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf095e8-abbd-423f-bc82-2609283b5571 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:12.876292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf095e8-abbd-423f-bc82-2609283b5571 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:12.876566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf095e8-abbd-423f-bc82-2609283b5571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:12.877299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf095e8-abbd-423f-bc82-2609283b5571 None admin] RBAC: Adding query filter params (group.id=8b1729e1a6b04785a1cc06472b91c9ad, role.id=6ba784d4bd374e1793729d1ff430e45f, scope.project.id=323eda8873b34125b0dc80cad45fb567) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:12.877743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf095e8-abbd-423f-bc82-2609283b5571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:12.878541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:12.879086 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf095e8-abbd-423f-bc82-2609283b5571 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:12.884960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 178/368] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Sep 8 15:59:12 2022] GET /identity/v3/role_assignments?group.id=8b1729e1a6b04785a1cc06472b91c9ad&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:12.885746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf095e8-abbd-423f-bc82-2609283b5571 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:13.016890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73ed9d-fc16-4f3f-a25a-0a5f81fc0718 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:13.021692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf095e8-abbd-423f-bc82-2609283b5571 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:13.067291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c09d9-9cd5-4640-8cbe-cf093cff5b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:13.068471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c09d9-9cd5-4640-8cbe-cf093cff5b26 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:13.068955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c09d9-9cd5-4640-8cbe-cf093cff5b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:13.069400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c09d9-9cd5-4640-8cbe-cf093cff5b26 None admin] PATH_INFO: `/v3/users/9c9ba1e2990a4035b8bc2021725bfa4f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:13.070236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b03b54-83f6-47ed-a3ea-a3b9616b7eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:13.070974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b03b54-83f6-47ed-a3ea-a3b9616b7eed None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:13.071296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c09d9-9cd5-4640-8cbe-cf093cff5b26 None admin] RBAC: Authorizing `identity:get_user(user_id=9c9ba1e2990a4035b8bc2021725bfa4f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:13.071399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b03b54-83f6-47ed-a3ea-a3b9616b7eed None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:13.071640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b03b54-83f6-47ed-a3ea-a3b9616b7eed None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:13.072375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b03b54-83f6-47ed-a3ea-a3b9616b7eed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:13.072761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b03b54-83f6-47ed-a3ea-a3b9616b7eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:13.073618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c09d9-9cd5-4640-8cbe-cf093cff5b26 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:13.074296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b03b54-83f6-47ed-a3ea-a3b9616b7eed None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:13.075754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 179/369] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 15:59:12 2022] GET /identity/v3/users/9c9ba1e2990a4035b8bc2021725bfa4f => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:13.077176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c09d9-9cd5-4640-8cbe-cf093cff5b26 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:13.089073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 191/370] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:13.089937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b03b54-83f6-47ed-a3ea-a3b9616b7eed None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:13.114754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:13.172735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:13.214744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c09d9-9cd5-4640-8cbe-cf093cff5b26 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:13.227548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b03b54-83f6-47ed-a3ea-a3b9616b7eed None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:13.262562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045275e-f308-4bd8-b561-76aeb5acc35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:13.263883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045275e-f308-4bd8-b561-76aeb5acc35f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:13.264570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045275e-f308-4bd8-b561-76aeb5acc35f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:13.264990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045275e-f308-4bd8-b561-76aeb5acc35f None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:13.266459 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045275e-f308-4bd8-b561-76aeb5acc35f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:13.266988 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045275e-f308-4bd8-b561-76aeb5acc35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:13.268865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045275e-f308-4bd8-b561-76aeb5acc35f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:13.273152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cb5ab-f5f5-47a0-8d12-0b346e615136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:13.273760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cb5ab-f5f5-47a0-8d12-0b346e615136 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:13.274032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cb5ab-f5f5-47a0-8d12-0b346e615136 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:13.274301 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cb5ab-f5f5-47a0-8d12-0b346e615136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:13.275048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cb5ab-f5f5-47a0-8d12-0b346e615136 None admin] RBAC: Adding query filter params (role.id=a970a114620e467295e3dd153a9f4321, user.id=9c9ba1e2990a4035b8bc2021725bfa4f, scope.system=all) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:13.275355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cb5ab-f5f5-47a0-8d12-0b346e615136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:13.276776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cb5ab-f5f5-47a0-8d12-0b346e615136 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:13.280841 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 180/371] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:13.282378 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045275e-f308-4bd8-b561-76aeb5acc35f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:13.292313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 192/372] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Sep 8 15:59:13 2022] GET /identity/v3/role_assignments?user.id=9c9ba1e2990a4035b8bc2021725bfa4f&scope.system=all&role.id=a970a114620e467295e3dd153a9f4321 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:13.293143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cb5ab-f5f5-47a0-8d12-0b346e615136 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:13.415605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:13.427762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045275e-f308-4bd8-b561-76aeb5acc35f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:13.471002 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767eb2b-17b2-4299-9d66-2c76132de9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:13.471781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767eb2b-17b2-4299-9d66-2c76132de9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:13.472058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767eb2b-17b2-4299-9d66-2c76132de9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:13.472329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767eb2b-17b2-4299-9d66-2c76132de9b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:13.492914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cb5ab-f5f5-47a0-8d12-0b346e615136 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:13.558848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:13.565035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767eb2b-17b2-4299-9d66-2c76132de9b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:13.567222 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767eb2b-17b2-4299-9d66-2c76132de9b4 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:13.595422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6152035-6a15-459d-a5d7-11ab145d083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:13.596603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152035-6a15-459d-a5d7-11ab145d083f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:13.597079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152035-6a15-459d-a5d7-11ab145d083f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:13.597541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6152035-6a15-459d-a5d7-11ab145d083f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:13.678692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:13.694962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 181/373] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:13.701164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767eb2b-17b2-4299-9d66-2c76132de9b4 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:13.723418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6152035-6a15-459d-a5d7-11ab145d083f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:13.725208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6152035-6a15-459d-a5d7-11ab145d083f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:13.820279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767eb2b-17b2-4299-9d66-2c76132de9b4 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:13.860179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d46363-864e-4655-8925-419525046c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:13.860830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46363-864e-4655-8925-419525046c07 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:13.861107 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46363-864e-4655-8925-419525046c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:13.861376 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46363-864e-4655-8925-419525046c07 None admin] PATH_INFO: `/v3/projects/2058312f3bcf45699a154a422ba5b605` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:13.863320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d46363-864e-4655-8925-419525046c07 None admin] RBAC: Authorizing `identity:get_project(project_id=2058312f3bcf45699a154a422ba5b605)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:13.865691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d46363-864e-4655-8925-419525046c07 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:13.867691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 182/374] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:13 2022] GET /identity/v3/projects/2058312f3bcf45699a154a422ba5b605 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:13.874326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d46363-864e-4655-8925-419525046c07 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:13.955052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:13.965348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 193/375] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:13.971371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6152035-6a15-459d-a5d7-11ab145d083f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:13.988493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d46363-864e-4655-8925-419525046c07 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:14.028422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a25297-57e4-4621-bd89-83e3ca02361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:14.029065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a25297-57e4-4621-bd89-83e3ca02361b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:14.029342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a25297-57e4-4621-bd89-83e3ca02361b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:14.030151 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a25297-57e4-4621-bd89-83e3ca02361b None admin] PATH_INFO: `/v3/groups/0715ab8140244a93b2b0c5e0f24a5aeb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:14.036418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a25297-57e4-4621-bd89-83e3ca02361b None admin] RBAC: Authorizing `identity:get_group(group_id=0715ab8140244a93b2b0c5e0f24a5aeb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:14.038024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a25297-57e4-4621-bd89-83e3ca02361b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:14.040407 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 183/376] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:13 2022] GET /identity/v3/groups/0715ab8140244a93b2b0c5e0f24a5aeb => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:14.046317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:14.047878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a25297-57e4-4621-bd89-83e3ca02361b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:14.163125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a25297-57e4-4621-bd89-83e3ca02361b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:14.203996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930bdaf-7f46-428c-955d-8467a3f24b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:14.204892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:14.207234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930bdaf-7f46-428c-955d-8467a3f24b64 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:14.207347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930bdaf-7f46-428c-955d-8467a3f24b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:14.208149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930bdaf-7f46-428c-955d-8467a3f24b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:14.208336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930bdaf-7f46-428c-955d-8467a3f24b64 None admin] RBAC: Adding query filter params (group.id=0715ab8140244a93b2b0c5e0f24a5aeb, role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=2058312f3bcf45699a154a422ba5b605) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:14.208651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930bdaf-7f46-428c-955d-8467a3f24b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:14.210854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930bdaf-7f46-428c-955d-8467a3f24b64 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:14.223252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 184/377] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Sep 8 15:59:14 2022] GET /identity/v3/role_assignments?group.id=0715ab8140244a93b2b0c5e0f24a5aeb&scope.project.id=2058312f3bcf45699a154a422ba5b605&role.id=519b356d36364663a59265dc7eeff0b8 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:14.301990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6152035-6a15-459d-a5d7-11ab145d083f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:14.387580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0105cc-5a02-404e-a02f-2aeeb9fcc86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:14.388637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0105cc-5a02-404e-a02f-2aeeb9fcc86b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:14.389717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0105cc-5a02-404e-a02f-2aeeb9fcc86b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:14.390179 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0105cc-5a02-404e-a02f-2aeeb9fcc86b None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:14.391679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0105cc-5a02-404e-a02f-2aeeb9fcc86b None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:14.393653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0105cc-5a02-404e-a02f-2aeeb9fcc86b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:14.395820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 194/378] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:13 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:14.401269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930bdaf-7f46-428c-955d-8467a3f24b64 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:14.536429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0591c-ef55-4976-8ef8-0648b988ea7c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:14.537408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0591c-ef55-4976-8ef8-0648b988ea7c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:14.537676 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0591c-ef55-4976-8ef8-0648b988ea7c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:14.539044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 195/379] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:59:14.552132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206dcbf4-c464-4503-b075-2f190ed8c0e3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:14.552415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206dcbf4-c464-4503-b075-2f190ed8c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:14.552677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206dcbf4-c464-4503-b075-2f190ed8c0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:14.574112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930bdaf-7f46-428c-955d-8467a3f24b64 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:14.584154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-206dcbf4-c464-4503-b075-2f190ed8c0e3 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:14.589186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-206dcbf4-c464-4503-b075-2f190ed8c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:14.615043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8facef-5583-43d5-97c2-93fe0d6ab86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:14.616591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8facef-5583-43d5-97c2-93fe0d6ab86b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:14.617025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8facef-5583-43d5-97c2-93fe0d6ab86b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:14.617443 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8facef-5583-43d5-97c2-93fe0d6ab86b None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:14.619125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8facef-5583-43d5-97c2-93fe0d6ab86b None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:14.620923 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8facef-5583-43d5-97c2-93fe0d6ab86b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:14.625504 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 185/380] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:14 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:14.631633 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8facef-5583-43d5-97c2-93fe0d6ab86b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:14.768598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:14.832340 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 196/381] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:14.874122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8facef-5583-43d5-97c2-93fe0d6ab86b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:14.927422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbbae1-7606-403e-b3c0-16de3a66fd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:14.928055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbbae1-7606-403e-b3c0-16de3a66fd72 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:14.928338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbbae1-7606-403e-b3c0-16de3a66fd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:14.928610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbbae1-7606-403e-b3c0-16de3a66fd72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:14.929349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbbae1-7606-403e-b3c0-16de3a66fd72 None admin] RBAC: Adding query filter params (group.id=8b1729e1a6b04785a1cc06472b91c9ad, role.id=779e95b5df394f2a95fbdfa2a9fb58eb, scope.project.id=323eda8873b34125b0dc80cad45fb567) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:14.929660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbbae1-7606-403e-b3c0-16de3a66fd72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:14.931136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbbae1-7606-403e-b3c0-16de3a66fd72 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:14.952481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 186/382] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Sep 8 15:59:14 2022] GET /identity/v3/role_assignments?group.id=8b1729e1a6b04785a1cc06472b91c9ad&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=779e95b5df394f2a95fbdfa2a9fb58eb => generated 260 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:15.232208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206dcbf4-c464-4503-b075-2f190ed8c0e3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:15.258001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:15.318835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecbe93-9156-4c30-a560-de6765a56973 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:15.319371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecbe93-9156-4c30-a560-de6765a56973 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:15.319371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecbe93-9156-4c30-a560-de6765a56973 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:15.320933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 187/383] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:15.327081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d316-f733-4ba1-9e17-963e98480b40 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:15.327357 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d316-f733-4ba1-9e17-963e98480b40 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:15.327929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d316-f733-4ba1-9e17-963e98480b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:15.346955 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206dcbf4-c464-4503-b075-2f190ed8c0e3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:15.358329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0036d316-f733-4ba1-9e17-963e98480b40 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:15.359436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0036d316-f733-4ba1-9e17-963e98480b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:15.382790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ce38-2ea5-4ce2-a4f0-0f39b2ce3562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:15.383796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ce38-2ea5-4ce2-a4f0-0f39b2ce3562 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:15.384261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ce38-2ea5-4ce2-a4f0-0f39b2ce3562 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:15.384720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ce38-2ea5-4ce2-a4f0-0f39b2ce3562 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:15.403716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9ce38-2ea5-4ce2-a4f0-0f39b2ce3562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b9f9ce38-2ea5-4ce2-a4f0-0f39b2ce3562 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:15.410459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:15.411370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:15.412171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:15.416110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 197/384] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:15.422833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ce38-2ea5-4ce2-a4f0-0f39b2ce3562 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:15.505024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 188/385] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:59:15.547128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:15.567177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ce38-2ea5-4ce2-a4f0-0f39b2ce3562 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:15.602489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060d20c-0f52-4c13-8e32-f2ab8dbc98e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:15.603123 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060d20c-0f52-4c13-8e32-f2ab8dbc98e2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:15.603394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060d20c-0f52-4c13-8e32-f2ab8dbc98e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:15.603661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060d20c-0f52-4c13-8e32-f2ab8dbc98e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:15.604315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060d20c-0f52-4c13-8e32-f2ab8dbc98e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:15.604608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060d20c-0f52-4c13-8e32-f2ab8dbc98e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:15.605965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060d20c-0f52-4c13-8e32-f2ab8dbc98e2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:15.614373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 198/386] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:15.619557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036d316-f733-4ba1-9e17-963e98480b40 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:15.677396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:15.735581 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036d316-f733-4ba1-9e17-963e98480b40 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:15.780166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebde7ae-89a3-4d83-99a2-fea68aee4b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:15.780741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde7ae-89a3-4d83-99a2-fea68aee4b7d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:15.781017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde7ae-89a3-4d83-99a2-fea68aee4b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:15.781288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde7ae-89a3-4d83-99a2-fea68aee4b7d None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:15.787456 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebde7ae-89a3-4d83-99a2-fea68aee4b7d None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:15.788935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebde7ae-89a3-4d83-99a2-fea68aee4b7d None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:15.790695 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 189/387] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:15 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:15.796681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060d20c-0f52-4c13-8e32-f2ab8dbc98e2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:15.884048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01961ece-959d-49fc-8ad6-0e72b8ef7ad7 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:15.884369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01961ece-959d-49fc-8ad6-0e72b8ef7ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:15.884574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01961ece-959d-49fc-8ad6-0e72b8ef7ad7 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:15.886228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 190/388] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:59:15.897876 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3727064-1ce8-45b0-9cc2-d7bd86eeb3ee None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:15.898419 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3727064-1ce8-45b0-9cc2-d7bd86eeb3ee None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:15.898912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3727064-1ce8-45b0-9cc2-d7bd86eeb3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:15.915306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060d20c-0f52-4c13-8e32-f2ab8dbc98e2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:15.925020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a3727064-1ce8-45b0-9cc2-d7bd86eeb3ee None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:15.926227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a3727064-1ce8-45b0-9cc2-d7bd86eeb3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:15.957045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57d451-ae38-4bf7-b52c-e4379f1107d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:15.957920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57d451-ae38-4bf7-b52c-e4379f1107d4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:15.958352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57d451-ae38-4bf7-b52c-e4379f1107d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:15.958801 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57d451-ae38-4bf7-b52c-e4379f1107d4 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:15.960289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57d451-ae38-4bf7-b52c-e4379f1107d4 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:15.961848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57d451-ae38-4bf7-b52c-e4379f1107d4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:15.964071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 199/389] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:15 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:15.964986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57d451-ae38-4bf7-b52c-e4379f1107d4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:15.991630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:16.025805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 191/390] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:59:16.027648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3727064-1ce8-45b0-9cc2-d7bd86eeb3ee None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:16.096475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:16.109475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57d451-ae38-4bf7-b52c-e4379f1107d4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:16.162939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3727064-1ce8-45b0-9cc2-d7bd86eeb3ee None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:16.200551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d394-9ecd-461b-b49c-318f3ea5d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:16.202039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d394-9ecd-461b-b49c-318f3ea5d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:16.202420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d394-9ecd-461b-b49c-318f3ea5d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:16.202822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d394-9ecd-461b-b49c-318f3ea5d2c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:16.208278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f65da8-ccda-4326-a959-2bd6e08f0db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:16.209154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f65da8-ccda-4326-a959-2bd6e08f0db0 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:16.209577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f65da8-ccda-4326-a959-2bd6e08f0db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:16.209997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f65da8-ccda-4326-a959-2bd6e08f0db0 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6/groups/8b1729e1a6b04785a1cc06472b91c9ad/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:16.212197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f65da8-ccda-4326-a959-2bd6e08f0db0 None admin] RBAC: Authorizing `identity:create_grant(project_id=680231dab5b3448499d71c6cba44d7c6, group_id=8b1729e1a6b04785a1cc06472b91c9ad, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:16.213926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f65da8-ccda-4326-a959-2bd6e08f0db0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:16.221455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987d394-9ecd-461b-b49c-318f3ea5d2c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8987d394-9ecd-461b-b49c-318f3ea5d2c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:16.227228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:16.237029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 200/391] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:59:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:16.237915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d394-9ecd-461b-b49c-318f3ea5d2c8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:16.307600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 192/392] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Sep 8 15:59:16 2022] PUT /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6/groups/8b1729e1a6b04785a1cc06472b91c9ad/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:59:16.328739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:16.366594 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d394-9ecd-461b-b49c-318f3ea5d2c8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:16.404901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb384e58-80b3-43fe-acdf-7170ed2b63c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:16.405519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb384e58-80b3-43fe-acdf-7170ed2b63c4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:16.405844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb384e58-80b3-43fe-acdf-7170ed2b63c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:16.406121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb384e58-80b3-43fe-acdf-7170ed2b63c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:16.406809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb384e58-80b3-43fe-acdf-7170ed2b63c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:16.407113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb384e58-80b3-43fe-acdf-7170ed2b63c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:16.413933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb384e58-80b3-43fe-acdf-7170ed2b63c4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:16.430220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 201/393] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:16.436426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f65da8-ccda-4326-a959-2bd6e08f0db0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:16.479642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb384e58-80b3-43fe-acdf-7170ed2b63c4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:16.578879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f65da8-ccda-4326-a959-2bd6e08f0db0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:16.587277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:16.619929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8db4b-8c12-4fcb-8aed-4c6ea609dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:16.620502 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8db4b-8c12-4fcb-8aed-4c6ea609dc46 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:16.620776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8db4b-8c12-4fcb-8aed-4c6ea609dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:16.621042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8db4b-8c12-4fcb-8aed-4c6ea609dc46 None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:16.622230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8db4b-8c12-4fcb-8aed-4c6ea609dc46 None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:16.623554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb384e58-80b3-43fe-acdf-7170ed2b63c4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:16.623984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8db4b-8c12-4fcb-8aed-4c6ea609dc46 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:16.625897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 193/394] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:16 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:16.631129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8db4b-8c12-4fcb-8aed-4c6ea609dc46 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:16.678449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5798-adf8-4dec-9261-d6016c2eff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:16.679131 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5798-adf8-4dec-9261-d6016c2eff06 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:16.680441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5798-adf8-4dec-9261-d6016c2eff06 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:16.680721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5798-adf8-4dec-9261-d6016c2eff06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:16.691038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:16.703453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f5798-adf8-4dec-9261-d6016c2eff06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8a4f5798-adf8-4dec-9261-d6016c2eff06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:16.708482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:16.709533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:16.710604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 202/395] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:16.715486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5798-adf8-4dec-9261-d6016c2eff06 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:16.815554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8db4b-8c12-4fcb-8aed-4c6ea609dc46 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:16.852154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5798-adf8-4dec-9261-d6016c2eff06 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:16.854443 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78276068-3b9c-48c5-85d3-dc515195d3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:16.855358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78276068-3b9c-48c5-85d3-dc515195d3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:16.855846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78276068-3b9c-48c5-85d3-dc515195d3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:16.856322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78276068-3b9c-48c5-85d3-dc515195d3f0 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:16.857736 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78276068-3b9c-48c5-85d3-dc515195d3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:16.859442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78276068-3b9c-48c5-85d3-dc515195d3f0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:16.861297 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 194/396] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:16 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:16.866977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78276068-3b9c-48c5-85d3-dc515195d3f0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:16.904058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99d790-7be7-4a5f-89dc-d2161e8e448b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:16.905275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99d790-7be7-4a5f-89dc-d2161e8e448b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:16.905549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99d790-7be7-4a5f-89dc-d2161e8e448b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:16.905817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99d790-7be7-4a5f-89dc-d2161e8e448b None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:16.906578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99d790-7be7-4a5f-89dc-d2161e8e448b None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:16.906925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99d790-7be7-4a5f-89dc-d2161e8e448b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:16.908406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99d790-7be7-4a5f-89dc-d2161e8e448b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:16.920114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:16.929122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 203/397] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:16.934653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99d790-7be7-4a5f-89dc-d2161e8e448b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:16.986256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78276068-3b9c-48c5-85d3-dc515195d3f0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:17.031479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536ea3b-06cc-4ed7-ba1f-435617d0adf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:17.032611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536ea3b-06cc-4ed7-ba1f-435617d0adf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:17.033096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536ea3b-06cc-4ed7-ba1f-435617d0adf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:17.034147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536ea3b-06cc-4ed7-ba1f-435617d0adf5 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6/groups/8b1729e1a6b04785a1cc06472b91c9ad/roles/779e95b5df394f2a95fbdfa2a9fb58eb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:17.036801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536ea3b-06cc-4ed7-ba1f-435617d0adf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=680231dab5b3448499d71c6cba44d7c6, group_id=8b1729e1a6b04785a1cc06472b91c9ad, role_id=779e95b5df394f2a95fbdfa2a9fb58eb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:17.038786 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536ea3b-06cc-4ed7-ba1f-435617d0adf5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:17.042910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:17.094388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99d790-7be7-4a5f-89dc-d2161e8e448b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:17.133559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23079cdf-1c1c-4ecc-acd2-d5cd5e2026f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:17.134628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079cdf-1c1c-4ecc-acd2-d5cd5e2026f4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:17.135195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079cdf-1c1c-4ecc-acd2-d5cd5e2026f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:17.135672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079cdf-1c1c-4ecc-acd2-d5cd5e2026f4 None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:17.137112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23079cdf-1c1c-4ecc-acd2-d5cd5e2026f4 None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:17.139419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23079cdf-1c1c-4ecc-acd2-d5cd5e2026f4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:17.147662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 195/398] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Sep 8 15:59:16 2022] PUT /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6/groups/8b1729e1a6b04785a1cc06472b91c9ad/roles/779e95b5df394f2a95fbdfa2a9fb58eb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:59:17.149892 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 204/399] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:16 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:17.156888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536ea3b-06cc-4ed7-ba1f-435617d0adf5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:17.238039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66633deb-2231-4961-8a24-6a583868718e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:17.238734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66633deb-2231-4961-8a24-6a583868718e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:17.239113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66633deb-2231-4961-8a24-6a583868718e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:17.241997 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 205/400] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:17.250702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f7a74-7acf-41a6-851b-665725b5f912 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:17.250702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f7a74-7acf-41a6-851b-665725b5f912 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:17.250702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f7a74-7acf-41a6-851b-665725b5f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:17.270690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f38f7a74-7acf-41a6-851b-665725b5f912 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:17.273124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f38f7a74-7acf-41a6-851b-665725b5f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:17.339264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536ea3b-06cc-4ed7-ba1f-435617d0adf5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:17.342995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:17.357433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 206/401] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:59:17.401066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff47f2-200a-41cc-bd29-a3c2b0dfa45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:17.401967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff47f2-200a-41cc-bd29-a3c2b0dfa45c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:17.402391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff47f2-200a-41cc-bd29-a3c2b0dfa45c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:17.402825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff47f2-200a-41cc-bd29-a3c2b0dfa45c None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:17.404158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff47f2-200a-41cc-bd29-a3c2b0dfa45c None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:17.406261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff47f2-200a-41cc-bd29-a3c2b0dfa45c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:17.408653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 196/402] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:17 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:17.415383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f7a74-7acf-41a6-851b-665725b5f912 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:17.479595 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:17.525221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f7a74-7acf-41a6-851b-665725b5f912 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:17.561663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a48e-dda1-4330-b15f-07e6aa72ebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:17.562423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a48e-dda1-4330-b15f-07e6aa72ebc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:17.562802 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a48e-dda1-4330-b15f-07e6aa72ebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:17.563144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9a48e-dda1-4330-b15f-07e6aa72ebc8 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567/groups/8b1729e1a6b04785a1cc06472b91c9ad/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:17.565201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9a48e-dda1-4330-b15f-07e6aa72ebc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=323eda8873b34125b0dc80cad45fb567, group_id=8b1729e1a6b04785a1cc06472b91c9ad, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:17.566739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9a48e-dda1-4330-b15f-07e6aa72ebc8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:17.684360 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff47f2-200a-41cc-bd29-a3c2b0dfa45c None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:17.704524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 207/403] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Sep 8 15:59:17 2022] PUT /identity/v3/projects/323eda8873b34125b0dc80cad45fb567/groups/8b1729e1a6b04785a1cc06472b91c9ad/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:59:17.825500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff47f2-200a-41cc-bd29-a3c2b0dfa45c None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:17.870205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61844f00-e6bc-4b96-8d52-a250f27f3f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:17.870886 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844f00-e6bc-4b96-8d52-a250f27f3f95 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:17.871166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844f00-e6bc-4b96-8d52-a250f27f3f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:17.871440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61844f00-e6bc-4b96-8d52-a250f27f3f95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:17.888170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61844f00-e6bc-4b96-8d52-a250f27f3f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-61844f00-e6bc-4b96-8d52-a250f27f3f95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:17.894363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:17.895320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:17.896110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 197/404] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:17.901938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a48e-dda1-4330-b15f-07e6aa72ebc8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:18.036150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9a48e-dda1-4330-b15f-07e6aa72ebc8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:18.059063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:18.082506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f669b57-7e7a-4aad-91b4-19d438c47963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:18.083525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f669b57-7e7a-4aad-91b4-19d438c47963 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:18.083990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f669b57-7e7a-4aad-91b4-19d438c47963 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:18.084447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f669b57-7e7a-4aad-91b4-19d438c47963 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:18.085333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f669b57-7e7a-4aad-91b4-19d438c47963 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:18.085843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f669b57-7e7a-4aad-91b4-19d438c47963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:18.087535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f669b57-7e7a-4aad-91b4-19d438c47963 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:18.100960 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 208/405] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:18.106628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61844f00-e6bc-4b96-8d52-a250f27f3f95 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:18.150128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:18.238349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61844f00-e6bc-4b96-8d52-a250f27f3f95 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:18.258156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c300d2c-0f67-4aed-81de-134222dd8a2d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:18.258767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c300d2c-0f67-4aed-81de-134222dd8a2d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:18.259256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c300d2c-0f67-4aed-81de-134222dd8a2d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:18.261073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 209/406] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:18.268284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8740-d742-460a-b559-ed7f0cb6cb49 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:18.268844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8740-d742-460a-b559-ed7f0cb6cb49 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:18.269308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8740-d742-460a-b559-ed7f0cb6cb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:18.297844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1ccb8-7158-4149-bb04-74d31db91e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:18.301416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ccb8-7158-4149-bb04-74d31db91e50 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:18.301700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ccb8-7158-4149-bb04-74d31db91e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:18.301978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ccb8-7158-4149-bb04-74d31db91e50 None admin] PATH_INFO: `/v3/groups/0715ab8140244a93b2b0c5e0f24a5aeb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:18.303153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1ccb8-7158-4149-bb04-74d31db91e50 None admin] RBAC: Authorizing `identity:get_group(group_id=0715ab8140244a93b2b0c5e0f24a5aeb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:18.304615 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1ccb8-7158-4149-bb04-74d31db91e50 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:18.306313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-319d8740-d742-460a-b559-ed7f0cb6cb49 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:18.307553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-319d8740-d742-460a-b559-ed7f0cb6cb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:18.307912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 198/407] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:18 2022] GET /identity/v3/groups/0715ab8140244a93b2b0c5e0f24a5aeb => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:18.313858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1ccb8-7158-4149-bb04-74d31db91e50 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:18.458772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 210/408] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:59:18.497356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1ccb8-7158-4149-bb04-74d31db91e50 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:18.499381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:18.549280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efc133-2470-4a32-9d56-f447f0803a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:18.549832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efc133-2470-4a32-9d56-f447f0803a85 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:18.550130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efc133-2470-4a32-9d56-f447f0803a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:18.550376 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efc133-2470-4a32-9d56-f447f0803a85 None admin] PATH_INFO: `/v3/projects/2058312f3bcf45699a154a422ba5b605` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:18.551760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efc133-2470-4a32-9d56-f447f0803a85 None admin] RBAC: Authorizing `identity:get_project(project_id=2058312f3bcf45699a154a422ba5b605)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:18.553736 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efc133-2470-4a32-9d56-f447f0803a85 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:18.556651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 199/409] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:18 2022] GET /identity/v3/projects/2058312f3bcf45699a154a422ba5b605 => generated 344 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:18.562986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d8740-d742-460a-b559-ed7f0cb6cb49 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:18.706369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d8740-d742-460a-b559-ed7f0cb6cb49 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:18.716737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:18.772290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04916e5a-f260-4dc5-922b-fc07959d503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:18.772961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916e5a-f260-4dc5-922b-fc07959d503a None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:18.773234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916e5a-f260-4dc5-922b-fc07959d503a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:18.773501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916e5a-f260-4dc5-922b-fc07959d503a None admin] PATH_INFO: `/v3/projects/2058312f3bcf45699a154a422ba5b605/groups/0715ab8140244a93b2b0c5e0f24a5aeb/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:18.775428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04916e5a-f260-4dc5-922b-fc07959d503a None admin] RBAC: Authorizing `identity:create_grant(project_id=2058312f3bcf45699a154a422ba5b605, group_id=0715ab8140244a93b2b0c5e0f24a5aeb, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:18.776856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04916e5a-f260-4dc5-922b-fc07959d503a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:18.855037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 211/410] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Sep 8 15:59:18 2022] PUT /identity/v3/projects/2058312f3bcf45699a154a422ba5b605/groups/0715ab8140244a93b2b0c5e0f24a5aeb/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:59:18.885933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efc133-2470-4a32-9d56-f447f0803a85 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:19.049164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efc133-2470-4a32-9d56-f447f0803a85 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:19.086444 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0b490-eed4-48fa-aace-d5d119cbc858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:19.087133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0b490-eed4-48fa-aace-d5d119cbc858 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:19.087407 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0b490-eed4-48fa-aace-d5d119cbc858 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:19.087676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0b490-eed4-48fa-aace-d5d119cbc858 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:19.100854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0b490-eed4-48fa-aace-d5d119cbc858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-33f0b490-eed4-48fa-aace-d5d119cbc858 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:19.106847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:19.108335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:19.109152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 200/411] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:59:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:19.114653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04916e5a-f260-4dc5-922b-fc07959d503a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:19.238096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04916e5a-f260-4dc5-922b-fc07959d503a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:19.242697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853cc5-5d0c-4666-93e4-036202f49532 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:19.242697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853cc5-5d0c-4666-93e4-036202f49532 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:19.242697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e853cc5-5d0c-4666-93e4-036202f49532 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:19.244198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 201/412] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:19.251100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430081-7adf-4ec0-8036-64f7f8a9559d None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:19.251671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430081-7adf-4ec0-8036-64f7f8a9559d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:19.252150 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430081-7adf-4ec0-8036-64f7f8a9559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:19.274255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-41430081-7adf-4ec0-8036-64f7f8a9559d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:19.275854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-41430081-7adf-4ec0-8036-64f7f8a9559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:19.302426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d74729-f440-44f7-8089-43625e46f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:19.306361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d74729-f440-44f7-8089-43625e46f791 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:19.306877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d74729-f440-44f7-8089-43625e46f791 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:19.307450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d74729-f440-44f7-8089-43625e46f791 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:19.308330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d74729-f440-44f7-8089-43625e46f791 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:19.308840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d74729-f440-44f7-8089-43625e46f791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:19.309369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:19.312984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d74729-f440-44f7-8089-43625e46f791 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:19.330145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 212/413] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:19.336170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d74729-f440-44f7-8089-43625e46f791 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:19.390024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:19.413803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 202/414] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:19.484978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d74729-f440-44f7-8089-43625e46f791 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:19.534155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332ed0a-886f-47a8-be54-6c0e37310e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:19.535191 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332ed0a-886f-47a8-be54-6c0e37310e26 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:19.535666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332ed0a-886f-47a8-be54-6c0e37310e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:19.536148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332ed0a-886f-47a8-be54-6c0e37310e26 None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:19.541902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332ed0a-886f-47a8-be54-6c0e37310e26 None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:19.543668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332ed0a-886f-47a8-be54-6c0e37310e26 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:19.546397 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 213/415] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:19 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:19.552271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41430081-7adf-4ec0-8036-64f7f8a9559d None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:19.687685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41430081-7adf-4ec0-8036-64f7f8a9559d None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:19.723523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386d6d4-3b6e-4fee-988d-437c17852824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:19.724164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386d6d4-3b6e-4fee-988d-437c17852824 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:19.724441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386d6d4-3b6e-4fee-988d-437c17852824 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:19.724717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386d6d4-3b6e-4fee-988d-437c17852824 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:19.725846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386d6d4-3b6e-4fee-988d-437c17852824 None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:19.727338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386d6d4-3b6e-4fee-988d-437c17852824 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:19.729375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 203/416] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:19 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:19.732840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a16e0-c0e6-4cb5-9a69-f386e682c331 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:19.733285 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a16e0-c0e6-4cb5-9a69-f386e682c331 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:19.733448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a16e0-c0e6-4cb5-9a69-f386e682c331 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:19.734958 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 214/417] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 15:59:19.736254 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386d6d4-3b6e-4fee-988d-437c17852824 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:19.740275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08302c6-588d-4d79-b972-61289dcc7e2c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:19.740554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08302c6-588d-4d79-b972-61289dcc7e2c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:19.740825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08302c6-588d-4d79-b972-61289dcc7e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:19.777310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b08302c6-588d-4d79-b972-61289dcc7e2c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:19.778524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b08302c6-588d-4d79-b972-61289dcc7e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:19.784263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:19.883049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386d6d4-3b6e-4fee-988d-437c17852824 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:19.887532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 215/418] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:19.889081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08302c6-588d-4d79-b972-61289dcc7e2c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:19.935017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:19.947270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0b51a-d5bc-4f2e-91e7-8b6757491b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:19.947869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0b51a-d5bc-4f2e-91e7-8b6757491b57 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:19.948137 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0b51a-d5bc-4f2e-91e7-8b6757491b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:19.948408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0b51a-d5bc-4f2e-91e7-8b6757491b57 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567/groups/8b1729e1a6b04785a1cc06472b91c9ad/roles/779e95b5df394f2a95fbdfa2a9fb58eb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:19.955466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0b51a-d5bc-4f2e-91e7-8b6757491b57 None admin] RBAC: Authorizing `identity:create_grant(project_id=323eda8873b34125b0dc80cad45fb567, group_id=8b1729e1a6b04785a1cc06472b91c9ad, role_id=779e95b5df394f2a95fbdfa2a9fb58eb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:19.956921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0b51a-d5bc-4f2e-91e7-8b6757491b57 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:20.024031 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08302c6-588d-4d79-b972-61289dcc7e2c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:20.032438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 204/419] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Sep 8 15:59:19 2022] PUT /identity/v3/projects/323eda8873b34125b0dc80cad45fb567/groups/8b1729e1a6b04785a1cc06472b91c9ad/roles/779e95b5df394f2a95fbdfa2a9fb58eb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 15:59:20.070047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8a98d-c108-4a2e-9ef9-15127ebb01fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:20.070750 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8a98d-c108-4a2e-9ef9-15127ebb01fd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:20.071035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8a98d-c108-4a2e-9ef9-15127ebb01fd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:20.071315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8a98d-c108-4a2e-9ef9-15127ebb01fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:20.084173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8a98d-c108-4a2e-9ef9-15127ebb01fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-31b8a98d-c108-4a2e-9ef9-15127ebb01fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:20.089124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:20.090080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:20.090890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:20.094453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 216/420] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:20.096813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0b51a-d5bc-4f2e-91e7-8b6757491b57 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:20.225083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:20.233762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8a98d-c108-4a2e-9ef9-15127ebb01fd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:20.249763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0b51a-d5bc-4f2e-91e7-8b6757491b57 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:20.287492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d019e9-6aed-464a-823d-bf241f824737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:20.288546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d019e9-6aed-464a-823d-bf241f824737 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:20.289038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d019e9-6aed-464a-823d-bf241f824737 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:20.289510 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d019e9-6aed-464a-823d-bf241f824737 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:20.290372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d019e9-6aed-464a-823d-bf241f824737 None admin] RBAC: Adding query filter params (name=member) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:20.290965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d019e9-6aed-464a-823d-bf241f824737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:20.292545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d019e9-6aed-464a-823d-bf241f824737 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:20.303840 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 205/421] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:20.311640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d019e9-6aed-464a-823d-bf241f824737 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:20.339725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:20.356158 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8a98d-c108-4a2e-9ef9-15127ebb01fd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:20.404029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3238-0d56-4547-a6f7-d1de8a1c3bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:20.404685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3238-0d56-4547-a6f7-d1de8a1c3bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:20.404961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3238-0d56-4547-a6f7-d1de8a1c3bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:20.405231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb3238-0d56-4547-a6f7-d1de8a1c3bf7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:20.428128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d019e9-6aed-464a-823d-bf241f824737 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:20.447316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb3238-0d56-4547-a6f7-d1de8a1c3bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-78fb3238-0d56-4547-a6f7-d1de8a1c3bf7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:20.452279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:20.453222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:20.454023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 217/422] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:59:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:20.459585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3238-0d56-4547-a6f7-d1de8a1c3bf7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:20.468610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0866174-00a6-4af0-8098-809ae412cd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:20.469625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866174-00a6-4af0-8098-809ae412cd2a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:20.470125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866174-00a6-4af0-8098-809ae412cd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:20.470595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866174-00a6-4af0-8098-809ae412cd2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:20.512403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:20.547813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0866174-00a6-4af0-8098-809ae412cd2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:20.549631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0866174-00a6-4af0-8098-809ae412cd2a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:20.647985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb3238-0d56-4547-a6f7-d1de8a1c3bf7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:20.656103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 206/423] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:20.657757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be03de3-c876-4057-81ac-684651fa4237 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:20.658282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be03de3-c876-4057-81ac-684651fa4237 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:20.658833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be03de3-c876-4057-81ac-684651fa4237 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:20.661019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 207/424] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:20.661949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be03de3-c876-4057-81ac-684651fa4237 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:20.692947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c1685-1e80-4a2e-ad5d-7e0c56aeea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:20.693566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c1685-1e80-4a2e-ad5d-7e0c56aeea40 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:20.693950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c1685-1e80-4a2e-ad5d-7e0c56aeea40 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:20.694250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c1685-1e80-4a2e-ad5d-7e0c56aeea40 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:20.695050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c1685-1e80-4a2e-ad5d-7e0c56aeea40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:20.695359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c1685-1e80-4a2e-ad5d-7e0c56aeea40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:20.696744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c1685-1e80-4a2e-ad5d-7e0c56aeea40 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:20.710931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 218/425] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:20.712313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b83f-84ed-4220-8b03-8b292288a148 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:20.712601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b83f-84ed-4220-8b03-8b292288a148 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:20.712867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b83f-84ed-4220-8b03-8b292288a148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:20.717568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:20.733535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1bf0b83f-84ed-4220-8b03-8b292288a148 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:20.735305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1bf0b83f-84ed-4220-8b03-8b292288a148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:20.739037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:20.777827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be03de3-c876-4057-81ac-684651fa4237 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:20.813830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf84ff-a3ee-43b0-9033-985eeff749a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:20.814454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf84ff-a3ee-43b0-9033-985eeff749a8 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:20.814690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 219/426] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:20.814791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf84ff-a3ee-43b0-9033-985eeff749a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:20.815034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf84ff-a3ee-43b0-9033-985eeff749a8 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:20.816126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b83f-84ed-4220-8b03-8b292288a148 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:20.816550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf84ff-a3ee-43b0-9033-985eeff749a8 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:20.818090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf84ff-a3ee-43b0-9033-985eeff749a8 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:20.820199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 208/427] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:20 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:20.828760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf84ff-a3ee-43b0-9033-985eeff749a8 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:20.931030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf84ff-a3ee-43b0-9033-985eeff749a8 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:20.946869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:20.968749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093785-77ad-44de-898c-b0a96b7f37b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:20.969546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093785-77ad-44de-898c-b0a96b7f37b6 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:20.970139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093785-77ad-44de-898c-b0a96b7f37b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:20.970329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093785-77ad-44de-898c-b0a96b7f37b6 None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:20.974129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c093785-77ad-44de-898c-b0a96b7f37b6 None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:20.974129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c093785-77ad-44de-898c-b0a96b7f37b6 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:20.975158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 209/428] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:20 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:20.986857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093785-77ad-44de-898c-b0a96b7f37b6 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:21.009055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b83f-84ed-4220-8b03-8b292288a148 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:21.118845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19861d-e309-4b0d-ab46-0c33fe01214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:21.119385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19861d-e309-4b0d-ab46-0c33fe01214b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:21.119666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19861d-e309-4b0d-ab46-0c33fe01214b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:21.119939 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19861d-e309-4b0d-ab46-0c33fe01214b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:21.124685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093785-77ad-44de-898c-b0a96b7f37b6 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:21.141419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:21.170429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee69363-fb86-49e1-bb7b-834f720cff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:21.171094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee69363-fb86-49e1-bb7b-834f720cff38 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:21.171369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee69363-fb86-49e1-bb7b-834f720cff38 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:21.171642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee69363-fb86-49e1-bb7b-834f720cff38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:21.172423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee69363-fb86-49e1-bb7b-834f720cff38 None admin] RBAC: Adding query filter params (group.id=8b1729e1a6b04785a1cc06472b91c9ad, role.id=6ba784d4bd374e1793729d1ff430e45f, scope.project.id=680231dab5b3448499d71c6cba44d7c6) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:21.172742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee69363-fb86-49e1-bb7b-834f720cff38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:21.174278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee69363-fb86-49e1-bb7b-834f720cff38 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:21.180698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 210/429] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Sep 8 15:59:20 2022] GET /identity/v3/role_assignments?group.id=8b1729e1a6b04785a1cc06472b91c9ad&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:21.206572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee69363-fb86-49e1-bb7b-834f720cff38 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:21.295100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:21.299612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19861d-e309-4b0d-ab46-0c33fe01214b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:21.301085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19861d-e309-4b0d-ab46-0c33fe01214b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:21.321651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee69363-fb86-49e1-bb7b-834f720cff38 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:21.362827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553ca68-b3ba-47de-aea0-2019dd90522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:21.363490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ca68-b3ba-47de-aea0-2019dd90522d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:21.363771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ca68-b3ba-47de-aea0-2019dd90522d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:21.364048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ca68-b3ba-47de-aea0-2019dd90522d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:21.377617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553ca68-b3ba-47de-aea0-2019dd90522d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-9553ca68-b3ba-47de-aea0-2019dd90522d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:21.385071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:21.386031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:21.386878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 211/430] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:21.395158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553ca68-b3ba-47de-aea0-2019dd90522d None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:21.499759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 220/431] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:21.505194 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19861d-e309-4b0d-ab46-0c33fe01214b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:21.550343 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553ca68-b3ba-47de-aea0-2019dd90522d None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:21.560823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:21.564674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:21.604813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fe81a-b2e3-4051-8d63-98e134ee3974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:21.605557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fe81a-b2e3-4051-8d63-98e134ee3974 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:21.605833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fe81a-b2e3-4051-8d63-98e134ee3974 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:21.606101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fe81a-b2e3-4051-8d63-98e134ee3974 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:21.606837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fe81a-b2e3-4051-8d63-98e134ee3974 None admin] RBAC: Adding query filter params (name=member) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:21.607192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fe81a-b2e3-4051-8d63-98e134ee3974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:21.608626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fe81a-b2e3-4051-8d63-98e134ee3974 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:21.618052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 212/432] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 15:59:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:21.619428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c376f-770e-4df6-bed6-173a724995f8 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:21.619709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c376f-770e-4df6-bed6-173a724995f8 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:21.620116 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c376f-770e-4df6-bed6-173a724995f8 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:21.621305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 213/433] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:21.627238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2df7b9-ba12-4388-bd6c-f1546dd53db1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:21.627518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2df7b9-ba12-4388-bd6c-f1546dd53db1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:21.627845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2df7b9-ba12-4388-bd6c-f1546dd53db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:21.640026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19861d-e309-4b0d-ab46-0c33fe01214b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:21.647929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-aa2df7b9-ba12-4388-bd6c-f1546dd53db1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:21.649119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-aa2df7b9-ba12-4388-bd6c-f1546dd53db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:21.684874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbab54-6139-4239-b7da-7e0f9a24e091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:21.686642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbab54-6139-4239-b7da-7e0f9a24e091 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:21.686642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbab54-6139-4239-b7da-7e0f9a24e091 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:21.686642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbab54-6139-4239-b7da-7e0f9a24e091 None admin] PATH_INFO: `/v3/projects/680231dab5b3448499d71c6cba44d7c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:21.688789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbab54-6139-4239-b7da-7e0f9a24e091 None admin] RBAC: Authorizing `identity:get_project(project_id=680231dab5b3448499d71c6cba44d7c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:21.691288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbab54-6139-4239-b7da-7e0f9a24e091 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:21.693237 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 221/434] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:21 2022] GET /identity/v3/projects/680231dab5b3448499d71c6cba44d7c6 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:21.694073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbab54-6139-4239-b7da-7e0f9a24e091 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:21.730996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 214/435] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:21.732168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2df7b9-ba12-4388-bd6c-f1546dd53db1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:21.831580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbab54-6139-4239-b7da-7e0f9a24e091 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:21.835736 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:21.839741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2df7b9-ba12-4388-bd6c-f1546dd53db1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:21.841612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:21.878327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c270ad-9d45-4e44-856d-46de696d53e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:21.878796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca093b6-8125-4099-93dd-7337593ea715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:21.879434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca093b6-8125-4099-93dd-7337593ea715 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:21.879703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c270ad-9d45-4e44-856d-46de696d53e5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:21.879806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca093b6-8125-4099-93dd-7337593ea715 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:21.880060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca093b6-8125-4099-93dd-7337593ea715 None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:21.880557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c270ad-9d45-4e44-856d-46de696d53e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:21.881038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c270ad-9d45-4e44-856d-46de696d53e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:21.883817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca093b6-8125-4099-93dd-7337593ea715 None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:21.883817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca093b6-8125-4099-93dd-7337593ea715 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:21.885494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 215/436] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:21 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:21.891705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca093b6-8125-4099-93dd-7337593ea715 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:21.974628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c270ad-9d45-4e44-856d-46de696d53e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:21.976989 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c270ad-9d45-4e44-856d-46de696d53e5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:22.033221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca093b6-8125-4099-93dd-7337593ea715 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:22.076051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76b56e-7ba2-4ca8-b16f-a8aa5978f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:22.077068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76b56e-7ba2-4ca8-b16f-a8aa5978f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:22.077606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76b56e-7ba2-4ca8-b16f-a8aa5978f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:22.078083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76b56e-7ba2-4ca8-b16f-a8aa5978f7b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:22.079070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76b56e-7ba2-4ca8-b16f-a8aa5978f7b1 None admin] RBAC: Adding query filter params (group.id=8b1729e1a6b04785a1cc06472b91c9ad, role.id=779e95b5df394f2a95fbdfa2a9fb58eb, scope.project.id=680231dab5b3448499d71c6cba44d7c6) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:22.079632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76b56e-7ba2-4ca8-b16f-a8aa5978f7b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:22.081194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76b56e-7ba2-4ca8-b16f-a8aa5978f7b1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:22.087287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 216/437] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Sep 8 15:59:21 2022] GET /identity/v3/role_assignments?group.id=8b1729e1a6b04785a1cc06472b91c9ad&scope.project.id=680231dab5b3448499d71c6cba44d7c6&role.id=779e95b5df394f2a95fbdfa2a9fb58eb => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:22.087872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76b56e-7ba2-4ca8-b16f-a8aa5978f7b1 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:22.099083 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 222/438] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:22.104640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c270ad-9d45-4e44-856d-46de696d53e5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:22.115089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:22.135748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:22.220674 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76b56e-7ba2-4ca8-b16f-a8aa5978f7b1 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:22.240659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c270ad-9d45-4e44-856d-46de696d53e5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:22.260084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16170b-2256-4e7c-bf5b-a14a88729999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:22.260733 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16170b-2256-4e7c-bf5b-a14a88729999 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:22.261015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16170b-2256-4e7c-bf5b-a14a88729999 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:22.261294 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16170b-2256-4e7c-bf5b-a14a88729999 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:22.274191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16170b-2256-4e7c-bf5b-a14a88729999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-5b16170b-2256-4e7c-bf5b-a14a88729999 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:22.280704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:22.282648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:22.283777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 217/439] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:22.286036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03109ef-98b4-4dfa-9826-8b23a639ff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:22.286787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03109ef-98b4-4dfa-9826-8b23a639ff62 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:22.287600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16170b-2256-4e7c-bf5b-a14a88729999 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:22.288221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03109ef-98b4-4dfa-9826-8b23a639ff62 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:22.288490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03109ef-98b4-4dfa-9826-8b23a639ff62 None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:22.289911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03109ef-98b4-4dfa-9826-8b23a639ff62 None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:22.291417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03109ef-98b4-4dfa-9826-8b23a639ff62 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:22.293193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 223/440] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:22 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:22.300201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03109ef-98b4-4dfa-9826-8b23a639ff62 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:22.399047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:22.410700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:22.432133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16170b-2256-4e7c-bf5b-a14a88729999 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:22.436437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03109ef-98b4-4dfa-9826-8b23a639ff62 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:22.481461 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6cbc1-34be-4f2f-ac77-d51fab8e9162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:22.482865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6cbc1-34be-4f2f-ac77-d51fab8e9162 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:22.483149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6cbc1-34be-4f2f-ac77-d51fab8e9162 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:22.483423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6cbc1-34be-4f2f-ac77-d51fab8e9162 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:22.484100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6cbc1-34be-4f2f-ac77-d51fab8e9162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:22.484407 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6cbc1-34be-4f2f-ac77-d51fab8e9162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:22.484697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62569474-42a4-46fb-9ece-a5910a42959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:22.485470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62569474-42a4-46fb-9ece-a5910a42959e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:22.485784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6cbc1-34be-4f2f-ac77-d51fab8e9162 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:22.486028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62569474-42a4-46fb-9ece-a5910a42959e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:22.486444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62569474-42a4-46fb-9ece-a5910a42959e None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:22.489255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62569474-42a4-46fb-9ece-a5910a42959e None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:22.490692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62569474-42a4-46fb-9ece-a5910a42959e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:22.492487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 224/441] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:22 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:22.493493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2f4a-5b83-49f7-ae3f-6d175492eb41 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:22.493764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2f4a-5b83-49f7-ae3f-6d175492eb41 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:22.494085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2f4a-5b83-49f7-ae3f-6d175492eb41 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:22.495308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 225/442] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:22.495574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 218/443] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:22.500135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a2f4a-5b83-49f7-ae3f-6d175492eb41 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:22.500750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315754-d864-4a45-bee1-6e924b04d209 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:22.501038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315754-d864-4a45-bee1-6e924b04d209 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:22.501310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315754-d864-4a45-bee1-6e924b04d209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:22.522789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3e315754-d864-4a45-bee1-6e924b04d209 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:22.523980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3e315754-d864-4a45-bee1-6e924b04d209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:22.593351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 219/444] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:22.594191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e315754-d864-4a45-bee1-6e924b04d209 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:22.612150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a2f4a-5b83-49f7-ae3f-6d175492eb41 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:22.647318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd879086-cca6-4c3c-8c8e-b7d713988ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:22.647917 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd879086-cca6-4c3c-8c8e-b7d713988ddc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:22.648190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd879086-cca6-4c3c-8c8e-b7d713988ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:22.648459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd879086-cca6-4c3c-8c8e-b7d713988ddc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:22.649227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd879086-cca6-4c3c-8c8e-b7d713988ddc None admin] RBAC: Adding query filter params (group.id=8b1729e1a6b04785a1cc06472b91c9ad, role.id=6ba784d4bd374e1793729d1ff430e45f, scope.project.id=323eda8873b34125b0dc80cad45fb567) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:22.649475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd879086-cca6-4c3c-8c8e-b7d713988ddc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:22.650927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd879086-cca6-4c3c-8c8e-b7d713988ddc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:22.657199 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 226/445] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Sep 8 15:59:22 2022] GET /identity/v3/role_assignments?group.id=8b1729e1a6b04785a1cc06472b91c9ad&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=6ba784d4bd374e1793729d1ff430e45f => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:22.684003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:22.705142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e315754-d864-4a45-bee1-6e924b04d209 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:22.744608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd704fe-f470-49cd-bec0-83edb3e8bf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:22.745586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd704fe-f470-49cd-bec0-83edb3e8bf95 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:22.746081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd704fe-f470-49cd-bec0-83edb3e8bf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:22.746582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd704fe-f470-49cd-bec0-83edb3e8bf95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:22.820272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd704fe-f470-49cd-bec0-83edb3e8bf95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:22.822084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd704fe-f470-49cd-bec0-83edb3e8bf95 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:22.861845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd879086-cca6-4c3c-8c8e-b7d713988ddc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:22.871049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:22.909836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:22.928557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 220/446] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:22.934578 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd704fe-f470-49cd-bec0-83edb3e8bf95 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:22.984554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd879086-cca6-4c3c-8c8e-b7d713988ddc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:23.020864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d39be-68ce-43c8-a1f2-83f3eaac648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:23.021303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d39be-68ce-43c8-a1f2-83f3eaac648d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:23.021583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d39be-68ce-43c8-a1f2-83f3eaac648d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:23.021856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d39be-68ce-43c8-a1f2-83f3eaac648d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:23.036534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d39be-68ce-43c8-a1f2-83f3eaac648d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-817d39be-68ce-43c8-a1f2-83f3eaac648d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:23.041890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:23.043079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:23.044106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 227/447] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:59:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:23.050142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d39be-68ce-43c8-a1f2-83f3eaac648d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:23.056475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd704fe-f470-49cd-bec0-83edb3e8bf95 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:23.091166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66613112-69e2-48d9-b263-ea0463f60030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:23.091820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66613112-69e2-48d9-b263-ea0463f60030 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:23.092103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66613112-69e2-48d9-b263-ea0463f60030 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:23.092376 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66613112-69e2-48d9-b263-ea0463f60030 None admin] PATH_INFO: `/v3/projects/2058312f3bcf45699a154a422ba5b605` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:23.093496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66613112-69e2-48d9-b263-ea0463f60030 None admin] RBAC: Authorizing `identity:get_project(project_id=2058312f3bcf45699a154a422ba5b605)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:23.094979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66613112-69e2-48d9-b263-ea0463f60030 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:23.096597 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 221/448] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:22 2022] GET /identity/v3/projects/2058312f3bcf45699a154a422ba5b605 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:23.101930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66613112-69e2-48d9-b263-ea0463f60030 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:23.118492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:23.150995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:23.153242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d39be-68ce-43c8-a1f2-83f3eaac648d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:23.189340 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568ede5-3035-4c3b-b70a-b0b02e191548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:23.189947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568ede5-3035-4c3b-b70a-b0b02e191548 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:23.190230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568ede5-3035-4c3b-b70a-b0b02e191548 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:23.190500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568ede5-3035-4c3b-b70a-b0b02e191548 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:23.191193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568ede5-3035-4c3b-b70a-b0b02e191548 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:23.191494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568ede5-3035-4c3b-b70a-b0b02e191548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:23.192865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568ede5-3035-4c3b-b70a-b0b02e191548 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:23.201622 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 228/449] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:23.202266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66613112-69e2-48d9-b263-ea0463f60030 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:23.207305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568ede5-3035-4c3b-b70a-b0b02e191548 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:23.235120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec4c87-311e-46b2-b584-7b1822d6bbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:23.235743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec4c87-311e-46b2-b584-7b1822d6bbcd None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:23.236017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec4c87-311e-46b2-b584-7b1822d6bbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:23.236287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec4c87-311e-46b2-b584-7b1822d6bbcd None admin] PATH_INFO: `/v3/groups/0715ab8140244a93b2b0c5e0f24a5aeb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:23.237397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec4c87-311e-46b2-b584-7b1822d6bbcd None admin] RBAC: Authorizing `identity:get_group(group_id=0715ab8140244a93b2b0c5e0f24a5aeb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:23.238856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec4c87-311e-46b2-b584-7b1822d6bbcd None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:23.240560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 222/450] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:23 2022] GET /identity/v3/groups/0715ab8140244a93b2b0c5e0f24a5aeb => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:23.246013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec4c87-311e-46b2-b584-7b1822d6bbcd None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:23.305288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568ede5-3035-4c3b-b70a-b0b02e191548 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:23.331240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:23.338691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a61af-60d3-451e-99ba-760cda911a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:23.339300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a61af-60d3-451e-99ba-760cda911a8f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:23.339575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a61af-60d3-451e-99ba-760cda911a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:23.339846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a61af-60d3-451e-99ba-760cda911a8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:23.341686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec4c87-311e-46b2-b584-7b1822d6bbcd None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:23.358380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:23.374950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c283d-a187-4b53-8691-020b1921f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:23.375545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c283d-a187-4b53-8691-020b1921f9ad None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:23.375822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c283d-a187-4b53-8691-020b1921f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:23.376092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c283d-a187-4b53-8691-020b1921f9ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:23.376810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c283d-a187-4b53-8691-020b1921f9ad None admin] RBAC: Adding query filter params (group.id=0715ab8140244a93b2b0c5e0f24a5aeb, role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=2058312f3bcf45699a154a422ba5b605) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:23.377116 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c283d-a187-4b53-8691-020b1921f9ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:23.378540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c283d-a187-4b53-8691-020b1921f9ad None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:23.384159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 223/451] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Sep 8 15:59:23 2022] GET /identity/v3/role_assignments?group.id=0715ab8140244a93b2b0c5e0f24a5aeb&scope.project.id=2058312f3bcf45699a154a422ba5b605&role.id=519b356d36364663a59265dc7eeff0b8 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:23.408274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a61af-60d3-451e-99ba-760cda911a8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:23.409793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a61af-60d3-451e-99ba-760cda911a8f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:23.515772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 229/452] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 15:59:23.521824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c283d-a187-4b53-8691-020b1921f9ad None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:23.622453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c283d-a187-4b53-8691-020b1921f9ad None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:23.655285 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259559f9-d2bb-4b4f-84ad-cc89e145b07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:23.655909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259559f9-d2bb-4b4f-84ad-cc89e145b07f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:23.656228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259559f9-d2bb-4b4f-84ad-cc89e145b07f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:23.656503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259559f9-d2bb-4b4f-84ad-cc89e145b07f None admin] PATH_INFO: `/v3/projects/323eda8873b34125b0dc80cad45fb567` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:23.657619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259559f9-d2bb-4b4f-84ad-cc89e145b07f None admin] RBAC: Authorizing `identity:get_project(project_id=323eda8873b34125b0dc80cad45fb567)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:23.659097 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259559f9-d2bb-4b4f-84ad-cc89e145b07f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:23.660714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 224/453] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 15:59:23 2022] GET /identity/v3/projects/323eda8873b34125b0dc80cad45fb567 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:23.666353 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a61af-60d3-451e-99ba-760cda911a8f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:23.693798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:23.762237 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a61af-60d3-451e-99ba-760cda911a8f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:23.795731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8056687-a688-4247-aef5-07f9faaf2666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:23.796277 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8056687-a688-4247-aef5-07f9faaf2666 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:23.796550 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8056687-a688-4247-aef5-07f9faaf2666 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:23.796818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8056687-a688-4247-aef5-07f9faaf2666 None admin] PATH_INFO: `/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:23.797903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8056687-a688-4247-aef5-07f9faaf2666 None admin] RBAC: Authorizing `identity:get_group(group_id=8b1729e1a6b04785a1cc06472b91c9ad)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:23.799361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8056687-a688-4247-aef5-07f9faaf2666 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:23.800914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 230/454] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Sep 8 15:59:23 2022] GET /identity/v3/groups/8b1729e1a6b04785a1cc06472b91c9ad => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:23.806515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259559f9-d2bb-4b4f-84ad-cc89e145b07f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:23.854339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:23.902726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259559f9-d2bb-4b4f-84ad-cc89e145b07f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:23.933793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee16b0-ae21-4374-81d9-388d37b1dff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:23.934377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee16b0-ae21-4374-81d9-388d37b1dff7 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:23.934685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee16b0-ae21-4374-81d9-388d37b1dff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:23.934953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee16b0-ae21-4374-81d9-388d37b1dff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:23.936187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee16b0-ae21-4374-81d9-388d37b1dff7 None admin] RBAC: Adding query filter params (group.id=8b1729e1a6b04785a1cc06472b91c9ad, role.id=779e95b5df394f2a95fbdfa2a9fb58eb, scope.project.id=323eda8873b34125b0dc80cad45fb567) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:23.936489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee16b0-ae21-4374-81d9-388d37b1dff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:23.937924 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee16b0-ae21-4374-81d9-388d37b1dff7 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:23.943549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 225/455] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Sep 8 15:59:23 2022] GET /identity/v3/role_assignments?group.id=8b1729e1a6b04785a1cc06472b91c9ad&scope.project.id=323eda8873b34125b0dc80cad45fb567&role.id=779e95b5df394f2a95fbdfa2a9fb58eb => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:26.644470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732806b-3553-4634-b83b-74f180bb3ff0 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:26.644973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732806b-3553-4634-b83b-74f180bb3ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:26.645214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732806b-3553-4634-b83b-74f180bb3ff0 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:26.647940 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 231/456] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:26.654507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2192e8-a27d-4177-b28d-1c52cadbe7f1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:26.655408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2192e8-a27d-4177-b28d-1c52cadbe7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:26.655895 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2192e8-a27d-4177-b28d-1c52cadbe7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:26.683847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-ca2192e8-a27d-4177-b28d-1c52cadbe7f1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:26.685673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ca2192e8-a27d-4177-b28d-1c52cadbe7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:26.784855 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 226/457] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:26.877828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985e9c4-aa00-45ed-897b-c644ecd52085 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:26.878192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985e9c4-aa00-45ed-897b-c644ecd52085 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:26.878463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985e9c4-aa00-45ed-897b-c644ecd52085 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:26.880133 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 232/458] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:26.900004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d8577-a64c-4d95-b246-76fb2e9d0f81 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:26.900004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d8577-a64c-4d95-b246-76fb2e9d0f81 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:26.900004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d8577-a64c-4d95-b246-76fb2e9d0f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:26.908834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-e15d8577-a64c-4d95-b246-76fb2e9d0f81 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:26.910069 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e15d8577-a64c-4d95-b246-76fb2e9d0f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:26.991870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:27.030729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 227/459] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:27.239784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985e9c4-aa00-45ed-897b-c644ecd52085 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:27.395658 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:27.412586 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985e9c4-aa00-45ed-897b-c644ecd52085 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:27.421208 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d8577-a64c-4d95-b246-76fb2e9d0f81 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:27.466005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbf782-aa5e-4cab-b479-065112802523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:27.466698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbf782-aa5e-4cab-b479-065112802523 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:27.466987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbf782-aa5e-4cab-b479-065112802523 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:27.467263 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbf782-aa5e-4cab-b479-065112802523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:27.487266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbf782-aa5e-4cab-b479-065112802523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:27.492966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbf782-aa5e-4cab-b479-065112802523 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-dacbf782-aa5e-4cab-b479-065112802523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:27.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:27.511661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:27.512516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:27.512516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:27.512516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:27.518780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 233/460] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:27.520212 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43b007-6950-48ae-88f4-821698862c8c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:27.520495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43b007-6950-48ae-88f4-821698862c8c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:27.520768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43b007-6950-48ae-88f4-821698862c8c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:27.522361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 234/461] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:27.523878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43b007-6950-48ae-88f4-821698862c8c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:27.589226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d8577-a64c-4d95-b246-76fb2e9d0f81 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:27.638722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab832db-26c3-4fb5-a69f-7a3a85757554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:27.639368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab832db-26c3-4fb5-a69f-7a3a85757554 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:27.639649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab832db-26c3-4fb5-a69f-7a3a85757554 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:27.639923 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab832db-26c3-4fb5-a69f-7a3a85757554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:27.651769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab832db-26c3-4fb5-a69f-7a3a85757554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:27.652032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43b007-6950-48ae-88f4-821698862c8c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:27.653188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab832db-26c3-4fb5-a69f-7a3a85757554 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-cab832db-26c3-4fb5-a69f-7a3a85757554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:27.669312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:27.670728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:27.672060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:27.672060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:27.672060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:27.675500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 228/462] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:27.676789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9674b8-1fe8-4f82-a46f-763701d1ee99 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:27.677072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9674b8-1fe8-4f82-a46f-763701d1ee99 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:27.677346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9674b8-1fe8-4f82-a46f-763701d1ee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:27.691057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a879d75-a971-49cb-9cf2-52206eb949f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:27.691664 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a879d75-a971-49cb-9cf2-52206eb949f8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:27.691944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a879d75-a971-49cb-9cf2-52206eb949f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:27.692217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a879d75-a971-49cb-9cf2-52206eb949f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:27.692850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a879d75-a971-49cb-9cf2-52206eb949f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:27.693150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a879d75-a971-49cb-9cf2-52206eb949f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:27.694603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a879d75-a971-49cb-9cf2-52206eb949f8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:27.695989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-6a9674b8-1fe8-4f82-a46f-763701d1ee99 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:27.697211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6a9674b8-1fe8-4f82-a46f-763701d1ee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:27.712048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 235/463] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:27.712048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427116e-cea3-4ed3-b709-fe79b0866a00 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:27.712048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427116e-cea3-4ed3-b709-fe79b0866a00 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:27.712048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427116e-cea3-4ed3-b709-fe79b0866a00 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:27.715174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 236/464] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:27.715952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427116e-cea3-4ed3-b709-fe79b0866a00 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:27.722873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:27.726601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:27.770723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 229/465] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:27.776048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9674b8-1fe8-4f82-a46f-763701d1ee99 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:27.829747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427116e-cea3-4ed3-b709-fe79b0866a00 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:27.864693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d756db-7ec2-4783-8a9c-ebf769d954d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:27.865299 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d756db-7ec2-4783-8a9c-ebf769d954d0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:27.865620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d756db-7ec2-4783-8a9c-ebf769d954d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:27.865894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d756db-7ec2-4783-8a9c-ebf769d954d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:27.866528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d756db-7ec2-4783-8a9c-ebf769d954d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:27.866882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d756db-7ec2-4783-8a9c-ebf769d954d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:27.868334 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d756db-7ec2-4783-8a9c-ebf769d954d0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:27.881345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 237/466] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:27.882869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054aa7e-3368-412a-8c35-0b6b96ba58bd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:27.882986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054aa7e-3368-412a-8c35-0b6b96ba58bd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:27.883259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054aa7e-3368-412a-8c35-0b6b96ba58bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:27.895312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9674b8-1fe8-4f82-a46f-763701d1ee99 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:27.905309 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6054aa7e-3368-412a-8c35-0b6b96ba58bd None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:27.906483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6054aa7e-3368-412a-8c35-0b6b96ba58bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:27.936472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c0c5d-b849-407b-a9d1-22af8374dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:27.937456 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c0c5d-b849-407b-a9d1-22af8374dba2 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:27.937950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c0c5d-b849-407b-a9d1-22af8374dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:27.938541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c0c5d-b849-407b-a9d1-22af8374dba2 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:27.939508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c0c5d-b849-407b-a9d1-22af8374dba2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:27.941154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c0c5d-b849-407b-a9d1-22af8374dba2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:27.976061 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:27.982147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 238/467] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:27.986806 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054aa7e-3368-412a-8c35-0b6b96ba58bd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:28.061144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 230/468] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:59:27 2022] POST /identity/v3/users => generated 246 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:59:28.085147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c0c5d-b849-407b-a9d1-22af8374dba2 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:28.112208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054aa7e-3368-412a-8c35-0b6b96ba58bd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:28.129131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:28.154613 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c6f83-2405-42fe-bb29-0fc86cc2a4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:28.155475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c6f83-2405-42fe-bb29-0fc86cc2a4a2 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:28.161369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c6f83-2405-42fe-bb29-0fc86cc2a4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:28.161369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c6f83-2405-42fe-bb29-0fc86cc2a4a2 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:28.161369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c6f83-2405-42fe-bb29-0fc86cc2a4a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:28.161369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c6f83-2405-42fe-bb29-0fc86cc2a4a2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:28.266702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c0c5d-b849-407b-a9d1-22af8374dba2 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:28.268492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 239/469] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:59:27 2022] POST /identity/v3/users => generated 248 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:59:28.275058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c6f83-2405-42fe-bb29-0fc86cc2a4a2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:28.311486 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5814a-0492-4d4a-9281-445aa002a5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:28.312194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5814a-0492-4d4a-9281-445aa002a5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:28.312472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5814a-0492-4d4a-9281-445aa002a5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:28.312745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5814a-0492-4d4a-9281-445aa002a5c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:28.326979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5814a-0492-4d4a-9281-445aa002a5c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:28.329310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5814a-0492-4d4a-9281-445aa002a5c0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-e2b5814a-0492-4d4a-9281-445aa002a5c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:28.349610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:28.350583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:28.351586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:28.351586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:28.351586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:28.351586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 231/470] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:28.359257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5814a-0492-4d4a-9281-445aa002a5c0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:28.369206 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:28.441591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c6f83-2405-42fe-bb29-0fc86cc2a4a2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:28.461384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:28.482903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5485-cb57-490b-8448-939decbb6ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:28.483541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5485-cb57-490b-8448-939decbb6ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:28.483809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5485-cb57-490b-8448-939decbb6ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:28.484072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5485-cb57-490b-8448-939decbb6ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:28.498173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb5485-cb57-490b-8448-939decbb6ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:28.500011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb5485-cb57-490b-8448-939decbb6ee6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:28.511775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5814a-0492-4d4a-9281-445aa002a5c0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-49fb5485-cb57-490b-8448-939decbb6ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:28.517835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:28.518825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:28.519696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:28.519696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:28.519696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:28.520315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 240/471] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:28.521495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe3770-1aa5-4aea-99f8-99f12e58631d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:28.521781 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe3770-1aa5-4aea-99f8-99f12e58631d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:28.522058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe3770-1aa5-4aea-99f8-99f12e58631d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:28.525026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 241/472] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:28.526162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe3770-1aa5-4aea-99f8-99f12e58631d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:28.565060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bf9f6-9dca-4998-bbd0-e35cb8b9765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:28.566240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf9f6-9dca-4998-bbd0-e35cb8b9765e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:28.566842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf9f6-9dca-4998-bbd0-e35cb8b9765e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:28.567263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bf9f6-9dca-4998-bbd0-e35cb8b9765e None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:28.567936 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bf9f6-9dca-4998-bbd0-e35cb8b9765e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:28.568302 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bf9f6-9dca-4998-bbd0-e35cb8b9765e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:28.569710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bf9f6-9dca-4998-bbd0-e35cb8b9765e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:28.586432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 232/473] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:28.588039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa279a1-0094-48a2-8ecd-186e4d4e760d None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:28.588325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa279a1-0094-48a2-8ecd-186e4d4e760d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:28.588600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa279a1-0094-48a2-8ecd-186e4d4e760d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:28.620802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-aaa279a1-0094-48a2-8ecd-186e4d4e760d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:28.622058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-aaa279a1-0094-48a2-8ecd-186e4d4e760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:28.659031 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe3770-1aa5-4aea-99f8-99f12e58631d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:28.667318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:28.696562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f805a-2547-40f6-97e1-bdb396dbc682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:28.697465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f805a-2547-40f6-97e1-bdb396dbc682 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:28.698070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f805a-2547-40f6-97e1-bdb396dbc682 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:28.699493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f805a-2547-40f6-97e1-bdb396dbc682 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:28.700812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f805a-2547-40f6-97e1-bdb396dbc682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:28.701258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f805a-2547-40f6-97e1-bdb396dbc682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:28.702804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f805a-2547-40f6-97e1-bdb396dbc682 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:28.703998 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 233/474] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:28.707585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa279a1-0094-48a2-8ecd-186e4d4e760d None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:28.726776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 242/475] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:28.737205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f805a-2547-40f6-97e1-bdb396dbc682 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:28.811959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:28.875508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa279a1-0094-48a2-8ecd-186e4d4e760d None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:28.912853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab137-2820-4eaf-a9d9-df6d1d4a0f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:28.913600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f805a-2547-40f6-97e1-bdb396dbc682 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:28.913864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab137-2820-4eaf-a9d9-df6d1d4a0f33 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:28.914275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab137-2820-4eaf-a9d9-df6d1d4a0f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:28.914733 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab137-2820-4eaf-a9d9-df6d1d4a0f33 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:28.915609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ab137-2820-4eaf-a9d9-df6d1d4a0f33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:28.917176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ab137-2820-4eaf-a9d9-df6d1d4a0f33 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:28.959321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72a1da-bdbd-402c-8ce8-f8da930eadfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:28.960183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72a1da-bdbd-402c-8ce8-f8da930eadfe None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:28.960665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72a1da-bdbd-402c-8ce8-f8da930eadfe None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:28.961071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72a1da-bdbd-402c-8ce8-f8da930eadfe None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:28.961884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72a1da-bdbd-402c-8ce8-f8da930eadfe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:28.963537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72a1da-bdbd-402c-8ce8-f8da930eadfe None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:29.033019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 234/476] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:59:28 2022] POST /identity/v3/users => generated 248 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:59:29.034230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab137-2820-4eaf-a9d9-df6d1d4a0f33 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:29.067326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 243/477] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:59:28 2022] POST /identity/v3/users => generated 249 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:59:29.194181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab137-2820-4eaf-a9d9-df6d1d4a0f33 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:29.227515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:29.237392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93cbd0-229c-4495-9ac2-72150c072fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:29.238028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93cbd0-229c-4495-9ac2-72150c072fe9 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:29.242865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93cbd0-229c-4495-9ac2-72150c072fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:29.242865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93cbd0-229c-4495-9ac2-72150c072fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:29.242865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93cbd0-229c-4495-9ac2-72150c072fe9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:29.242865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93cbd0-229c-4495-9ac2-72150c072fe9 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:29.288890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.sql.core [None req-2d93cbd0-229c-4495-9ac2-72150c072fe9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 15:59:29.288890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 15:59:29.288890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [parameters: {'id': '3a529d0660c945d3ae5abdc1600df4d6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 15:59:29.288890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81696) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-2d93cbd0-229c-4495-9ac2-72150c072fe9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application conn.query(q) Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application result.read() Sep 08 15:59:29.307437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return ref.to_dict() Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 15:59:29.321311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application next(self.gen) Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application yield resource Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application next(self.gen) Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise self.value Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application session.commit() Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 15:59:29.322250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self.session.flush() Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application compat.raise_( Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 15:59:29.323620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 15:59:29.324519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application conn.query(q) Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application result.read() Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 15:59:29.325897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [parameters: {'id': '3a529d0660c945d3ae5abdc1600df4d6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:29.326805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 15:59:29.327628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:29.328447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 235/478] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Sep 8 15:59:29 2022] POST /identity/v3/roles => generated 144 bytes in 275 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:29.328519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72a1da-bdbd-402c-8ce8-f8da930eadfe None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:29.350443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:29.438313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72a1da-bdbd-402c-8ce8-f8da930eadfe None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:29.477185 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccaeeb-4671-4107-8244-447e61a0fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:29.477858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccaeeb-4671-4107-8244-447e61a0fe6d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:29.478084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccaeeb-4671-4107-8244-447e61a0fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:29.478349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccaeeb-4671-4107-8244-447e61a0fe6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:29.490266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccaeeb-4671-4107-8244-447e61a0fe6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f5ccaeeb-4671-4107-8244-447e61a0fe6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:29.495753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:29.498472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:29.500506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 244/479] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 15:59:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:29.503435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93cbd0-229c-4495-9ac2-72150c072fe9 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:29.617637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93cbd0-229c-4495-9ac2-72150c072fe9 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:29.661283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02e7b5-a9b3-46bd-8f4a-2932c2a4bda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:29.661895 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02e7b5-a9b3-46bd-8f4a-2932c2a4bda0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:29.662172 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02e7b5-a9b3-46bd-8f4a-2932c2a4bda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:29.662444 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02e7b5-a9b3-46bd-8f4a-2932c2a4bda0 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:29.663151 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02e7b5-a9b3-46bd-8f4a-2932c2a4bda0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:29.663452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02e7b5-a9b3-46bd-8f4a-2932c2a4bda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:29.664837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02e7b5-a9b3-46bd-8f4a-2932c2a4bda0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:29.677959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 236/480] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:30.718563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed3c0-78d2-4d30-9510-75cf19332b72 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:30.719143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed3c0-78d2-4d30-9510-75cf19332b72 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:30.719143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed3c0-78d2-4d30-9510-75cf19332b72 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:30.720784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 245/481] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:30.726760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcae9a-2da4-451a-a678-09151cd89c8e None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:30.727256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcae9a-2da4-451a-a678-09151cd89c8e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:30.727514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcae9a-2da4-451a-a678-09151cd89c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:30.756003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-06fcae9a-2da4-451a-a678-09151cd89c8e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:30.757210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-06fcae9a-2da4-451a-a678-09151cd89c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:30.800171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:30.818058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac43e9-e79a-4b29-9944-913470ca61a5 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:30.818345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac43e9-e79a-4b29-9944-913470ca61a5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:30.823524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac43e9-e79a-4b29-9944-913470ca61a5 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:30.823524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 246/482] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:30.825037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ee58-40dc-469d-8dd0-8cf6f001976e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:30.825450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ee58-40dc-469d-8dd0-8cf6f001976e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:30.825814 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141ee58-40dc-469d-8dd0-8cf6f001976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:30.844374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2141ee58-40dc-469d-8dd0-8cf6f001976e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:30.845681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2141ee58-40dc-469d-8dd0-8cf6f001976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:30.859164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 237/483] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:30.946931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 247/484] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:59:31.151540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcae9a-2da4-451a-a678-09151cd89c8e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:31.288691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcae9a-2da4-451a-a678-09151cd89c8e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:31.333965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141ee58-40dc-469d-8dd0-8cf6f001976e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:31.339091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553de809-22c8-4a4e-b908-b1c6d930903b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:31.339744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553de809-22c8-4a4e-b908-b1c6d930903b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:31.340021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553de809-22c8-4a4e-b908-b1c6d930903b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:31.340291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553de809-22c8-4a4e-b908-b1c6d930903b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:31.348313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:31.362270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553de809-22c8-4a4e-b908-b1c6d930903b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-553de809-22c8-4a4e-b908-b1c6d930903b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:31.368164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:31.370875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:31.371680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 238/485] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:31.377190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553de809-22c8-4a4e-b908-b1c6d930903b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:31.436284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:31.523600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141ee58-40dc-469d-8dd0-8cf6f001976e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:31.578761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf2484-cf22-45f6-8404-a542652b96eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:31.580515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf2484-cf22-45f6-8404-a542652b96eb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:31.582046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf2484-cf22-45f6-8404-a542652b96eb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:31.582773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf2484-cf22-45f6-8404-a542652b96eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:31.584763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553de809-22c8-4a4e-b908-b1c6d930903b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:31.605632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf2484-cf22-45f6-8404-a542652b96eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-fcbf2484-cf22-45f6-8404-a542652b96eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:31.618209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:31.619247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:31.620057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:31.621800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 248/486] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:31.627851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf2484-cf22-45f6-8404-a542652b96eb None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:31.662243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcbe71-74f3-49f7-af2d-8e9fff231029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:31.662881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcbe71-74f3-49f7-af2d-8e9fff231029 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:31.663156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcbe71-74f3-49f7-af2d-8e9fff231029 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:31.663423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcbe71-74f3-49f7-af2d-8e9fff231029 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:31.664090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcbe71-74f3-49f7-af2d-8e9fff231029 None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:31.664391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcbe71-74f3-49f7-af2d-8e9fff231029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:31.665771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcbe71-74f3-49f7-af2d-8e9fff231029 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:31.681331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 239/487] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:31.687379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcbe71-74f3-49f7-af2d-8e9fff231029 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:31.749475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:31.782966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf2484-cf22-45f6-8404-a542652b96eb None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:31.802167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:31.816619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcbe71-74f3-49f7-af2d-8e9fff231029 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:31.827720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9b601-4ce3-43d6-ab6a-8a5302d0c773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:31.828761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9b601-4ce3-43d6-ab6a-8a5302d0c773 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:31.829126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9b601-4ce3-43d6-ab6a-8a5302d0c773 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:31.829479 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9b601-4ce3-43d6-ab6a-8a5302d0c773 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:31.830524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9b601-4ce3-43d6-ab6a-8a5302d0c773 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:31.830938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9b601-4ce3-43d6-ab6a-8a5302d0c773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:31.832667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9b601-4ce3-43d6-ab6a-8a5302d0c773 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:31.846744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 249/488] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:31.848211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b72e24-c897-4b85-8f90-2492e3fc6edb None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:31.848752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b72e24-c897-4b85-8f90-2492e3fc6edb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:31.849864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b72e24-c897-4b85-8f90-2492e3fc6edb None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:31.851918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 250/489] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:31.852939 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b72e24-c897-4b85-8f90-2492e3fc6edb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:31.874961 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be04d15-3a16-47fa-a27e-025c55ad00a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:31.876034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be04d15-3a16-47fa-a27e-025c55ad00a9 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:31.876397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be04d15-3a16-47fa-a27e-025c55ad00a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:31.876720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be04d15-3a16-47fa-a27e-025c55ad00a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:31.892699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be04d15-3a16-47fa-a27e-025c55ad00a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:31.894657 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be04d15-3a16-47fa-a27e-025c55ad00a9 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-9be04d15-3a16-47fa-a27e-025c55ad00a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:31.916439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:31.917569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:31.918657 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:31.918657 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:31.918657 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:31.920329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 240/490] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:31.921559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01928787-42ce-480f-a80e-3b367b63cc9c None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:31.921899 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01928787-42ce-480f-a80e-3b367b63cc9c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:31.930689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01928787-42ce-480f-a80e-3b367b63cc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:31.948200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-01928787-42ce-480f-a80e-3b367b63cc9c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:31.949514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-01928787-42ce-480f-a80e-3b367b63cc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:31.984475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b72e24-c897-4b85-8f90-2492e3fc6edb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:32.026080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe8e8-350e-4c85-a6f9-276f6dbd5420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:32.027200 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe8e8-350e-4c85-a6f9-276f6dbd5420 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.027729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe8e8-350e-4c85-a6f9-276f6dbd5420 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.028816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe8e8-350e-4c85-a6f9-276f6dbd5420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.031565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:32.042719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fe8e8-350e-4c85-a6f9-276f6dbd5420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:32.044562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fe8e8-350e-4c85-a6f9-276f6dbd5420 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:32.045782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 241/491] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:32.047487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01928787-42ce-480f-a80e-3b367b63cc9c None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-489fe8e8-350e-4c85-a6f9-276f6dbd5420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:32.081624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:32.082587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:32.083512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:32.083512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:32.083512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:32.085602 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 251/492] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:32.092388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe8e8-350e-4c85-a6f9-276f6dbd5420 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:32.158166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:32.191027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01928787-42ce-480f-a80e-3b367b63cc9c None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:32.228869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1e2d-e696-430d-8d40-533ddc9e9ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:32.229383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1e2d-e696-430d-8d40-533ddc9e9ffe None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.229667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1e2d-e696-430d-8d40-533ddc9e9ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.229939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1e2d-e696-430d-8d40-533ddc9e9ffe None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.230708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1e2d-e696-430d-8d40-533ddc9e9ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:32.231010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1e2d-e696-430d-8d40-533ddc9e9ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:32.232487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1e2d-e696-430d-8d40-533ddc9e9ffe None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:32.233651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe8e8-350e-4c85-a6f9-276f6dbd5420 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:32.245793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 242/493] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:32.247720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17950a9-d535-47b7-8711-e24e233aad80 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.248004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17950a9-d535-47b7-8711-e24e233aad80 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.248275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17950a9-d535-47b7-8711-e24e233aad80 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.249724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 243/494] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:32.255562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17950a9-d535-47b7-8711-e24e233aad80 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:32.278588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402bc0a-0642-4493-99e6-ab8fca197fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:32.279224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402bc0a-0642-4493-99e6-ab8fca197fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.279507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402bc0a-0642-4493-99e6-ab8fca197fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.279767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402bc0a-0642-4493-99e6-ab8fca197fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.280522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402bc0a-0642-4493-99e6-ab8fca197fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:32.280828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402bc0a-0642-4493-99e6-ab8fca197fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:32.282305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402bc0a-0642-4493-99e6-ab8fca197fc3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:32.297460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 252/495] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:32.298911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda8989-7c15-4654-ab76-ea6eb1500084 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.299290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda8989-7c15-4654-ab76-ea6eb1500084 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.299576 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda8989-7c15-4654-ab76-ea6eb1500084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.321355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1dda8989-7c15-4654-ab76-ea6eb1500084 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:32.322558 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1dda8989-7c15-4654-ab76-ea6eb1500084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:32.367576 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:32.391350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17950a9-d535-47b7-8711-e24e233aad80 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:32.399491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 253/496] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:32.400423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda8989-7c15-4654-ab76-ea6eb1500084 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:32.433582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:32.440336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223d61e-7bd7-475e-af2c-0757bab64bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:32.441253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223d61e-7bd7-475e-af2c-0757bab64bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.441717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223d61e-7bd7-475e-af2c-0757bab64bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.442140 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223d61e-7bd7-475e-af2c-0757bab64bb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.450387 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223d61e-7bd7-475e-af2c-0757bab64bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:32.452119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223d61e-7bd7-475e-af2c-0757bab64bb7 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-9223d61e-7bd7-475e-af2c-0757bab64bb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:32.466577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:32.467519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:32.468385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:32.468385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:32.468385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:32.468385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:32.468385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:32.468385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:32.468385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:32.468385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:32.468385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 15:59:32.468385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:32.475034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 244/497] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Sep 8 15:59:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:32.476075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223d61e-7bd7-475e-af2c-0757bab64bb7 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:32.523175 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda8989-7c15-4654-ab76-ea6eb1500084 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:32.560543 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44059587-fdae-4252-9f15-0586c21ac3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:32.561544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44059587-fdae-4252-9f15-0586c21ac3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.561969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44059587-fdae-4252-9f15-0586c21ac3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.562239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44059587-fdae-4252-9f15-0586c21ac3b2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.569368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44059587-fdae-4252-9f15-0586c21ac3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:32.570831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44059587-fdae-4252-9f15-0586c21ac3b2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:32.578450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223d61e-7bd7-475e-af2c-0757bab64bb7 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-44059587-fdae-4252-9f15-0586c21ac3b2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:32.583447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:32.584417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:32.585311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:32.585311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:32.585311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:32.585311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:32.585311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:32.585311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:32.585311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:32.585311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:32.585311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 15:59:32.585311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:32.589048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 254/498] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:32.589950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44059587-fdae-4252-9f15-0586c21ac3b2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:32.614167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ea689-39a5-48b4-9d2b-1ac69e2315fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:32.614921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea689-39a5-48b4-9d2b-1ac69e2315fd None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.615256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea689-39a5-48b4-9d2b-1ac69e2315fd None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.615461 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea689-39a5-48b4-9d2b-1ac69e2315fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.625662 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:32.625783 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ea689-39a5-48b4-9d2b-1ac69e2315fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-375ea689-39a5-48b4-9d2b-1ac69e2315fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:32.631133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:32.632029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:32.632830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 245/499] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:32.633934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1b388-d497-47d1-8cd2-bd45891f6fd3 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.633934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1b388-d497-47d1-8cd2-bd45891f6fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.633934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1b388-d497-47d1-8cd2-bd45891f6fd3 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.635287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 246/500] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:32.635979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1b388-d497-47d1-8cd2-bd45891f6fd3 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:32.688953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:32.701648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44059587-fdae-4252-9f15-0586c21ac3b2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:32.734350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c26e01-b878-4bc0-bb6f-5e8bf6c84777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:32.734982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c26e01-b878-4bc0-bb6f-5e8bf6c84777 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.735257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c26e01-b878-4bc0-bb6f-5e8bf6c84777 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.735529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c26e01-b878-4bc0-bb6f-5e8bf6c84777 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.736253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c26e01-b878-4bc0-bb6f-5e8bf6c84777 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:32.736558 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c26e01-b878-4bc0-bb6f-5e8bf6c84777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:32.737999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c26e01-b878-4bc0-bb6f-5e8bf6c84777 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:32.739322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1b388-d497-47d1-8cd2-bd45891f6fd3 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:32.772189 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15043-9bd1-4e50-b680-6781dbbb5f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:32.772789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15043-9bd1-4e50-b680-6781dbbb5f24 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.773064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15043-9bd1-4e50-b680-6781dbbb5f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.773379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15043-9bd1-4e50-b680-6781dbbb5f24 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.773988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 255/501] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 8 15:59:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:32.774411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b15043-9bd1-4e50-b680-6781dbbb5f24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:32.774411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b15043-9bd1-4e50-b680-6781dbbb5f24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:32.774835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c26e01-b878-4bc0-bb6f-5e8bf6c84777 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:32.775794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b15043-9bd1-4e50-b680-6781dbbb5f24 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:32.812011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 247/502] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 8 15:59:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:32.813293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd47d5-c1ab-40cf-92c5-00cad7306e1f None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.813583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd47d5-c1ab-40cf-92c5-00cad7306e1f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.813859 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd47d5-c1ab-40cf-92c5-00cad7306e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.832446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-14dd47d5-c1ab-40cf-92c5-00cad7306e1f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:32.833666 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-14dd47d5-c1ab-40cf-92c5-00cad7306e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:32.871534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:32.877923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c26e01-b878-4bc0-bb6f-5e8bf6c84777 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:32.899477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 248/503] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:32.900332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd47d5-c1ab-40cf-92c5-00cad7306e1f None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:32.911562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92c8bb-b8ee-43c9-adbf-a7e4572f5621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:32.912166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c8bb-b8ee-43c9-adbf-a7e4572f5621 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:32.914477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c8bb-b8ee-43c9-adbf-a7e4572f5621 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:32.914477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c8bb-b8ee-43c9-adbf-a7e4572f5621 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:32.914477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92c8bb-b8ee-43c9-adbf-a7e4572f5621 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:32.914477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92c8bb-b8ee-43c9-adbf-a7e4572f5621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:32.915080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92c8bb-b8ee-43c9-adbf-a7e4572f5621 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:32.923931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 256/504] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:32.923931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92c8bb-b8ee-43c9-adbf-a7e4572f5621 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:32.943367 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:33.005043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd47d5-c1ab-40cf-92c5-00cad7306e1f None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:33.037784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92c8bb-b8ee-43c9-adbf-a7e4572f5621 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:33.040449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897dc5-af6b-481b-9454-5178c436164b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:33.041086 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897dc5-af6b-481b-9454-5178c436164b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:33.041365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897dc5-af6b-481b-9454-5178c436164b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:33.041635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897dc5-af6b-481b-9454-5178c436164b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:33.053329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30897dc5-af6b-481b-9454-5178c436164b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-30897dc5-af6b-481b-9454-5178c436164b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:33.058527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:33.059465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:33.060263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 249/505] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:33.060955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897dc5-af6b-481b-9454-5178c436164b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:33.077051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e11c80-1d2b-4eb6-9b29-6be1250a7752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:33.077662 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e11c80-1d2b-4eb6-9b29-6be1250a7752 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:33.077940 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e11c80-1d2b-4eb6-9b29-6be1250a7752 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:33.078210 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e11c80-1d2b-4eb6-9b29-6be1250a7752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:33.105916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:33.150366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e11c80-1d2b-4eb6-9b29-6be1250a7752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:33.151940 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e11c80-1d2b-4eb6-9b29-6be1250a7752 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:33.163219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:33.166410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897dc5-af6b-481b-9454-5178c436164b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:33.199715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a3766-6c7e-47ff-b290-01af4555894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:33.200868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a3766-6c7e-47ff-b290-01af4555894c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:33.201395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a3766-6c7e-47ff-b290-01af4555894c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:33.201889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a3766-6c7e-47ff-b290-01af4555894c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:33.249820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 257/506] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:33.250858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e11c80-1d2b-4eb6-9b29-6be1250a7752 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:33.267879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a3766-6c7e-47ff-b290-01af4555894c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:33.269363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a3766-6c7e-47ff-b290-01af4555894c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:33.306605 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:33.350353 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e11c80-1d2b-4eb6-9b29-6be1250a7752 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:33.362384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:33.366813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 250/507] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:33.367600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a3766-6c7e-47ff-b290-01af4555894c None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:33.388340 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9390f6-21b3-4c2f-8f70-447240f2458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:33.388965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9390f6-21b3-4c2f-8f70-447240f2458d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:33.389236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9390f6-21b3-4c2f-8f70-447240f2458d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:33.389498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9390f6-21b3-4c2f-8f70-447240f2458d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:33.399463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9390f6-21b3-4c2f-8f70-447240f2458d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:33.400908 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9390f6-21b3-4c2f-8f70-447240f2458d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-2a9390f6-21b3-4c2f-8f70-447240f2458d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:33.420273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:33.421282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:33.422211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:33.422211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:33.422211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:33.422211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 258/508] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:33.422211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9390f6-21b3-4c2f-8f70-447240f2458d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:33.470324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a3766-6c7e-47ff-b290-01af4555894c None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:33.501834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa7490-52a3-49aa-87b9-429961dbce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:33.502432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7490-52a3-49aa-87b9-429961dbce22 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:33.502732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7490-52a3-49aa-87b9-429961dbce22 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:33.503004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa7490-52a3-49aa-87b9-429961dbce22 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:33.503655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa7490-52a3-49aa-87b9-429961dbce22 None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:33.503952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa7490-52a3-49aa-87b9-429961dbce22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:33.505327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa7490-52a3-49aa-87b9-429961dbce22 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:33.513400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 251/509] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:33.514176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa7490-52a3-49aa-87b9-429961dbce22 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:33.522201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9390f6-21b3-4c2f-8f70-447240f2458d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:33.531482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:33.555229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cf36e-b160-4d36-b075-80a7501adc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:33.555881 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf36e-b160-4d36-b075-80a7501adc61 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:33.556156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf36e-b160-4d36-b075-80a7501adc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:33.556429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf36e-b160-4d36-b075-80a7501adc61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:33.567039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cf36e-b160-4d36-b075-80a7501adc61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:33.568412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cf36e-b160-4d36-b075-80a7501adc61 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:33.571872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-607cf36e-b160-4d36-b075-80a7501adc61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:33.582810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:33.583935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:33.584769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:33.584769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:33.584769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:33.584769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 259/510] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:33.584769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cf36e-b160-4d36-b075-80a7501adc61 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:33.614422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa7490-52a3-49aa-87b9-429961dbce22 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:33.648716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736a9e-15ec-4679-840f-27e396aeab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:33.649337 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736a9e-15ec-4679-840f-27e396aeab08 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:33.649608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736a9e-15ec-4679-840f-27e396aeab08 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:33.649876 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736a9e-15ec-4679-840f-27e396aeab08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:33.659978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de736a9e-15ec-4679-840f-27e396aeab08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:33.661415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de736a9e-15ec-4679-840f-27e396aeab08 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-de736a9e-15ec-4679-840f-27e396aeab08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:33.675053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:33.675942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:33.676820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:33.676820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:33.676820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:33.676820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 252/511] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:33.677232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736a9e-15ec-4679-840f-27e396aeab08 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:33.683746 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cf36e-b160-4d36-b075-80a7501adc61 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:33.716930 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b3a19-6055-4fa2-8949-8a5961c65240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:33.717549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b3a19-6055-4fa2-8949-8a5961c65240 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:33.717826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b3a19-6055-4fa2-8949-8a5961c65240 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:33.718098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b3a19-6055-4fa2-8949-8a5961c65240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:33.728325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b3a19-6055-4fa2-8949-8a5961c65240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:33.729924 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b3a19-6055-4fa2-8949-8a5961c65240 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-841b3a19-6055-4fa2-8949-8a5961c65240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:33.743739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:33.744698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:33.745548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:33.745548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:33.745548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:33.745548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 260/512] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:33.745548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b3a19-6055-4fa2-8949-8a5961c65240 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:33.760266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:33.775097 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736a9e-15ec-4679-840f-27e396aeab08 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:33.787314 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:33.807457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946122-86e5-40fe-9ee4-6e32523f247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:33.808054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946122-86e5-40fe-9ee4-6e32523f247f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:33.808329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946122-86e5-40fe-9ee4-6e32523f247f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:33.808596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946122-86e5-40fe-9ee4-6e32523f247f None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:33.809227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12946122-86e5-40fe-9ee4-6e32523f247f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:33.810048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12946122-86e5-40fe-9ee4-6e32523f247f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:33.811449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12946122-86e5-40fe-9ee4-6e32523f247f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:33.823640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 253/513] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:33.824361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946122-86e5-40fe-9ee4-6e32523f247f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:33.848389 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b3a19-6055-4fa2-8949-8a5961c65240 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:33.881516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffcb97-42ac-454b-b5a4-c372c9b28f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:33.882138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffcb97-42ac-454b-b5a4-c372c9b28f31 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:33.882414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffcb97-42ac-454b-b5a4-c372c9b28f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:33.886339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffcb97-42ac-454b-b5a4-c372c9b28f31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:33.893814 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffcb97-42ac-454b-b5a4-c372c9b28f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:33.895298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffcb97-42ac-454b-b5a4-c372c9b28f31 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-29ffcb97-42ac-454b-b5a4-c372c9b28f31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:33.908952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:33.909893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:33.910835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:33.910835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:33.910835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:33.910835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 261/514] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:33.910835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffcb97-42ac-454b-b5a4-c372c9b28f31 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:33.922298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946122-86e5-40fe-9ee4-6e32523f247f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:33.956976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827907af-3b15-450d-8575-fb9665c27f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:33.957576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827907af-3b15-450d-8575-fb9665c27f01 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:33.957854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827907af-3b15-450d-8575-fb9665c27f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:33.958128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827907af-3b15-450d-8575-fb9665c27f01 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:33.958774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827907af-3b15-450d-8575-fb9665c27f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:33.959081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827907af-3b15-450d-8575-fb9665c27f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:33.960489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827907af-3b15-450d-8575-fb9665c27f01 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:33.971175 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:33.971514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 254/515] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:33.972300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827907af-3b15-450d-8575-fb9665c27f01 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.002190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:34.011924 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffcb97-42ac-454b-b5a4-c372c9b28f31 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.045160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d260c-d806-45a9-86df-33b28185f03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.045779 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d260c-d806-45a9-86df-33b28185f03b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.046052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d260c-d806-45a9-86df-33b28185f03b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.046324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d260c-d806-45a9-86df-33b28185f03b None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:34.047015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d260c-d806-45a9-86df-33b28185f03b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:34.047320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d260c-d806-45a9-86df-33b28185f03b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:34.048816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d260c-d806-45a9-86df-33b28185f03b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:34.061362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 262/516] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:34.062161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d260c-d806-45a9-86df-33b28185f03b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.069507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827907af-3b15-450d-8575-fb9665c27f01 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.102587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ca55-4c83-4a3d-a725-f5c239d9e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.103157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ca55-4c83-4a3d-a725-f5c239d9e046 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.103432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ca55-4c83-4a3d-a725-f5c239d9e046 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.103704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ca55-4c83-4a3d-a725-f5c239d9e046 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:34.104332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2ca55-4c83-4a3d-a725-f5c239d9e046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:34.104631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2ca55-4c83-4a3d-a725-f5c239d9e046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:34.105991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2ca55-4c83-4a3d-a725-f5c239d9e046 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:34.117265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 255/517] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:34.118184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ca55-4c83-4a3d-a725-f5c239d9e046 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.163462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d260c-d806-45a9-86df-33b28185f03b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.187068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:34.197500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e5b23-0353-4444-bc0b-2364f98974b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.200217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5b23-0353-4444-bc0b-2364f98974b7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.200217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5b23-0353-4444-bc0b-2364f98974b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.200217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5b23-0353-4444-bc0b-2364f98974b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:34.205526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e5b23-0353-4444-bc0b-2364f98974b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:34.206793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:34.206995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e5b23-0353-4444-bc0b-2364f98974b7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:34.215199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ca55-4c83-4a3d-a725-f5c239d9e046 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c87e5b23-0353-4444-bc0b-2364f98974b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:34.218135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:34.219049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 263/518] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:34.224678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e5b23-0353-4444-bc0b-2364f98974b7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.249392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e965c87-ac49-433b-8b7b-907098fc659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.249990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e965c87-ac49-433b-8b7b-907098fc659d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.250264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e965c87-ac49-433b-8b7b-907098fc659d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.250534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e965c87-ac49-433b-8b7b-907098fc659d None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:34.251194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e965c87-ac49-433b-8b7b-907098fc659d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:34.251492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e965c87-ac49-433b-8b7b-907098fc659d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:34.252869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e965c87-ac49-433b-8b7b-907098fc659d None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:34.264994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 256/519] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:34.265783 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e965c87-ac49-433b-8b7b-907098fc659d None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.328522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e5b23-0353-4444-bc0b-2364f98974b7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.362297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916144a-4349-4286-82bb-7c747816d04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.362851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916144a-4349-4286-82bb-7c747816d04f None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.363128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916144a-4349-4286-82bb-7c747816d04f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.363404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916144a-4349-4286-82bb-7c747816d04f None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:34.364042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916144a-4349-4286-82bb-7c747816d04f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:34.365462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916144a-4349-4286-82bb-7c747816d04f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:34.368817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e965c87-ac49-433b-8b7b-907098fc659d None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.401669 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f5e51-131f-4f6d-84d8-d4a1f92839ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.402291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f5e51-131f-4f6d-84d8-d4a1f92839ad None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.402570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f5e51-131f-4f6d-84d8-d4a1f92839ad None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.402876 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f5e51-131f-4f6d-84d8-d4a1f92839ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:34.409891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f5e51-131f-4f6d-84d8-d4a1f92839ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:34.411378 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f5e51-131f-4f6d-84d8-d4a1f92839ad None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-963f5e51-131f-4f6d-84d8-d4a1f92839ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:34.423765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:34.424888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:34.426445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:34.426445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:34.426445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:34.426445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:34.426445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:34.426445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:34.426445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:34.426445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:34.426445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 257/520] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:34.426445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f5e51-131f-4f6d-84d8-d4a1f92839ad None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.440395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:34.453761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 264/521] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:59:34 2022] POST /identity/v3/users => generated 247 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:59:34.454680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916144a-4349-4286-82bb-7c747816d04f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.503242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:34.534053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f5e51-131f-4f6d-84d8-d4a1f92839ad None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.572488 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa0d35-8881-42b3-89db-8a34799f5cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.573296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0d35-8881-42b3-89db-8a34799f5cbf None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.573686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0d35-8881-42b3-89db-8a34799f5cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.573963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0d35-8881-42b3-89db-8a34799f5cbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:34.579806 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916144a-4349-4286-82bb-7c747816d04f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.581265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa0d35-8881-42b3-89db-8a34799f5cbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:34.582826 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa0d35-8881-42b3-89db-8a34799f5cbf None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-49fa0d35-8881-42b3-89db-8a34799f5cbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:34.595553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:34.596501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:34.597450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:34.597450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:34.597450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:34.597450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:34.597450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:34.597450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:34.597450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:34.597450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:34.601991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 258/522] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:34.602992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa0d35-8881-42b3-89db-8a34799f5cbf None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.627126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f25170-fb59-49cc-ba67-d12f672cf64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.627661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f25170-fb59-49cc-ba67-d12f672cf64e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.627945 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f25170-fb59-49cc-ba67-d12f672cf64e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.628249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f25170-fb59-49cc-ba67-d12f672cf64e None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:34.630102 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f25170-fb59-49cc-ba67-d12f672cf64e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:34.630102 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f25170-fb59-49cc-ba67-d12f672cf64e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:34.631512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f25170-fb59-49cc-ba67-d12f672cf64e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:34.650451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 265/523] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 8 15:59:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:34.651566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f25170-fb59-49cc-ba67-d12f672cf64e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.683089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:34.716388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa0d35-8881-42b3-89db-8a34799f5cbf None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.752764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddfb03-47ee-4e06-ba02-57246c292631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.753395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddfb03-47ee-4e06-ba02-57246c292631 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.753673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddfb03-47ee-4e06-ba02-57246c292631 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.753946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddfb03-47ee-4e06-ba02-57246c292631 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:34.757166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:34.761006 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f25170-fb59-49cc-ba67-d12f672cf64e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.761501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddfb03-47ee-4e06-ba02-57246c292631 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:34.763545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddfb03-47ee-4e06-ba02-57246c292631 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-a8ddfb03-47ee-4e06-ba02-57246c292631 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:34.775898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:34.777021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 259/524] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:34.777901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddfb03-47ee-4e06-ba02-57246c292631 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.806096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb901a6-af7e-46a4-9dbb-7cb0f5ef229e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.806952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb901a6-af7e-46a4-9dbb-7cb0f5ef229e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.807399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb901a6-af7e-46a4-9dbb-7cb0f5ef229e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.807668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb901a6-af7e-46a4-9dbb-7cb0f5ef229e None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:34.808351 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb901a6-af7e-46a4-9dbb-7cb0f5ef229e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:34.808649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb901a6-af7e-46a4-9dbb-7cb0f5ef229e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:34.810300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb901a6-af7e-46a4-9dbb-7cb0f5ef229e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:34.834656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 266/525] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:34.834656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb901a6-af7e-46a4-9dbb-7cb0f5ef229e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.888449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddfb03-47ee-4e06-ba02-57246c292631 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.922349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:34.928044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362199f6-e84c-4018-85d4-8b748eba7287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.928599 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362199f6-e84c-4018-85d4-8b748eba7287 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.928877 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362199f6-e84c-4018-85d4-8b748eba7287 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.929148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362199f6-e84c-4018-85d4-8b748eba7287 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:34.929838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362199f6-e84c-4018-85d4-8b748eba7287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:34.930147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362199f6-e84c-4018-85d4-8b748eba7287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:34.931650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362199f6-e84c-4018-85d4-8b748eba7287 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:34.943333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb901a6-af7e-46a4-9dbb-7cb0f5ef229e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:34.954377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 260/526] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:34.954377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362199f6-e84c-4018-85d4-8b748eba7287 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:34.983564 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed01a8-5419-4553-b3ca-a7b4fa7e7b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:34.984174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed01a8-5419-4553-b3ca-a7b4fa7e7b6e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:34.984450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed01a8-5419-4553-b3ca-a7b4fa7e7b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:34.984722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed01a8-5419-4553-b3ca-a7b4fa7e7b6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:35.012156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:35.061175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362199f6-e84c-4018-85d4-8b748eba7287 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:35.066292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed01a8-5419-4553-b3ca-a7b4fa7e7b6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:35.068005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed01a8-5419-4553-b3ca-a7b4fa7e7b6e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:35.095436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca71f3-a09d-41a4-b9c5-562a94cce895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:35.096048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca71f3-a09d-41a4-b9c5-562a94cce895 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:35.096328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca71f3-a09d-41a4-b9c5-562a94cce895 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:35.096599 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca71f3-a09d-41a4-b9c5-562a94cce895 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:35.097325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca71f3-a09d-41a4-b9c5-562a94cce895 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:35.097630 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca71f3-a09d-41a4-b9c5-562a94cce895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:35.099108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca71f3-a09d-41a4-b9c5-562a94cce895 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:35.116055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 261/527] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 8 15:59:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:35.116848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca71f3-a09d-41a4-b9c5-562a94cce895 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:35.172523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:35.182339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 267/528] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:35.183126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed01a8-5419-4553-b3ca-a7b4fa7e7b6e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:35.228711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca71f3-a09d-41a4-b9c5-562a94cce895 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:35.245255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:35.268030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2df93-e800-4810-8afa-64ecf6ae7a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:35.268638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2df93-e800-4810-8afa-64ecf6ae7a1f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:35.268963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2df93-e800-4810-8afa-64ecf6ae7a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:35.269175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2df93-e800-4810-8afa-64ecf6ae7a1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:35.269969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2df93-e800-4810-8afa-64ecf6ae7a1f None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=41f7a6292d004a648c3c92526d1304ec) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:35.270246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2df93-e800-4810-8afa-64ecf6ae7a1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:35.271726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2df93-e800-4810-8afa-64ecf6ae7a1f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:35.286985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 262/529] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:35 2022] GET /identity/v3/role_assignments?user.id=41f7a6292d004a648c3c92526d1304ec&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:35.286985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2df93-e800-4810-8afa-64ecf6ae7a1f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:35.300492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed01a8-5419-4553-b3ca-a7b4fa7e7b6e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:35.353677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf669-fc04-4a7d-b117-0d35f4ecd653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:35.354442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf669-fc04-4a7d-b117-0d35f4ecd653 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:35.355425 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf669-fc04-4a7d-b117-0d35f4ecd653 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:35.355701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf669-fc04-4a7d-b117-0d35f4ecd653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:35.356791 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf669-fc04-4a7d-b117-0d35f4ecd653 None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=d0892bfab3ce435b90b93b0786899f84) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:35.357104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf669-fc04-4a7d-b117-0d35f4ecd653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:35.359872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf669-fc04-4a7d-b117-0d35f4ecd653 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:35.367313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 268/530] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:35 2022] GET /identity/v3/role_assignments?user.id=d0892bfab3ce435b90b93b0786899f84&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:35.368676 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf669-fc04-4a7d-b117-0d35f4ecd653 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:35.424665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2df93-e800-4810-8afa-64ecf6ae7a1f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:35.450405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:35.497835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05706dd0-ba6b-4c8b-96e0-9133a21d6e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:35.498464 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706dd0-ba6b-4c8b-96e0-9133a21d6e41 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:35.498762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706dd0-ba6b-4c8b-96e0-9133a21d6e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:35.499035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706dd0-ba6b-4c8b-96e0-9133a21d6e41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:35.580525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf669-fc04-4a7d-b117-0d35f4ecd653 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:35.609121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:35.618713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05706dd0-ba6b-4c8b-96e0-9133a21d6e41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:35.618713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05706dd0-ba6b-4c8b-96e0-9133a21d6e41 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:35.638788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81d74b-2dc0-468e-8007-6e09b82d990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:35.640512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d74b-2dc0-468e-8007-6e09b82d990b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:35.642945 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d74b-2dc0-468e-8007-6e09b82d990b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:35.644222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d74b-2dc0-468e-8007-6e09b82d990b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:35.667065 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81d74b-2dc0-468e-8007-6e09b82d990b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:35.669413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81d74b-2dc0-468e-8007-6e09b82d990b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4c81d74b-2dc0-468e-8007-6e09b82d990b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:35.700953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:35.702080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:35.703157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:35.703157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:35.703157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:35.705249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 269/531] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:35.711030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81d74b-2dc0-468e-8007-6e09b82d990b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:35.826215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81d74b-2dc0-468e-8007-6e09b82d990b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:35.829452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 263/532] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:35.834479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05706dd0-ba6b-4c8b-96e0-9133a21d6e41 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:35.864534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ece416-5edb-4403-96f6-0f8571165b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:35.865206 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ece416-5edb-4403-96f6-0f8571165b7f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:35.865486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ece416-5edb-4403-96f6-0f8571165b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:35.865757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ece416-5edb-4403-96f6-0f8571165b7f None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:35.866394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ece416-5edb-4403-96f6-0f8571165b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:35.866717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ece416-5edb-4403-96f6-0f8571165b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:35.868136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:35.869707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ece416-5edb-4403-96f6-0f8571165b7f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:35.883634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 270/533] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:35.895796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ece416-5edb-4403-96f6-0f8571165b7f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:35.959788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:35.978401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05706dd0-ba6b-4c8b-96e0-9133a21d6e41 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:36.040227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce4a4e-004c-461c-9e72-b7da71149e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:36.040865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce4a4e-004c-461c-9e72-b7da71149e66 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:36.041144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce4a4e-004c-461c-9e72-b7da71149e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:36.041415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce4a4e-004c-461c-9e72-b7da71149e66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:36.059757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce4a4e-004c-461c-9e72-b7da71149e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:36.061236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce4a4e-004c-461c-9e72-b7da71149e66 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:36.066391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ece416-5edb-4403-96f6-0f8571165b7f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-50ce4a4e-004c-461c-9e72-b7da71149e66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:36.091417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:36.092350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:36.093179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:36.093179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:36.093179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:36.093765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 264/534] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:36.101084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce4a4e-004c-461c-9e72-b7da71149e66 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:36.145263 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2817d75-992b-42cd-b65e-d79d21588450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:36.145911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2817d75-992b-42cd-b65e-d79d21588450 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:36.146188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2817d75-992b-42cd-b65e-d79d21588450 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:36.146457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2817d75-992b-42cd-b65e-d79d21588450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:36.164454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2817d75-992b-42cd-b65e-d79d21588450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:36.166722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2817d75-992b-42cd-b65e-d79d21588450 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a2817d75-992b-42cd-b65e-d79d21588450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:36.194143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:36.195095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:36.196018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:36.196018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:36.196018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:36.196018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:36.196018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:36.196018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:36.196018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:36.196018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:36.196428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 271/535] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:36.205520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2817d75-992b-42cd-b65e-d79d21588450 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:36.206066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:36.250391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce4a4e-004c-461c-9e72-b7da71149e66 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:36.290112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dcdee-ed77-4a19-8da9-eb2b48f6cab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:36.290897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcdee-ed77-4a19-8da9-eb2b48f6cab4 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:36.291173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcdee-ed77-4a19-8da9-eb2b48f6cab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:36.291443 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcdee-ed77-4a19-8da9-eb2b48f6cab4 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:36.292089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dcdee-ed77-4a19-8da9-eb2b48f6cab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:36.292390 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dcdee-ed77-4a19-8da9-eb2b48f6cab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:36.298659 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dcdee-ed77-4a19-8da9-eb2b48f6cab4 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:36.308223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 265/536] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:36.314594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dcdee-ed77-4a19-8da9-eb2b48f6cab4 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:36.440930 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:36.452559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2817d75-992b-42cd-b65e-d79d21588450 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:36.494403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dcdee-ed77-4a19-8da9-eb2b48f6cab4 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:36.498943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce1df3-439e-4a8e-97fe-5e0b3174aef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:36.499993 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce1df3-439e-4a8e-97fe-5e0b3174aef9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:36.500532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce1df3-439e-4a8e-97fe-5e0b3174aef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:36.501090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce1df3-439e-4a8e-97fe-5e0b3174aef9 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:36.501963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce1df3-439e-4a8e-97fe-5e0b3174aef9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:36.502528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce1df3-439e-4a8e-97fe-5e0b3174aef9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:36.504495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce1df3-439e-4a8e-97fe-5e0b3174aef9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:36.518163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 272/537] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:36.527663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce1df3-439e-4a8e-97fe-5e0b3174aef9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:36.556805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:36.572835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e38017-7f7c-4a8a-b7ab-cdd700945e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:36.573475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e38017-7f7c-4a8a-b7ab-cdd700945e0a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:36.573750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e38017-7f7c-4a8a-b7ab-cdd700945e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:36.574019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e38017-7f7c-4a8a-b7ab-cdd700945e0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:36.588785 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e38017-7f7c-4a8a-b7ab-cdd700945e0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:36.590307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e38017-7f7c-4a8a-b7ab-cdd700945e0a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-61e38017-7f7c-4a8a-b7ab-cdd700945e0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:36.611797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:36.612653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:36.613505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:36.613505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:36.613505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:36.613505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:36.613505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:36.613505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:36.613505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:36.613505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:36.613505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 266/538] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:36.618899 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e38017-7f7c-4a8a-b7ab-cdd700945e0a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:36.755527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e38017-7f7c-4a8a-b7ab-cdd700945e0a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:36.758633 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce1df3-439e-4a8e-97fe-5e0b3174aef9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:36.797526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89189842-9581-4f65-98d4-36ff00f9da33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:36.798139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89189842-9581-4f65-98d4-36ff00f9da33 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:36.798415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89189842-9581-4f65-98d4-36ff00f9da33 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:36.798699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89189842-9581-4f65-98d4-36ff00f9da33 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:36.801722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89189842-9581-4f65-98d4-36ff00f9da33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:36.802031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89189842-9581-4f65-98d4-36ff00f9da33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:36.803514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89189842-9581-4f65-98d4-36ff00f9da33 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:36.830110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 267/539] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:36.831418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03dff1-68d4-4f17-a0c0-3ff3f4ee7265 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:36.831702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03dff1-68d4-4f17-a0c0-3ff3f4ee7265 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:36.831973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03dff1-68d4-4f17-a0c0-3ff3f4ee7265 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:36.833376 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 268/540] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:36.836090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06b954-3755-472a-86b3-a4af470e75d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:36.836772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06b954-3755-472a-86b3-a4af470e75d7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:36.837224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06b954-3755-472a-86b3-a4af470e75d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:36.837406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06b954-3755-472a-86b3-a4af470e75d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:36.837909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03dff1-68d4-4f17-a0c0-3ff3f4ee7265 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:36.838094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06b954-3755-472a-86b3-a4af470e75d7 None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=e1d9c18139104883848f3ba22b38b360) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:36.838506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06b954-3755-472a-86b3-a4af470e75d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:36.840068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06b954-3755-472a-86b3-a4af470e75d7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:36.847893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 273/541] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:36 2022] GET /identity/v3/role_assignments?user.id=e1d9c18139104883848f3ba22b38b360&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:36.852723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2f939-d561-4a07-86c2-af4a51eb0509 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:36.852998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2f939-d561-4a07-86c2-af4a51eb0509 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:36.853270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2f939-d561-4a07-86c2-af4a51eb0509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:36.893036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d3c2f939-d561-4a07-86c2-af4a51eb0509 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:36.894269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d3c2f939-d561-4a07-86c2-af4a51eb0509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:36.916011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:36.933178 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:36.978372 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 274/542] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:37.040051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03dff1-68d4-4f17-a0c0-3ff3f4ee7265 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:37.080129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a046d-fe99-4e7c-91d4-b625a3917d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:37.080735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a046d-fe99-4e7c-91d4-b625a3917d24 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:37.081010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a046d-fe99-4e7c-91d4-b625a3917d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:37.081283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a046d-fe99-4e7c-91d4-b625a3917d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:37.082000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a046d-fe99-4e7c-91d4-b625a3917d24 None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=e08c9de660c04ed98f6100be2d687ea6) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:37.082362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a046d-fe99-4e7c-91d4-b625a3917d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:37.083902 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a046d-fe99-4e7c-91d4-b625a3917d24 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:37.089568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 269/543] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:36 2022] GET /identity/v3/role_assignments?user.id=e08c9de660c04ed98f6100be2d687ea6&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:37.313886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2f939-d561-4a07-86c2-af4a51eb0509 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:37.419195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2f939-d561-4a07-86c2-af4a51eb0509 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:37.456373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796beaeb-db83-4b92-85f5-bcaca1901d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:37.456999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796beaeb-db83-4b92-85f5-bcaca1901d29 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:37.457266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796beaeb-db83-4b92-85f5-bcaca1901d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:37.457529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796beaeb-db83-4b92-85f5-bcaca1901d29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:37.468713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796beaeb-db83-4b92-85f5-bcaca1901d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-796beaeb-db83-4b92-85f5-bcaca1901d29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:37.473520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:37.474393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:37.475616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 275/544] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:37.483733 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a046d-fe99-4e7c-91d4-b625a3917d24 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:37.609076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a046d-fe99-4e7c-91d4-b625a3917d24 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:37.619812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:37.645453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ffa56-5a6f-4442-878e-1dcf236623ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:37.646067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ffa56-5a6f-4442-878e-1dcf236623ec None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:37.646345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ffa56-5a6f-4442-878e-1dcf236623ec None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:37.646613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ffa56-5a6f-4442-878e-1dcf236623ec None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:37.650209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ffa56-5a6f-4442-878e-1dcf236623ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:37.650209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ffa56-5a6f-4442-878e-1dcf236623ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:37.650209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ffa56-5a6f-4442-878e-1dcf236623ec None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:37.660574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 270/545] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:37.665854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796beaeb-db83-4b92-85f5-bcaca1901d29 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:37.689338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:37.804601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0499b-1efa-4994-915b-f2a6f23f6789 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:37.804927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0499b-1efa-4994-915b-f2a6f23f6789 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:37.805138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0499b-1efa-4994-915b-f2a6f23f6789 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:37.806458 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 271/546] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:37.820090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1aad5-bc59-4b35-9b71-0c165eff0014 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:37.820437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1aad5-bc59-4b35-9b71-0c165eff0014 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:37.820615 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1aad5-bc59-4b35-9b71-0c165eff0014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:37.821278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796beaeb-db83-4b92-85f5-bcaca1901d29 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:37.846472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b9c1aad5-bc59-4b35-9b71-0c165eff0014 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:37.848617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b9c1aad5-bc59-4b35-9b71-0c165eff0014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:37.880822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c09605-e7e2-4255-9fa9-2f2bbf81938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:37.881524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09605-e7e2-4255-9fa9-2f2bbf81938b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:37.881839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09605-e7e2-4255-9fa9-2f2bbf81938b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:37.882444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09605-e7e2-4255-9fa9-2f2bbf81938b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:37.895974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c09605-e7e2-4255-9fa9-2f2bbf81938b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:37.897428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c09605-e7e2-4255-9fa9-2f2bbf81938b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f5c09605-e7e2-4255-9fa9-2f2bbf81938b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:37.913532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:37.914440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:37.916032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:37.916032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:37.916032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:37.916032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 276/547] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:37.916270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f91c24-01c1-412c-ba57-9f494911a6d4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:37.916492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f91c24-01c1-412c-ba57-9f494911a6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:37.916730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f91c24-01c1-412c-ba57-9f494911a6d4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:37.918088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 277/548] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:37.922703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f91c24-01c1-412c-ba57-9f494911a6d4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:37.989154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:37.995110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 272/549] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:38.002728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9eef-3129-4521-a2e5-d2961ce4e55b None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:38.002728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9eef-3129-4521-a2e5-d2961ce4e55b None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:38.002728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9eef-3129-4521-a2e5-d2961ce4e55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:38.020526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b49f9eef-3129-4521-a2e5-d2961ce4e55b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:38.021529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b49f9eef-3129-4521-a2e5-d2961ce4e55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:38.076328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f91c24-01c1-412c-ba57-9f494911a6d4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:38.124176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bf12e-78e7-4e69-8b47-8b2a4b6dec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:38.124813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bf12e-78e7-4e69-8b47-8b2a4b6dec56 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:38.125144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bf12e-78e7-4e69-8b47-8b2a4b6dec56 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:38.125424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bf12e-78e7-4e69-8b47-8b2a4b6dec56 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:38.126159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bf12e-78e7-4e69-8b47-8b2a4b6dec56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:38.126508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bf12e-78e7-4e69-8b47-8b2a4b6dec56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:38.127952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bf12e-78e7-4e69-8b47-8b2a4b6dec56 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:38.140956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 278/550] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:38.146660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bf12e-78e7-4e69-8b47-8b2a4b6dec56 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:38.163892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 273/551] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:38.297021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bf12e-78e7-4e69-8b47-8b2a4b6dec56 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:38.315376 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f9eef-3129-4521-a2e5-d2961ce4e55b None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:38.323173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:38.332284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c056786-5022-45a3-9dfa-84b2250a2b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:38.333110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c056786-5022-45a3-9dfa-84b2250a2b17 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:38.333219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c056786-5022-45a3-9dfa-84b2250a2b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:38.333488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c056786-5022-45a3-9dfa-84b2250a2b17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:38.341996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c056786-5022-45a3-9dfa-84b2250a2b17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:38.343736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c056786-5022-45a3-9dfa-84b2250a2b17 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:38.349782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3c056786-5022-45a3-9dfa-84b2250a2b17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:38.357965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:38.359013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:38.359899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:38.359899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:38.359899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:38.359899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:38.359899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:38.359899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:38.359899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:38.359899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:38.359899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 15:59:38.359899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:38.365246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 279/552] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:59:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:38.372089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c056786-5022-45a3-9dfa-84b2250a2b17 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:38.427808 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f9eef-3129-4521-a2e5-d2961ce4e55b None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:38.463274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34162216-2f4c-4fb5-986d-467efd94daea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:38.464216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34162216-2f4c-4fb5-986d-467efd94daea None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:38.464722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34162216-2f4c-4fb5-986d-467efd94daea None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:38.465186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34162216-2f4c-4fb5-986d-467efd94daea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:38.484413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34162216-2f4c-4fb5-986d-467efd94daea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-34162216-2f4c-4fb5-986d-467efd94daea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:38.489711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:38.490592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:38.491422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:38.494287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 274/553] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:38.500827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34162216-2f4c-4fb5-986d-467efd94daea None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:38.519937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c056786-5022-45a3-9dfa-84b2250a2b17 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:38.557088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de59f2c-d9dc-42f6-af26-7cbc622e695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:38.557729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de59f2c-d9dc-42f6-af26-7cbc622e695a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:38.558013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de59f2c-d9dc-42f6-af26-7cbc622e695a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:38.558271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de59f2c-d9dc-42f6-af26-7cbc622e695a None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:38.559888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de59f2c-d9dc-42f6-af26-7cbc622e695a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:38.559996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de59f2c-d9dc-42f6-af26-7cbc622e695a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:38.561502 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de59f2c-d9dc-42f6-af26-7cbc622e695a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:38.595586 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 280/554] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Sep 8 15:59:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:38.596569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de59f2c-d9dc-42f6-af26-7cbc622e695a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:38.601052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:38.610637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34162216-2f4c-4fb5-986d-467efd94daea None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:38.648656 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721a0a-4506-4016-a4ba-97b592f457ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:38.649359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721a0a-4506-4016-a4ba-97b592f457ef None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:38.649704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721a0a-4506-4016-a4ba-97b592f457ef None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:38.650043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721a0a-4506-4016-a4ba-97b592f457ef None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:38.650799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69721a0a-4506-4016-a4ba-97b592f457ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:38.651229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69721a0a-4506-4016-a4ba-97b592f457ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:38.652580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:38.652805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69721a0a-4506-4016-a4ba-97b592f457ef None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:38.663228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 275/555] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:38.663986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721a0a-4506-4016-a4ba-97b592f457ef None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:38.781981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de59f2c-d9dc-42f6-af26-7cbc622e695a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:38.798456 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721a0a-4506-4016-a4ba-97b592f457ef None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:38.818938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2e90-2c94-454e-a9cc-fbe0273a6f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:38.819646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2e90-2c94-454e-a9cc-fbe0273a6f60 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:38.819991 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2e90-2c94-454e-a9cc-fbe0273a6f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:38.820556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2e90-2c94-454e-a9cc-fbe0273a6f60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:38.831361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab2e90-2c94-454e-a9cc-fbe0273a6f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:38.834759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391a5de-9e64-49be-a04b-092ed7fa6c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:38.835518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391a5de-9e64-49be-a04b-092ed7fa6c06 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:38.836003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391a5de-9e64-49be-a04b-092ed7fa6c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-90ab2e90-2c94-454e-a9cc-fbe0273a6f60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:38.836419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:38.837483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:38.838559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:38.839348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391a5de-9e64-49be-a04b-092ed7fa6c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:38.845021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 281/556] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:38.845021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2e90-2c94-454e-a9cc-fbe0273a6f60 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:38.873803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:38.927587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391a5de-9e64-49be-a04b-092ed7fa6c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:38.929048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391a5de-9e64-49be-a04b-092ed7fa6c06 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:38.967664 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:38.973190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2e90-2c94-454e-a9cc-fbe0273a6f60 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:39.028438 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4e5e6-a6a4-4edf-9c82-7833c1f96748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:39.030317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e5e6-a6a4-4edf-9c82-7833c1f96748 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.030854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e5e6-a6a4-4edf-9c82-7833c1f96748 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.031347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e5e6-a6a4-4edf-9c82-7833c1f96748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.048509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4e5e6-a6a4-4edf-9c82-7833c1f96748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:39.051781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 276/557] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:39.052267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4e5e6-a6a4-4edf-9c82-7833c1f96748 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:39.052730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391a5de-9e64-49be-a04b-092ed7fa6c06 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-2ed4e5e6-a6a4-4edf-9c82-7833c1f96748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:39.072491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:39.073497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:39.074378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:39.074378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:39.074378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:39.076633 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 282/558] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:39.077647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4e5e6-a6a4-4edf-9c82-7833c1f96748 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:39.129221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:39.189635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391a5de-9e64-49be-a04b-092ed7fa6c06 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:39.197193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4e5e6-a6a4-4edf-9c82-7833c1f96748 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:39.232995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311906b8-0051-438e-a641-2fdc0fb0c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:39.233763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311906b8-0051-438e-a641-2fdc0fb0c0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.234134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311906b8-0051-438e-a641-2fdc0fb0c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.234501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311906b8-0051-438e-a641-2fdc0fb0c0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.235290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311906b8-0051-438e-a641-2fdc0fb0c0c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:39.235724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311906b8-0051-438e-a641-2fdc0fb0c0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:39.237174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311906b8-0051-438e-a641-2fdc0fb0c0c5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:39.237585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8870a5-b76e-41fd-a5ab-14175e598974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:39.238371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8870a5-b76e-41fd-a5ab-14175e598974 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.238825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8870a5-b76e-41fd-a5ab-14175e598974 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.239241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8870a5-b76e-41fd-a5ab-14175e598974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.246966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 277/559] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:39.248049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311906b8-0051-438e-a641-2fdc0fb0c0c5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:39.256426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8870a5-b76e-41fd-a5ab-14175e598974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:39.258090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8870a5-b76e-41fd-a5ab-14175e598974 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-bd8870a5-b76e-41fd-a5ab-14175e598974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:39.276485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:39.277673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:39.279184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:39.279184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:39.279184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:39.279711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 283/560] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:39.280707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8870a5-b76e-41fd-a5ab-14175e598974 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:39.283962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:39.367204 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311906b8-0051-438e-a641-2fdc0fb0c0c5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:39.390959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:39.397418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8870a5-b76e-41fd-a5ab-14175e598974 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:39.421506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452fb24-2440-4718-bc99-5310de46a1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:39.422131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452fb24-2440-4718-bc99-5310de46a1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.422414 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452fb24-2440-4718-bc99-5310de46a1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.422711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452fb24-2440-4718-bc99-5310de46a1c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.424284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452fb24-2440-4718-bc99-5310de46a1c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:39.424586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452fb24-2440-4718-bc99-5310de46a1c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:39.426858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452fb24-2440-4718-bc99-5310de46a1c6 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:39.442988 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 278/561] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:39.443873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452fb24-2440-4718-bc99-5310de46a1c6 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:39.453297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fed95-23a8-4a4f-93c2-7098a6814ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:39.454874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fed95-23a8-4a4f-93c2-7098a6814ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.455360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fed95-23a8-4a4f-93c2-7098a6814ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.455959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fed95-23a8-4a4f-93c2-7098a6814ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.471883 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fed95-23a8-4a4f-93c2-7098a6814ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:39.473745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fed95-23a8-4a4f-93c2-7098a6814ea7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b83fed95-23a8-4a4f-93c2-7098a6814ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:39.495011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:39.496050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:39.496988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:39.496988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:39.496988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:39.503952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 284/562] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:39.503952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fed95-23a8-4a4f-93c2-7098a6814ea7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:39.559644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452fb24-2440-4718-bc99-5310de46a1c6 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:39.576417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:39.601100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072184b-b4ae-4135-834d-5f32a93418e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:39.601707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072184b-b4ae-4135-834d-5f32a93418e0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.601979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072184b-b4ae-4135-834d-5f32a93418e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.602248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072184b-b4ae-4135-834d-5f32a93418e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.602980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072184b-b4ae-4135-834d-5f32a93418e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:39.603284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072184b-b4ae-4135-834d-5f32a93418e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:39.604651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072184b-b4ae-4135-834d-5f32a93418e0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:39.619191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 279/563] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:39.619191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072184b-b4ae-4135-834d-5f32a93418e0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:39.634082 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fed95-23a8-4a4f-93c2-7098a6814ea7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:39.655634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:39.672994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d5d4b-8f83-412f-87ec-35160796ad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:39.673622 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5d4b-8f83-412f-87ec-35160796ad76 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.673898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5d4b-8f83-412f-87ec-35160796ad76 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.674164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d5d4b-8f83-412f-87ec-35160796ad76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.682025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d5d4b-8f83-412f-87ec-35160796ad76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:39.683495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d5d4b-8f83-412f-87ec-35160796ad76 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-089d5d4b-8f83-412f-87ec-35160796ad76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:39.695516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:39.696660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:39.697764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:39.697764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:39.697764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:39.697764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:39.697764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:39.697764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:39.697764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:39.697764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:39.697764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 15:59:39.697764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:39.698806 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 285/564] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Sep 8 15:59:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:39.700711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c31515-78b1-4a9c-8f9f-8a413c05e501 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.700993 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c31515-78b1-4a9c-8f9f-8a413c05e501 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.701264 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c31515-78b1-4a9c-8f9f-8a413c05e501 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.702503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 286/565] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:39.703217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c31515-78b1-4a9c-8f9f-8a413c05e501 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:39.723046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072184b-b4ae-4135-834d-5f32a93418e0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:39.756165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb35ab-fe5e-42bc-a32f-677b89c5810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:39.756771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb35ab-fe5e-42bc-a32f-677b89c5810a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.757047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb35ab-fe5e-42bc-a32f-677b89c5810a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.757323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb35ab-fe5e-42bc-a32f-677b89c5810a None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.757960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb35ab-fe5e-42bc-a32f-677b89c5810a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:39.758263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb35ab-fe5e-42bc-a32f-677b89c5810a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:39.759686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb35ab-fe5e-42bc-a32f-677b89c5810a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:39.772012 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 280/566] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:39.773234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bcb2b-fa0e-476a-9db1-72aff718fe4b None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.773520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bcb2b-fa0e-476a-9db1-72aff718fe4b None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.773793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bcb2b-fa0e-476a-9db1-72aff718fe4b None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.775161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 281/567] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:39.775834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bcb2b-fa0e-476a-9db1-72aff718fe4b None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:39.805902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c31515-78b1-4a9c-8f9f-8a413c05e501 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:39.819704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:39.839985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbacfe5-843c-4750-b34f-8e6bd3f1b067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:39.840615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbacfe5-843c-4750-b34f-8e6bd3f1b067 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.840894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbacfe5-843c-4750-b34f-8e6bd3f1b067 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.841167 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbacfe5-843c-4750-b34f-8e6bd3f1b067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.847620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbacfe5-843c-4750-b34f-8e6bd3f1b067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:39.849045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbacfe5-843c-4750-b34f-8e6bd3f1b067 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5fbacfe5-843c-4750-b34f-8e6bd3f1b067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:39.860867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:39.861765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:39.862688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:39.862688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:39.862688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:39.862688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:39.862688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:39.862688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:39.862688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:39.862688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:39.862688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 287/568] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:39.863189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bfdfd-0dac-4c56-b69e-12a2de09f718 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.863817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bfdfd-0dac-4c56-b69e-12a2de09f718 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.863817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bfdfd-0dac-4c56-b69e-12a2de09f718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.874362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:39.880938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bcb2b-fa0e-476a-9db1-72aff718fe4b None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:39.882062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-813bfdfd-0dac-4c56-b69e-12a2de09f718 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:39.886421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-813bfdfd-0dac-4c56-b69e-12a2de09f718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:39.915228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca8563-6b02-49ed-9cb2-ed7655c8e14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:39.915823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca8563-6b02-49ed-9cb2-ed7655c8e14b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.916099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca8563-6b02-49ed-9cb2-ed7655c8e14b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.916367 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca8563-6b02-49ed-9cb2-ed7655c8e14b None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.917141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca8563-6b02-49ed-9cb2-ed7655c8e14b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:39.917379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca8563-6b02-49ed-9cb2-ed7655c8e14b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:39.919383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca8563-6b02-49ed-9cb2-ed7655c8e14b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:39.940926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 282/569] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 8 15:59:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:39.942124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cfa3e-384e-4091-b9d7-b00316d964a6 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:39.942372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cfa3e-384e-4091-b9d7-b00316d964a6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:39.942645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cfa3e-384e-4091-b9d7-b00316d964a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:39.959527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-773cfa3e-384e-4091-b9d7-b00316d964a6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:39.960719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-773cfa3e-384e-4091-b9d7-b00316d964a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:39.962987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 288/570] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:39.963807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bfdfd-0dac-4c56-b69e-12a2de09f718 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.032920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 283/571] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:40.034008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cfa3e-384e-4091-b9d7-b00316d964a6 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.089493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bfdfd-0dac-4c56-b69e-12a2de09f718 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:40.091985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:40.127589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db65ca3-46a0-4372-a07a-9b537e20815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:40.128169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db65ca3-46a0-4372-a07a-9b537e20815b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:40.128446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db65ca3-46a0-4372-a07a-9b537e20815b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:40.128714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db65ca3-46a0-4372-a07a-9b537e20815b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:40.136559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db65ca3-46a0-4372-a07a-9b537e20815b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:40.137543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:40.139073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db65ca3-46a0-4372-a07a-9b537e20815b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5db65ca3-46a0-4372-a07a-9b537e20815b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:40.151197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:40.152729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 289/572] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:40.153747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db65ca3-46a0-4372-a07a-9b537e20815b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.159575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cfa3e-384e-4091-b9d7-b00316d964a6 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:40.210345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3dfd-daf1-42fb-9b43-8c8b440e146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:40.211136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3dfd-daf1-42fb-9b43-8c8b440e146a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:40.214702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3dfd-daf1-42fb-9b43-8c8b440e146a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:40.214702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3dfd-daf1-42fb-9b43-8c8b440e146a None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:40.214702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec3dfd-daf1-42fb-9b43-8c8b440e146a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:40.214702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec3dfd-daf1-42fb-9b43-8c8b440e146a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:40.215008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec3dfd-daf1-42fb-9b43-8c8b440e146a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:40.231845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 284/573] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:40.233092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3dfd-daf1-42fb-9b43-8c8b440e146a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.267544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db65ca3-46a0-4372-a07a-9b537e20815b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:40.305356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8124-3722-42cb-84e7-acffb561ad4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:40.306030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8124-3722-42cb-84e7-acffb561ad4b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:40.306303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8124-3722-42cb-84e7-acffb561ad4b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:40.306569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d8124-3722-42cb-84e7-acffb561ad4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:40.319742 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d8124-3722-42cb-84e7-acffb561ad4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:40.321183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d8124-3722-42cb-84e7-acffb561ad4b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6b6d8124-3722-42cb-84e7-acffb561ad4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:40.335532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:40.336647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:40.337530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:40.337530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:40.337530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:40.337530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 290/574] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:40.337530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8124-3722-42cb-84e7-acffb561ad4b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.341282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3dfd-daf1-42fb-9b43-8c8b440e146a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:40.357419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:40.374953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86ad8e-efa9-4e81-b8ba-9ba470c13445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:40.375559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86ad8e-efa9-4e81-b8ba-9ba470c13445 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:40.375837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86ad8e-efa9-4e81-b8ba-9ba470c13445 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:40.376107 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86ad8e-efa9-4e81-b8ba-9ba470c13445 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:40.376827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86ad8e-efa9-4e81-b8ba-9ba470c13445 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:40.377131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86ad8e-efa9-4e81-b8ba-9ba470c13445 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:40.378609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86ad8e-efa9-4e81-b8ba-9ba470c13445 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:40.395960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 285/575] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 8 15:59:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:40.397082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86ad8e-efa9-4e81-b8ba-9ba470c13445 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.399712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:40.444085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d8124-3722-42cb-84e7-acffb561ad4b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:40.476726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752c4b3-47d3-4fb0-bdb8-216a8249f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:40.477341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752c4b3-47d3-4fb0-bdb8-216a8249f655 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:40.477620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752c4b3-47d3-4fb0-bdb8-216a8249f655 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:40.477885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752c4b3-47d3-4fb0-bdb8-216a8249f655 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:40.488299 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752c4b3-47d3-4fb0-bdb8-216a8249f655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b752c4b3-47d3-4fb0-bdb8-216a8249f655 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:40.493440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:40.494358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:40.495254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 291/576] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:40.495951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752c4b3-47d3-4fb0-bdb8-216a8249f655 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.499634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86ad8e-efa9-4e81-b8ba-9ba470c13445 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:40.534543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816a1bd-4912-4723-9bcb-82aefdfd1115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:40.535167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816a1bd-4912-4723-9bcb-82aefdfd1115 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:40.535446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816a1bd-4912-4723-9bcb-82aefdfd1115 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:40.535721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816a1bd-4912-4723-9bcb-82aefdfd1115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:40.536437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816a1bd-4912-4723-9bcb-82aefdfd1115 None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=50c9553845ba42e78de0293fd3a338d1) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:40.536749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816a1bd-4912-4723-9bcb-82aefdfd1115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:40.538168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816a1bd-4912-4723-9bcb-82aefdfd1115 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:40.543898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 286/577] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:40 2022] GET /identity/v3/role_assignments?user.id=50c9553845ba42e78de0293fd3a338d1&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:40.544673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816a1bd-4912-4723-9bcb-82aefdfd1115 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.587431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:40.613900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752c4b3-47d3-4fb0-bdb8-216a8249f655 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:40.620429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:40.653507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d101da-3205-45df-812d-0aae6c651674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:40.654064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d101da-3205-45df-812d-0aae6c651674 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:40.654341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d101da-3205-45df-812d-0aae6c651674 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:40.654703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d101da-3205-45df-812d-0aae6c651674 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:40.660723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816a1bd-4912-4723-9bcb-82aefdfd1115 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:40.667082 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d101da-3205-45df-812d-0aae6c651674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-70d101da-3205-45df-812d-0aae6c651674 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:40.674616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:40.675663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:40.676537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 292/578] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:40.677251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d101da-3205-45df-812d-0aae6c651674 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.707550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f8ae3-c1e5-4252-908f-b98a4fa58438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:40.708174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f8ae3-c1e5-4252-908f-b98a4fa58438 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:40.708615 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f8ae3-c1e5-4252-908f-b98a4fa58438 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:40.708896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f8ae3-c1e5-4252-908f-b98a4fa58438 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:40.709883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f8ae3-c1e5-4252-908f-b98a4fa58438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:40.710983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f8ae3-c1e5-4252-908f-b98a4fa58438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:40.713517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f8ae3-c1e5-4252-908f-b98a4fa58438 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:40.726126 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 287/579] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:40.727009 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f8ae3-c1e5-4252-908f-b98a4fa58438 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.788416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d101da-3205-45df-812d-0aae6c651674 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:40.826938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796273f-8f17-45e8-b923-e82898d4ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:40.827627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796273f-8f17-45e8-b923-e82898d4ec3b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:40.827955 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796273f-8f17-45e8-b923-e82898d4ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:40.828278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796273f-8f17-45e8-b923-e82898d4ec3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:40.831330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:40.840257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796273f-8f17-45e8-b923-e82898d4ec3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:40.841722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796273f-8f17-45e8-b923-e82898d4ec3b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:40.842025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f8ae3-c1e5-4252-908f-b98a4fa58438 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9796273f-8f17-45e8-b923-e82898d4ec3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:40.856572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:40.860880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:40.861869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:40.861869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:40.861869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:40.861869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 293/580] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:40.861869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796273f-8f17-45e8-b923-e82898d4ec3b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.877877 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:40.886799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc56592-bb0e-4007-87a0-356c27479d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:40.887715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc56592-bb0e-4007-87a0-356c27479d07 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:40.888431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc56592-bb0e-4007-87a0-356c27479d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:40.888558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc56592-bb0e-4007-87a0-356c27479d07 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:40.889767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc56592-bb0e-4007-87a0-356c27479d07 None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:40.890166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc56592-bb0e-4007-87a0-356c27479d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:40.891943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc56592-bb0e-4007-87a0-356c27479d07 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:40.903332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 288/581] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:40.904278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc56592-bb0e-4007-87a0-356c27479d07 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:40.973285 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796273f-8f17-45e8-b923-e82898d4ec3b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.008423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc56592-bb0e-4007-87a0-356c27479d07 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.010983 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e56064-0ddb-4fe3-82b1-be2d5fa80a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.011601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56064-0ddb-4fe3-82b1-be2d5fa80a27 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.011899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56064-0ddb-4fe3-82b1-be2d5fa80a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.012180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56064-0ddb-4fe3-82b1-be2d5fa80a27 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.012850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56064-0ddb-4fe3-82b1-be2d5fa80a27 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:41.013154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56064-0ddb-4fe3-82b1-be2d5fa80a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.014541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56064-0ddb-4fe3-82b1-be2d5fa80a27 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:41.029031 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 294/582] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:41.029987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e56064-0ddb-4fe3-82b1-be2d5fa80a27 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:41.043103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502560a6-b8f7-4561-95e5-59d7ba2d7408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.044298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502560a6-b8f7-4561-95e5-59d7ba2d7408 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.044572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502560a6-b8f7-4561-95e5-59d7ba2d7408 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.044842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502560a6-b8f7-4561-95e5-59d7ba2d7408 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.051945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502560a6-b8f7-4561-95e5-59d7ba2d7408 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.053390 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502560a6-b8f7-4561-95e5-59d7ba2d7408 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-502560a6-b8f7-4561-95e5-59d7ba2d7408 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:41.064417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:41.065349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:41.066250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:41.066250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:41.066250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:41.066250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:41.066250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:41.066250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:41.066250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:41.066250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:41.066250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 289/583] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:41.066250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502560a6-b8f7-4561-95e5-59d7ba2d7408 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:41.088105 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:41.118250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:41.145060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e56064-0ddb-4fe3-82b1-be2d5fa80a27 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.170503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502560a6-b8f7-4561-95e5-59d7ba2d7408 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.182040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe220-c7d4-4392-91ed-78c22f12f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.182869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe220-c7d4-4392-91ed-78c22f12f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.183293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe220-c7d4-4392-91ed-78c22f12f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.183731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe220-c7d4-4392-91ed-78c22f12f8b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.184539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fe220-c7d4-4392-91ed-78c22f12f8b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:41.185001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fe220-c7d4-4392-91ed-78c22f12f8b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.186692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fe220-c7d4-4392-91ed-78c22f12f8b2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:41.199048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 295/584] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:41.199972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe220-c7d4-4392-91ed-78c22f12f8b2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:41.207912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ad9e5-f749-49cb-8be6-7cfc72737c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.208550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ad9e5-f749-49cb-8be6-7cfc72737c24 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.208830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ad9e5-f749-49cb-8be6-7cfc72737c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.209226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ad9e5-f749-49cb-8be6-7cfc72737c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.220676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ad9e5-f749-49cb-8be6-7cfc72737c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.222130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ad9e5-f749-49cb-8be6-7cfc72737c24 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-0b5ad9e5-f749-49cb-8be6-7cfc72737c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:41.237691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:41.238640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:41.239567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:41.239567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:41.239567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:41.241414 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 290/585] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:41.242398 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ad9e5-f749-49cb-8be6-7cfc72737c24 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:41.310814 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe220-c7d4-4392-91ed-78c22f12f8b2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.322868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:41.347094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:41.347809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cfd94-1095-430e-8d48-ff78cdb701b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.348618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cfd94-1095-430e-8d48-ff78cdb701b3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.348931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cfd94-1095-430e-8d48-ff78cdb701b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.349420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cfd94-1095-430e-8d48-ff78cdb701b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.350326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ad9e5-f749-49cb-8be6-7cfc72737c24 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.361311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cfd94-1095-430e-8d48-ff78cdb701b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.362893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cfd94-1095-430e-8d48-ff78cdb701b3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-fd1cfd94-1095-430e-8d48-ff78cdb701b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:41.377458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:41.378827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:41.379734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:41.379734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:41.379734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:41.379734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 296/586] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:41.379734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cfd94-1095-430e-8d48-ff78cdb701b3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:41.395842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3e045-d947-47b6-9920-880c656075fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.397135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3e045-d947-47b6-9920-880c656075fc None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.397617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3e045-d947-47b6-9920-880c656075fc None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.398356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3e045-d947-47b6-9920-880c656075fc None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.399713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3e045-d947-47b6-9920-880c656075fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:41.400247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3e045-d947-47b6-9920-880c656075fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.403167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3e045-d947-47b6-9920-880c656075fc None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:41.416598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 291/587] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:41.417776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3e045-d947-47b6-9920-880c656075fc None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:41.517158 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cfd94-1095-430e-8d48-ff78cdb701b3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.529388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3e045-d947-47b6-9920-880c656075fc None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.554416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844c40e-c9af-41c6-9877-92e6b07d370f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.555375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c40e-c9af-41c6-9877-92e6b07d370f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.555801 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c40e-c9af-41c6-9877-92e6b07d370f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.556353 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844c40e-c9af-41c6-9877-92e6b07d370f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.561924 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f057301-bcdb-43b2-974c-c605a3ea0eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.562523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f057301-bcdb-43b2-974c-c605a3ea0eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.562834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f057301-bcdb-43b2-974c-c605a3ea0eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.563105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f057301-bcdb-43b2-974c-c605a3ea0eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.563743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f057301-bcdb-43b2-974c-c605a3ea0eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:41.564007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844c40e-c9af-41c6-9877-92e6b07d370f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.564118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f057301-bcdb-43b2-974c-c605a3ea0eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.565408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f057301-bcdb-43b2-974c-c605a3ea0eb6 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:41.565841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844c40e-c9af-41c6-9877-92e6b07d370f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:41.577795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 292/588] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6844c40e-c9af-41c6-9877-92e6b07d370f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:41.578275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:41.579276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:41.580240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:41.580240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:41.580240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:41.580240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:41.580240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:41.580240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:41.580240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:41.580240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:41.580669 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f057301-bcdb-43b2-974c-c605a3ea0eb6 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:41.581870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 297/589] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:41.582915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844c40e-c9af-41c6-9877-92e6b07d370f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:41.608078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:41.609744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:41.686001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f057301-bcdb-43b2-974c-c605a3ea0eb6 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.688684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844c40e-c9af-41c6-9877-92e6b07d370f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.720792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e138b-3485-48ec-99f5-5db4754b932b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.721394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e138b-3485-48ec-99f5-5db4754b932b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.721674 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e138b-3485-48ec-99f5-5db4754b932b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.722000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e138b-3485-48ec-99f5-5db4754b932b None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.722576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e138b-3485-48ec-99f5-5db4754b932b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:41.722906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e138b-3485-48ec-99f5-5db4754b932b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.724299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e138b-3485-48ec-99f5-5db4754b932b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:41.724913 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0be3d-1e78-465d-8c75-6d2ed2086de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.725723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0be3d-1e78-465d-8c75-6d2ed2086de4 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.726011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0be3d-1e78-465d-8c75-6d2ed2086de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.726286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0be3d-1e78-465d-8c75-6d2ed2086de4 None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/41f7a6292d004a648c3c92526d1304ec/roles/7323f34f91ec4c9c90fc0e4e8a705ebb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.738712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 293/590] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:41.738712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e138b-3485-48ec-99f5-5db4754b932b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:41.747037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0be3d-1e78-465d-8c75-6d2ed2086de4 None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=41f7a6292d004a648c3c92526d1304ec, role_id=7323f34f91ec4c9c90fc0e4e8a705ebb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.748859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0be3d-1e78-465d-8c75-6d2ed2086de4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:41.819591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 298/591] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:59:41 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/41f7a6292d004a648c3c92526d1304ec/roles/7323f34f91ec4c9c90fc0e4e8a705ebb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:59:41.820538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0be3d-1e78-465d-8c75-6d2ed2086de4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:41.831449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:41.858535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e138b-3485-48ec-99f5-5db4754b932b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.910323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:41.912476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605c171-09ac-4214-8588-e36f25ad7d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.913667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605c171-09ac-4214-8588-e36f25ad7d58 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.914091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605c171-09ac-4214-8588-e36f25ad7d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.914503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605c171-09ac-4214-8588-e36f25ad7d58 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.926147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605c171-09ac-4214-8588-e36f25ad7d58 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.928417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605c171-09ac-4214-8588-e36f25ad7d58 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:41.943579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0be3d-1e78-465d-8c75-6d2ed2086de4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-d605c171-09ac-4214-8588-e36f25ad7d58 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:41.947175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:41.948112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:41.949037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:41.949037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:41.949037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:41.949037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:41.949037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:41.949037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:41.949037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:41.949037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:41.949037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 15:59:41.949037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:41.949037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 294/592] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:41.950252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605c171-09ac-4214-8588-e36f25ad7d58 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:41.987783 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19212250-5e93-44a9-9b8c-e2f14a1b51a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:41.988505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19212250-5e93-44a9-9b8c-e2f14a1b51a5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:41.988817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19212250-5e93-44a9-9b8c-e2f14a1b51a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:41.989077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19212250-5e93-44a9-9b8c-e2f14a1b51a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:41.989837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19212250-5e93-44a9-9b8c-e2f14a1b51a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:41.990466 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19212250-5e93-44a9-9b8c-e2f14a1b51a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:41.991634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19212250-5e93-44a9-9b8c-e2f14a1b51a5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:42.006038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 299/593] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:42.006480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19212250-5e93-44a9-9b8c-e2f14a1b51a5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:42.100559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605c171-09ac-4214-8588-e36f25ad7d58 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:42.117203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19212250-5e93-44a9-9b8c-e2f14a1b51a5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:42.149830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eff7a0-aacb-4c4d-8fd0-aa200b9bb40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:42.150471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eff7a0-aacb-4c4d-8fd0-aa200b9bb40f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:42.150775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eff7a0-aacb-4c4d-8fd0-aa200b9bb40f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:42.151047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eff7a0-aacb-4c4d-8fd0-aa200b9bb40f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:42.159979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eff7a0-aacb-4c4d-8fd0-aa200b9bb40f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:42.160362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ca422-c0de-4a77-9f8f-90f8c2feaa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:42.161433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eff7a0-aacb-4c4d-8fd0-aa200b9bb40f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:42.161908 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca422-c0de-4a77-9f8f-90f8c2feaa44 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:42.162434 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca422-c0de-4a77-9f8f-90f8c2feaa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:42.162973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca422-c0de-4a77-9f8f-90f8c2feaa44 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:42.163885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ca422-c0de-4a77-9f8f-90f8c2feaa44 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:42.164421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ca422-c0de-4a77-9f8f-90f8c2feaa44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:42.164525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:42.166171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ca422-c0de-4a77-9f8f-90f8c2feaa44 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:42.171015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-04eff7a0-aacb-4c4d-8fd0-aa200b9bb40f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:42.176606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:42.177582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:42.178743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:42.178743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:42.178743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:42.178743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:42.178743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:42.178743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:42.178743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:42.178743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:42.178743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 15:59:42.178743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:42.178743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 295/594] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:42.183524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eff7a0-aacb-4c4d-8fd0-aa200b9bb40f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:42.193881 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 300/595] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 8 15:59:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:42.195170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ca422-c0de-4a77-9f8f-90f8c2feaa44 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:42.308224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ca422-c0de-4a77-9f8f-90f8c2feaa44 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:42.315131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eff7a0-aacb-4c4d-8fd0-aa200b9bb40f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:42.351119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120d8e-de0c-4f17-91e4-4c4eee2c228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:42.352119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120d8e-de0c-4f17-91e4-4c4eee2c228d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:42.352608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120d8e-de0c-4f17-91e4-4c4eee2c228d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:42.353100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120d8e-de0c-4f17-91e4-4c4eee2c228d None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:42.354038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8120d8e-de0c-4f17-91e4-4c4eee2c228d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:42.354545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8120d8e-de0c-4f17-91e4-4c4eee2c228d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:42.356743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8120d8e-de0c-4f17-91e4-4c4eee2c228d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:42.366757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509203f6-f27e-4c84-a14c-3400d8b97c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:42.366757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509203f6-f27e-4c84-a14c-3400d8b97c71 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:42.366757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509203f6-f27e-4c84-a14c-3400d8b97c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:42.366757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509203f6-f27e-4c84-a14c-3400d8b97c71 None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/d0892bfab3ce435b90b93b0786899f84/roles/7323f34f91ec4c9c90fc0e4e8a705ebb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:42.381052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 301/596] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 8 15:59:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:42.381052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120d8e-de0c-4f17-91e4-4c4eee2c228d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:42.392758 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509203f6-f27e-4c84-a14c-3400d8b97c71 None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=d0892bfab3ce435b90b93b0786899f84, role_id=7323f34f91ec4c9c90fc0e4e8a705ebb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:42.395435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509203f6-f27e-4c84-a14c-3400d8b97c71 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:42.437144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:42.479277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 296/597] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:59:42 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/d0892bfab3ce435b90b93b0786899f84/roles/7323f34f91ec4c9c90fc0e4e8a705ebb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:59:42.480587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509203f6-f27e-4c84-a14c-3400d8b97c71 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:42.507886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8120d8e-de0c-4f17-91e4-4c4eee2c228d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:42.581120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b6f80-eb81-45ee-81ea-37ce0fe92344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:42.581819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b6f80-eb81-45ee-81ea-37ce0fe92344 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:42.582095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b6f80-eb81-45ee-81ea-37ce0fe92344 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:42.582367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b6f80-eb81-45ee-81ea-37ce0fe92344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:42.591970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:42.607648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b6f80-eb81-45ee-81ea-37ce0fe92344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:42.609252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b6f80-eb81-45ee-81ea-37ce0fe92344 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-660b6f80-eb81-45ee-81ea-37ce0fe92344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:42.648786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:42.649811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:42.650804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:42.650804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:42.650804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:42.650804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 302/598] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:42.655515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b6f80-eb81-45ee-81ea-37ce0fe92344 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:42.667546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509203f6-f27e-4c84-a14c-3400d8b97c71 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:42.717304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5950a68-e0bf-41a5-b3fd-9c0de26489c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:42.718474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5950a68-e0bf-41a5-b3fd-9c0de26489c3 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:42.719000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5950a68-e0bf-41a5-b3fd-9c0de26489c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:42.719494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5950a68-e0bf-41a5-b3fd-9c0de26489c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:42.740155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5950a68-e0bf-41a5-b3fd-9c0de26489c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:42.742278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5950a68-e0bf-41a5-b3fd-9c0de26489c3 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-c5950a68-e0bf-41a5-b3fd-9c0de26489c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:42.762949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:42.764182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:42.765074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:42.765074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:42.765074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:42.765074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 297/599] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:42.771525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26724a6d-fc91-4cd3-bcdd-615a6e7d94ea None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:42.771814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26724a6d-fc91-4cd3-bcdd-615a6e7d94ea None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:42.772093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26724a6d-fc91-4cd3-bcdd-615a6e7d94ea None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:42.773797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 298/600] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:42.774938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26724a6d-fc91-4cd3-bcdd-615a6e7d94ea None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:42.819017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:42.823254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b6f80-eb81-45ee-81ea-37ce0fe92344 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:42.881117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4c3b3-1ed0-46c8-95e7-52ae22ac57d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:42.881725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c3b3-1ed0-46c8-95e7-52ae22ac57d9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:42.881998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c3b3-1ed0-46c8-95e7-52ae22ac57d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:42.882267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c3b3-1ed0-46c8-95e7-52ae22ac57d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:42.882951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4c3b3-1ed0-46c8-95e7-52ae22ac57d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:42.883772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4c3b3-1ed0-46c8-95e7-52ae22ac57d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:42.885469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4c3b3-1ed0-46c8-95e7-52ae22ac57d9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:42.900790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 303/601] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:42.901356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26724a6d-fc91-4cd3-bcdd-615a6e7d94ea None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:42.902040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47623e-1a0f-4764-92d9-d63dd8d417c5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:42.902318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47623e-1a0f-4764-92d9-d63dd8d417c5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:42.902615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47623e-1a0f-4764-92d9-d63dd8d417c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:42.903887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:42.939831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc767e15-ab9e-451d-bac5-3f72278cbf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:42.940720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc767e15-ab9e-451d-bac5-3f72278cbf37 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:42.941428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc767e15-ab9e-451d-bac5-3f72278cbf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:42.941771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc767e15-ab9e-451d-bac5-3f72278cbf37 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:42.942524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc767e15-ab9e-451d-bac5-3f72278cbf37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:42.942875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc767e15-ab9e-451d-bac5-3f72278cbf37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:42.944287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc767e15-ab9e-451d-bac5-3f72278cbf37 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:42.956375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 299/602] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:42.957278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc767e15-ab9e-451d-bac5-3f72278cbf37 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:42.962469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bb47623e-1a0f-4764-92d9-d63dd8d417c5 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:42.963981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bb47623e-1a0f-4764-92d9-d63dd8d417c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:43.042615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 304/603] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:43.044571 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47623e-1a0f-4764-92d9-d63dd8d417c5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:43.075763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc767e15-ab9e-451d-bac5-3f72278cbf37 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:43.114282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb808bc-04cc-4b62-ada3-196b4c473103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:43.116248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb808bc-04cc-4b62-ada3-196b4c473103 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:43.116748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb808bc-04cc-4b62-ada3-196b4c473103 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:43.117212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb808bc-04cc-4b62-ada3-196b4c473103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:43.128034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb808bc-04cc-4b62-ada3-196b4c473103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:43.129721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb808bc-04cc-4b62-ada3-196b4c473103 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-dfb808bc-04cc-4b62-ada3-196b4c473103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:43.141874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:43.143077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:43.143959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:43.143959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:43.143959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:43.143959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:43.143959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:43.143959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:43.143959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:43.143959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:43.146335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 300/604] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:43.151647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb808bc-04cc-4b62-ada3-196b4c473103 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:43.162822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:43.178966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47623e-1a0f-4764-92d9-d63dd8d417c5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:43.211029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:43.240849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80405f-130b-4d6d-bbba-c3630a3d4364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:43.241497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80405f-130b-4d6d-bbba-c3630a3d4364 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:43.241772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80405f-130b-4d6d-bbba-c3630a3d4364 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:43.242103 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80405f-130b-4d6d-bbba-c3630a3d4364 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:43.252100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80405f-130b-4d6d-bbba-c3630a3d4364 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:43.255125 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80405f-130b-4d6d-bbba-c3630a3d4364 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4a80405f-130b-4d6d-bbba-c3630a3d4364 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:43.273339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:43.274236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:43.275145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:43.275145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:43.275145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:43.275145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:43.275145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:43.275145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:43.275145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:43.275145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:43.275145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 305/605] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:43.281633 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80405f-130b-4d6d-bbba-c3630a3d4364 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:43.370776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb808bc-04cc-4b62-ada3-196b4c473103 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:43.417851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b9081-3a53-44bc-a1f4-20c2585c5793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:43.419071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b9081-3a53-44bc-a1f4-20c2585c5793 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:43.419181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80405f-130b-4d6d-bbba-c3630a3d4364 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:43.419364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b9081-3a53-44bc-a1f4-20c2585c5793 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:43.419646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b9081-3a53-44bc-a1f4-20c2585c5793 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:43.423217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b9081-3a53-44bc-a1f4-20c2585c5793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:43.423661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b9081-3a53-44bc-a1f4-20c2585c5793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:43.430689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b9081-3a53-44bc-a1f4-20c2585c5793 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:43.445684 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 301/606] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:43.446619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b9081-3a53-44bc-a1f4-20c2585c5793 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:43.464473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f082d-87a8-4480-b6a4-06947933baca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:43.465919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f082d-87a8-4480-b6a4-06947933baca None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:43.466339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f082d-87a8-4480-b6a4-06947933baca None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:43.466786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f082d-87a8-4480-b6a4-06947933baca None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:43.467869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f082d-87a8-4480-b6a4-06947933baca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:43.468346 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f082d-87a8-4480-b6a4-06947933baca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:43.470802 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f082d-87a8-4480-b6a4-06947933baca None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:43.489468 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 306/607] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:43.490654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f082d-87a8-4480-b6a4-06947933baca None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:43.504515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:43.544284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:43.578406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b9081-3a53-44bc-a1f4-20c2585c5793 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:43.600384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f082d-87a8-4480-b6a4-06947933baca None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:43.624224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014965c8-efe8-4b0a-a773-2bdf8a3abe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:43.624940 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014965c8-efe8-4b0a-a773-2bdf8a3abe9d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:43.625227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014965c8-efe8-4b0a-a773-2bdf8a3abe9d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:43.625502 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014965c8-efe8-4b0a-a773-2bdf8a3abe9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:43.636532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4082be-cb1c-4527-a8a5-de389d280d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:43.637317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4082be-cb1c-4527-a8a5-de389d280d64 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:43.637710 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4082be-cb1c-4527-a8a5-de389d280d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:43.638050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4082be-cb1c-4527-a8a5-de389d280d64 None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/e08c9de660c04ed98f6100be2d687ea6/roles/7323f34f91ec4c9c90fc0e4e8a705ebb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:43.638161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014965c8-efe8-4b0a-a773-2bdf8a3abe9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-014965c8-efe8-4b0a-a773-2bdf8a3abe9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:43.644710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:43.645918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 302/608] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:43.647323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014965c8-efe8-4b0a-a773-2bdf8a3abe9d None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:43.655536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4082be-cb1c-4527-a8a5-de389d280d64 None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=e08c9de660c04ed98f6100be2d687ea6, role_id=7323f34f91ec4c9c90fc0e4e8a705ebb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:43.656984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4082be-cb1c-4527-a8a5-de389d280d64 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:43.755650 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 307/609] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:59:43 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/e08c9de660c04ed98f6100be2d687ea6/roles/7323f34f91ec4c9c90fc0e4e8a705ebb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:59:43.756896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4082be-cb1c-4527-a8a5-de389d280d64 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:43.759001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014965c8-efe8-4b0a-a773-2bdf8a3abe9d None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:43.840718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba451cbf-0792-4976-afb5-84697a3c4402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:43.841305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:43.841479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba451cbf-0792-4976-afb5-84697a3c4402 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:43.841984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba451cbf-0792-4976-afb5-84697a3c4402 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:43.841984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba451cbf-0792-4976-afb5-84697a3c4402 None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/e1d9c18139104883848f3ba22b38b360/roles/7323f34f91ec4c9c90fc0e4e8a705ebb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:43.872289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:43.878803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba451cbf-0792-4976-afb5-84697a3c4402 None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=e1d9c18139104883848f3ba22b38b360, role_id=7323f34f91ec4c9c90fc0e4e8a705ebb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:43.880310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba451cbf-0792-4976-afb5-84697a3c4402 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:43.891433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4082be-cb1c-4527-a8a5-de389d280d64 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:43.934979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff052-a80c-414b-bb4d-63c0398b6b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:43.935587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff052-a80c-414b-bb4d-63c0398b6b11 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:43.935913 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff052-a80c-414b-bb4d-63c0398b6b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:43.936213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff052-a80c-414b-bb4d-63c0398b6b11 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:43.936845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff052-a80c-414b-bb4d-63c0398b6b11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:43.937230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff052-a80c-414b-bb4d-63c0398b6b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:43.938580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff052-a80c-414b-bb4d-63c0398b6b11 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:43.947054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 308/610] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:43.952995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff052-a80c-414b-bb4d-63c0398b6b11 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:43.989531 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 303/611] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:59:43 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/e1d9c18139104883848f3ba22b38b360/roles/7323f34f91ec4c9c90fc0e4e8a705ebb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:59:44.071337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff052-a80c-414b-bb4d-63c0398b6b11 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:44.097686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:44.118959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fe0ef-522a-4914-bce1-9277554756b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:44.119610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe0ef-522a-4914-bce1-9277554756b5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:44.119882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe0ef-522a-4914-bce1-9277554756b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:44.120215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe0ef-522a-4914-bce1-9277554756b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:44.137603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fe0ef-522a-4914-bce1-9277554756b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:44.139028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fe0ef-522a-4914-bce1-9277554756b5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a54fe0ef-522a-4914-bce1-9277554756b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:44.159077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:44.161293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:44.163828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:44.163828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:44.163828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:44.163828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 309/612] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:44.175891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba451cbf-0792-4976-afb5-84697a3c4402 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:44.208910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2338a-4a3b-4123-8530-adc065b2ec02 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:44.209226 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2338a-4a3b-4123-8530-adc065b2ec02 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:44.209438 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2338a-4a3b-4123-8530-adc065b2ec02 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:44.211379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 310/613] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:44.217034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31393-f84e-45d3-9b0e-5322a88fbd73 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:44.217313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31393-f84e-45d3-9b0e-5322a88fbd73 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:44.217585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31393-f84e-45d3-9b0e-5322a88fbd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:44.239480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e4d31393-f84e-45d3-9b0e-5322a88fbd73 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:44.240725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e4d31393-f84e-45d3-9b0e-5322a88fbd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:44.326377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 311/614] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 15:59:44.341512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba451cbf-0792-4976-afb5-84697a3c4402 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:44.387828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d23912-de10-4034-b096-7ee6d976c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:44.388567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d23912-de10-4034-b096-7ee6d976c503 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:44.388725 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d23912-de10-4034-b096-7ee6d976c503 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:44.388872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d23912-de10-4034-b096-7ee6d976c503 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:44.389496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d23912-de10-4034-b096-7ee6d976c503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:44.389798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d23912-de10-4034-b096-7ee6d976c503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:44.391259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d23912-de10-4034-b096-7ee6d976c503 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:44.403721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 304/615] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:44.411285 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d31393-f84e-45d3-9b0e-5322a88fbd73 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:44.538458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d31393-f84e-45d3-9b0e-5322a88fbd73 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:44.540844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:44.573955 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a461498-712a-46b6-a6bc-3e060b61481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:44.574625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a461498-712a-46b6-a6bc-3e060b61481e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:44.574925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a461498-712a-46b6-a6bc-3e060b61481e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:44.575197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a461498-712a-46b6-a6bc-3e060b61481e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:44.582428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a461498-712a-46b6-a6bc-3e060b61481e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:44.583919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a461498-712a-46b6-a6bc-3e060b61481e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-2a461498-712a-46b6-a6bc-3e060b61481e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:44.596011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:44.598127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:44.600339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:44.600339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:44.600339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:44.600339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:44.600339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:44.600339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:44.600339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:44.600339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:44.600339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 15:59:44.600339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:44.600339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 312/616] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:59:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:44.607916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d23912-de10-4034-b096-7ee6d976c503 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:44.688452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:44.734246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a461498-712a-46b6-a6bc-3e060b61481e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:44.745794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d23912-de10-4034-b096-7ee6d976c503 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:44.782324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9e431-5703-47e4-a5bb-9f0ac7dd3a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:44.782978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e431-5703-47e4-a5bb-9f0ac7dd3a72 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:44.783296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e431-5703-47e4-a5bb-9f0ac7dd3a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:44.783568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9e431-5703-47e4-a5bb-9f0ac7dd3a72 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:44.784291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9e431-5703-47e4-a5bb-9f0ac7dd3a72 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:44.784592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9e431-5703-47e4-a5bb-9f0ac7dd3a72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:44.786084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9e431-5703-47e4-a5bb-9f0ac7dd3a72 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:44.813033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 305/617] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Sep 8 15:59:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:44.818469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9e431-5703-47e4-a5bb-9f0ac7dd3a72 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:44.849815 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a461498-712a-46b6-a6bc-3e060b61481e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:44.913965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400fccc-80c2-49a0-aed4-ce04ab178b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:44.914619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400fccc-80c2-49a0-aed4-ce04ab178b9d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:44.915280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400fccc-80c2-49a0-aed4-ce04ab178b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:44.915561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400fccc-80c2-49a0-aed4-ce04ab178b9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:44.937103 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400fccc-80c2-49a0-aed4-ce04ab178b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f400fccc-80c2-49a0-aed4-ce04ab178b9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:44.943606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:44.945805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:44.947968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:44.950711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 313/618] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:44.954697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400fccc-80c2-49a0-aed4-ce04ab178b9d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:44.983044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:45.032240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9e431-5703-47e4-a5bb-9f0ac7dd3a72 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:45.053916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:45.065321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400fccc-80c2-49a0-aed4-ce04ab178b9d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:45.103321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf00ab-64fe-4dc3-8bcd-1b8819a4cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:45.103939 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf00ab-64fe-4dc3-8bcd-1b8819a4cdcf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:45.104220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf00ab-64fe-4dc3-8bcd-1b8819a4cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:45.104493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf00ab-64fe-4dc3-8bcd-1b8819a4cdcf None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:45.105152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf00ab-64fe-4dc3-8bcd-1b8819a4cdcf None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:45.105996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf00ab-64fe-4dc3-8bcd-1b8819a4cdcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:45.107529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf00ab-64fe-4dc3-8bcd-1b8819a4cdcf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:45.115382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e24c66-73c6-4c8a-b16c-94fc23822d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:45.116026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e24c66-73c6-4c8a-b16c-94fc23822d7a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:45.116304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e24c66-73c6-4c8a-b16c-94fc23822d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:45.116578 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e24c66-73c6-4c8a-b16c-94fc23822d7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:45.123292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 314/619] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:45.134057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e24c66-73c6-4c8a-b16c-94fc23822d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:45.135613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e24c66-73c6-4c8a-b16c-94fc23822d7a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:45.139756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf00ab-64fe-4dc3-8bcd-1b8819a4cdcf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-02e24c66-73c6-4c8a-b16c-94fc23822d7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:45.167282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:45.170083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:45.172299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:45.172299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:45.172299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:45.172299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 306/620] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:45.178525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e24c66-73c6-4c8a-b16c-94fc23822d7a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:45.240644 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:45.263051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf00ab-64fe-4dc3-8bcd-1b8819a4cdcf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:45.293120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a90f-27ec-4d2a-b40f-1792087205e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:45.293930 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a90f-27ec-4d2a-b40f-1792087205e7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:45.294214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a90f-27ec-4d2a-b40f-1792087205e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:45.294491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a90f-27ec-4d2a-b40f-1792087205e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:45.305900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3a90f-27ec-4d2a-b40f-1792087205e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:45.307503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3a90f-27ec-4d2a-b40f-1792087205e7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1bf3a90f-27ec-4d2a-b40f-1792087205e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:45.322834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:45.323831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:45.325255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:45.325255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:45.325255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:45.325255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 315/621] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:45.330207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a90f-27ec-4d2a-b40f-1792087205e7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:45.348368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e24c66-73c6-4c8a-b16c-94fc23822d7a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:45.384501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d1260-cc89-40ff-b9d6-a2a9ea4e34f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:45.385193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1260-cc89-40ff-b9d6-a2a9ea4e34f5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:45.385475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1260-cc89-40ff-b9d6-a2a9ea4e34f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:45.385748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1260-cc89-40ff-b9d6-a2a9ea4e34f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:45.386392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d1260-cc89-40ff-b9d6-a2a9ea4e34f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:45.387247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d1260-cc89-40ff-b9d6-a2a9ea4e34f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:45.388807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d1260-cc89-40ff-b9d6-a2a9ea4e34f5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:45.401816 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 307/622] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:45.403752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016390-7318-444e-b76f-1a93f60a0b40 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:45.404034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016390-7318-444e-b76f-1a93f60a0b40 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:45.404310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016390-7318-444e-b76f-1a93f60a0b40 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:45.405745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 308/623] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:45.413881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9836b0-996f-4e3c-a1d3-30ac6cbe1b4b None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:45.413881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9836b0-996f-4e3c-a1d3-30ac6cbe1b4b None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:45.413881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9836b0-996f-4e3c-a1d3-30ac6cbe1b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:45.438786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a90f-27ec-4d2a-b40f-1792087205e7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:45.439290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-bd9836b0-996f-4e3c-a1d3-30ac6cbe1b4b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:45.440800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-bd9836b0-996f-4e3c-a1d3-30ac6cbe1b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:45.462077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:45.474794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b71b91-926f-4113-b6f0-ff36eda166b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:45.475402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b71b91-926f-4113-b6f0-ff36eda166b3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:45.475681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b71b91-926f-4113-b6f0-ff36eda166b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:45.475957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b71b91-926f-4113-b6f0-ff36eda166b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:45.476596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b71b91-926f-4113-b6f0-ff36eda166b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:45.476897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b71b91-926f-4113-b6f0-ff36eda166b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:45.478553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b71b91-926f-4113-b6f0-ff36eda166b3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:45.485638 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:45.495693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 316/624] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:45.496538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b71b91-926f-4113-b6f0-ff36eda166b3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:45.531114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 309/625] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:45.532302 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9836b0-996f-4e3c-a1d3-30ac6cbe1b4b None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:45.602697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b71b91-926f-4113-b6f0-ff36eda166b3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:45.636242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c96c16-279b-4af4-bcf8-d16257a01063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:45.637430 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c96c16-279b-4af4-bcf8-d16257a01063 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:45.637710 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c96c16-279b-4af4-bcf8-d16257a01063 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:45.637982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c96c16-279b-4af4-bcf8-d16257a01063 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:45.645106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c96c16-279b-4af4-bcf8-d16257a01063 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:45.646568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c96c16-279b-4af4-bcf8-d16257a01063 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-40c96c16-279b-4af4-bcf8-d16257a01063 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:45.658021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:45.659142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:45.660255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:45.660255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:45.660255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:45.660255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:45.660255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:45.660255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:45.660255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:45.660255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:45.662401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 317/626] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:45.677274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c96c16-279b-4af4-bcf8-d16257a01063 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:45.705463 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9836b0-996f-4e3c-a1d3-30ac6cbe1b4b None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:45.779102 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:45.787912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dba9cc-13d7-4dec-97d5-5fc4f52d5ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:45.788559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba9cc-13d7-4dec-97d5-5fc4f52d5ebf None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:45.788837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba9cc-13d7-4dec-97d5-5fc4f52d5ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:45.789110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dba9cc-13d7-4dec-97d5-5fc4f52d5ebf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:45.789821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c96c16-279b-4af4-bcf8-d16257a01063 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:45.802065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dba9cc-13d7-4dec-97d5-5fc4f52d5ebf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:45.811699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dba9cc-13d7-4dec-97d5-5fc4f52d5ebf None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-12dba9cc-13d7-4dec-97d5-5fc4f52d5ebf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:45.836152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:45.837181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:45.838121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:45.838121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:45.838121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:45.838121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:45.838121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:45.838121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:45.838121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:45.838121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:45.838121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 15:59:45.838121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:45.839732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c73ebb-aa92-40a2-8c6c-67c41643e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:45.840599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73ebb-aa92-40a2-8c6c-67c41643e7cc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:45.841088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73ebb-aa92-40a2-8c6c-67c41643e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:45.841647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73ebb-aa92-40a2-8c6c-67c41643e7cc None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:45.842540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c73ebb-aa92-40a2-8c6c-67c41643e7cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:45.843077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c73ebb-aa92-40a2-8c6c-67c41643e7cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:45.844734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c73ebb-aa92-40a2-8c6c-67c41643e7cc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:45.847142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 310/627] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Sep 8 15:59:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:45.848403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dba9cc-13d7-4dec-97d5-5fc4f52d5ebf None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:45.858488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 318/628] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:45.864058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c73ebb-aa92-40a2-8c6c-67c41643e7cc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:45.876853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:45.994236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c73ebb-aa92-40a2-8c6c-67c41643e7cc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:46.015187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:46.020721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dba9cc-13d7-4dec-97d5-5fc4f52d5ebf None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:46.034236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0218f-339b-4fed-9756-5106f8c7a0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:46.035259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0218f-339b-4fed-9756-5106f8c7a0ae None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:46.035771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0218f-339b-4fed-9756-5106f8c7a0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:46.036245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0218f-339b-4fed-9756-5106f8c7a0ae None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/50c9553845ba42e78de0293fd3a338d1/roles/7323f34f91ec4c9c90fc0e4e8a705ebb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:46.053182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0218f-339b-4fed-9756-5106f8c7a0ae None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=50c9553845ba42e78de0293fd3a338d1, role_id=7323f34f91ec4c9c90fc0e4e8a705ebb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:46.054946 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0218f-339b-4fed-9756-5106f8c7a0ae None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:46.062516 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1ebea-7bbe-45be-9341-7101bf93639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:46.063413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1ebea-7bbe-45be-9341-7101bf93639c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:46.063845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1ebea-7bbe-45be-9341-7101bf93639c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:46.064264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1ebea-7bbe-45be-9341-7101bf93639c None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:46.065139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1ebea-7bbe-45be-9341-7101bf93639c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:46.065592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1ebea-7bbe-45be-9341-7101bf93639c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:46.067222 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1ebea-7bbe-45be-9341-7101bf93639c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:46.086055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 311/629] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 8 15:59:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:46.087286 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1ebea-7bbe-45be-9341-7101bf93639c None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:46.133429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 319/630] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 15:59:45 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/50c9553845ba42e78de0293fd3a338d1/roles/7323f34f91ec4c9c90fc0e4e8a705ebb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 15:59:46.134606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0218f-339b-4fed-9756-5106f8c7a0ae None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:46.218562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:46.275049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1ebea-7bbe-45be-9341-7101bf93639c None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:46.330517 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0218f-339b-4fed-9756-5106f8c7a0ae None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:46.376447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecbfd8-4791-4c93-9271-6513971a316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:46.376447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecbfd8-4791-4c93-9271-6513971a316c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:46.376447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecbfd8-4791-4c93-9271-6513971a316c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:46.376447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecbfd8-4791-4c93-9271-6513971a316c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:46.376865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276a070-8ed1-414a-ab56-1bfdae27483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:46.377180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276a070-8ed1-414a-ab56-1bfdae27483d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:46.377343 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276a070-8ed1-414a-ab56-1bfdae27483d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:46.377574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276a070-8ed1-414a-ab56-1bfdae27483d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:46.388496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eecbfd8-4791-4c93-9271-6513971a316c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-9eecbfd8-4791-4c93-9271-6513971a316c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:46.393919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:46.395327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:46.396148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 312/631] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:46.396835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596042b7-1c78-46ce-b4cc-c08e103d0b92 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:46.396945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596042b7-1c78-46ce-b4cc-c08e103d0b92 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:46.397221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596042b7-1c78-46ce-b4cc-c08e103d0b92 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:46.399935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 313/632] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:46.404920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701e1d-8eed-4436-bfea-5f1ffcd811c9 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:46.405191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701e1d-8eed-4436-bfea-5f1ffcd811c9 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:46.405462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701e1d-8eed-4436-bfea-5f1ffcd811c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:46.429835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c1701e1d-8eed-4436-bfea-5f1ffcd811c9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:46.431166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c1701e1d-8eed-4436-bfea-5f1ffcd811c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:46.437674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:46.484663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276a070-8ed1-414a-ab56-1bfdae27483d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:46.486694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276a070-8ed1-414a-ab56-1bfdae27483d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:46.530759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 314/633] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:46.530759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1701e1d-8eed-4436-bfea-5f1ffcd811c9 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:46.626529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:46.632136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 320/634] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:46.638327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fc5e2-f584-4ce4-9ea1-ee41f7893bf6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:46.638832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fc5e2-f584-4ce4-9ea1-ee41f7893bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:46.639278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fc5e2-f584-4ce4-9ea1-ee41f7893bf6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:46.641053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 321/635] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:46.641930 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fc5e2-f584-4ce4-9ea1-ee41f7893bf6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:46.688169 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1701e1d-8eed-4436-bfea-5f1ffcd811c9 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:46.723938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d0342-c62b-4b2d-92c4-d29e38d954df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:46.725152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0342-c62b-4b2d-92c4-d29e38d954df None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:46.725628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0342-c62b-4b2d-92c4-d29e38d954df None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:46.725902 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0342-c62b-4b2d-92c4-d29e38d954df None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:46.726571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d0342-c62b-4b2d-92c4-d29e38d954df None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:46.726922 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d0342-c62b-4b2d-92c4-d29e38d954df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:46.728344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d0342-c62b-4b2d-92c4-d29e38d954df None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:46.729157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:46.737359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 315/636] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:46.739181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ff5ae-f562-4d4b-8f0e-d4f87f1dbdeb None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:46.742607 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ff5ae-f562-4d4b-8f0e-d4f87f1dbdeb None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:46.742607 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ff5ae-f562-4d4b-8f0e-d4f87f1dbdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:46.758815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-ac0ff5ae-f562-4d4b-8f0e-d4f87f1dbdeb None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:46.760300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ac0ff5ae-f562-4d4b-8f0e-d4f87f1dbdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:46.769047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fc5e2-f584-4ce4-9ea1-ee41f7893bf6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:46.817452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd0f8-6850-4f55-98b9-65d70b3df9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:46.818084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd0f8-6850-4f55-98b9-65d70b3df9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:46.818409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd0f8-6850-4f55-98b9-65d70b3df9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:46.818785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd0f8-6850-4f55-98b9-65d70b3df9d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:46.832292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cd0f8-6850-4f55-98b9-65d70b3df9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:46.833874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cd0f8-6850-4f55-98b9-65d70b3df9d9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:46.843547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 316/637] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:46.844716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ff5ae-f562-4d4b-8f0e-d4f87f1dbdeb None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-de1cd0f8-6850-4f55-98b9-65d70b3df9d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:46.852055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:46.853272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:46.854408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:46.854408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:46.854408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:46.856174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 322/638] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:46.857095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd0f8-6850-4f55-98b9-65d70b3df9d9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:46.906347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:46.959010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ff5ae-f562-4d4b-8f0e-d4f87f1dbdeb None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:46.974479 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd0f8-6850-4f55-98b9-65d70b3df9d9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:46.995760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b54f8-bbc9-40d5-b444-dfa0a567863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:46.996431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b54f8-bbc9-40d5-b444-dfa0a567863b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:46.996711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b54f8-bbc9-40d5-b444-dfa0a567863b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:46.996999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b54f8-bbc9-40d5-b444-dfa0a567863b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:46.997593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:47.007678 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b54f8-bbc9-40d5-b444-dfa0a567863b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:47.009041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b54f8-bbc9-40d5-b444-dfa0a567863b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:47.014095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c140614-1b36-4286-b7f8-a6fa62730ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:47.014973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c140614-1b36-4286-b7f8-a6fa62730ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:47.015445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c140614-1b36-4286-b7f8-a6fa62730ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:47.015894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c140614-1b36-4286-b7f8-a6fa62730ef5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:47.027828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c140614-1b36-4286-b7f8-a6fa62730ef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-e83b54f8-bbc9-40d5-b444-dfa0a567863b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:47.028532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:47.029449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:47.030406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:47.030406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:47.030406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:47.030406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 317/639] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:47.031055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b54f8-bbc9-40d5-b444-dfa0a567863b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8c140614-1b36-4286-b7f8-a6fa62730ef5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:47.036950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:47.038063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:47.039010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:47.041794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 323/640] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:47.042846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c140614-1b36-4286-b7f8-a6fa62730ef5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.147029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b54f8-bbc9-40d5-b444-dfa0a567863b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:47.149779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:47.165221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c140614-1b36-4286-b7f8-a6fa62730ef5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:47.182257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3fc24-e562-4a36-8dc3-554c999d0882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:47.182910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3fc24-e562-4a36-8dc3-554c999d0882 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:47.183195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3fc24-e562-4a36-8dc3-554c999d0882 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:47.184105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3fc24-e562-4a36-8dc3-554c999d0882 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:47.184742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3fc24-e562-4a36-8dc3-554c999d0882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:47.185710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3fc24-e562-4a36-8dc3-554c999d0882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:47.187123 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3fc24-e562-4a36-8dc3-554c999d0882 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:47.203469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 318/641] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:47.203469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3fc24-e562-4a36-8dc3-554c999d0882 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.206147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa556d71-b6c4-438a-a14c-e1a6accdeeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:47.206755 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa556d71-b6c4-438a-a14c-e1a6accdeeec None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:47.207715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa556d71-b6c4-438a-a14c-e1a6accdeeec None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:47.207715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa556d71-b6c4-438a-a14c-e1a6accdeeec None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:47.208018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa556d71-b6c4-438a-a14c-e1a6accdeeec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:47.208314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa556d71-b6c4-438a-a14c-e1a6accdeeec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:47.209655 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa556d71-b6c4-438a-a14c-e1a6accdeeec None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:47.227597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 324/642] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:47.228540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa556d71-b6c4-438a-a14c-e1a6accdeeec None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.273901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:47.304451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3fc24-e562-4a36-8dc3-554c999d0882 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:47.336965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa556d71-b6c4-438a-a14c-e1a6accdeeec None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:47.338187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b454e-2b0f-4a13-88ee-3a9d9e47ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:47.338829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b454e-2b0f-4a13-88ee-3a9d9e47ef6d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:47.339111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b454e-2b0f-4a13-88ee-3a9d9e47ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:47.339389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b454e-2b0f-4a13-88ee-3a9d9e47ef6d None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:47.340077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b454e-2b0f-4a13-88ee-3a9d9e47ef6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:47.340383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b454e-2b0f-4a13-88ee-3a9d9e47ef6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:47.341751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b454e-2b0f-4a13-88ee-3a9d9e47ef6d None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:47.349794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 319/643] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:47.350608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b454e-2b0f-4a13-88ee-3a9d9e47ef6d None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.379255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:47.380065 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a49f0-e06a-4639-8014-18c33ef689b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:47.380683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a49f0-e06a-4639-8014-18c33ef689b6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:47.381017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a49f0-e06a-4639-8014-18c33ef689b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:47.381353 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a49f0-e06a-4639-8014-18c33ef689b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:47.392036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a49f0-e06a-4639-8014-18c33ef689b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-997a49f0-e06a-4639-8014-18c33ef689b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:47.397120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:47.398104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 325/644] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:47.399603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a49f0-e06a-4639-8014-18c33ef689b6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.466288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b454e-2b0f-4a13-88ee-3a9d9e47ef6d None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:47.501829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ed30a-e08b-4d76-8b19-855f0480732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:47.502453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ed30a-e08b-4d76-8b19-855f0480732a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:47.502753 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ed30a-e08b-4d76-8b19-855f0480732a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:47.503024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ed30a-e08b-4d76-8b19-855f0480732a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:47.503709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:47.507100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a49f0-e06a-4639-8014-18c33ef689b6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:47.510435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ed30a-e08b-4d76-8b19-855f0480732a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:47.512514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ed30a-e08b-4d76-8b19-855f0480732a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-481ed30a-e08b-4d76-8b19-855f0480732a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:47.524095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:47.525003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:47.526147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:47.526147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:47.526147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:47.526147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:47.526147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:47.526147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:47.526147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:47.526147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:47.526147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 320/645] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:47.526147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ed30a-e08b-4d76-8b19-855f0480732a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.551367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743288c9-6e1b-4f6b-abce-4ce5b5d2c4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:47.551988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743288c9-6e1b-4f6b-abce-4ce5b5d2c4fb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:47.552291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743288c9-6e1b-4f6b-abce-4ce5b5d2c4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:47.552566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743288c9-6e1b-4f6b-abce-4ce5b5d2c4fb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:47.559718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743288c9-6e1b-4f6b-abce-4ce5b5d2c4fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:47.561157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743288c9-6e1b-4f6b-abce-4ce5b5d2c4fb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-743288c9-6e1b-4f6b-abce-4ce5b5d2c4fb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:47.574879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:47.576146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 326/646] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:47.582370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743288c9-6e1b-4f6b-abce-4ce5b5d2c4fb None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.630405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:47.645784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ed30a-e08b-4d76-8b19-855f0480732a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:47.683296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5880f61-dc38-4d6a-aeae-ed7a7914b889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:47.683896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5880f61-dc38-4d6a-aeae-ed7a7914b889 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:47.684084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743288c9-6e1b-4f6b-abce-4ce5b5d2c4fb None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:47.684200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5880f61-dc38-4d6a-aeae-ed7a7914b889 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:47.684473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5880f61-dc38-4d6a-aeae-ed7a7914b889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:47.694787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5880f61-dc38-4d6a-aeae-ed7a7914b889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:47.696238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5880f61-dc38-4d6a-aeae-ed7a7914b889 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-f5880f61-dc38-4d6a-aeae-ed7a7914b889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:47.711610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:47.712550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:47.713436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:47.713436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:47.713436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:47.713436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 321/647] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:47.713669 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5880f61-dc38-4d6a-aeae-ed7a7914b889 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.725820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6dbdf-1026-46df-99fc-2b2990fadb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:47.726472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6dbdf-1026-46df-99fc-2b2990fadb20 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:47.726899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6dbdf-1026-46df-99fc-2b2990fadb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:47.727145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6dbdf-1026-46df-99fc-2b2990fadb20 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:47.727757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6dbdf-1026-46df-99fc-2b2990fadb20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:47.728055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6dbdf-1026-46df-99fc-2b2990fadb20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:47.729442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6dbdf-1026-46df-99fc-2b2990fadb20 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:47.738803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 327/648] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:47.739810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6dbdf-1026-46df-99fc-2b2990fadb20 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.768460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:47.823886 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5880f61-dc38-4d6a-aeae-ed7a7914b889 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:47.851999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6dbdf-1026-46df-99fc-2b2990fadb20 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:47.859409 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf057a-58e5-4235-9914-fd534cfabb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:47.860029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf057a-58e5-4235-9914-fd534cfabb71 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:47.860310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf057a-58e5-4235-9914-fd534cfabb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:47.860584 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf057a-58e5-4235-9914-fd534cfabb71 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:47.861291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf057a-58e5-4235-9914-fd534cfabb71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:47.861594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf057a-58e5-4235-9914-fd534cfabb71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:47.863075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf057a-58e5-4235-9914-fd534cfabb71 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:47.870513 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:47.875963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 322/649] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:47.876756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf057a-58e5-4235-9914-fd534cfabb71 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.904601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c6de9-3b2e-4c16-9359-96b2c553127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:47.905721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6de9-3b2e-4c16-9359-96b2c553127a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:47.906143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6de9-3b2e-4c16-9359-96b2c553127a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:47.906559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6de9-3b2e-4c16-9359-96b2c553127a None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:47.907870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c6de9-3b2e-4c16-9359-96b2c553127a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:47.908596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c6de9-3b2e-4c16-9359-96b2c553127a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:47.910164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c6de9-3b2e-4c16-9359-96b2c553127a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:47.935409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 328/650] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:47.935409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c6de9-3b2e-4c16-9359-96b2c553127a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:47.984427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf057a-58e5-4235-9914-fd534cfabb71 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:48.014538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:48.020621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1356326-8113-4b28-b085-3f68866702bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:48.021331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1356326-8113-4b28-b085-3f68866702bb None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:48.021610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1356326-8113-4b28-b085-3f68866702bb None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:48.021879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1356326-8113-4b28-b085-3f68866702bb None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:48.022515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1356326-8113-4b28-b085-3f68866702bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:48.022846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1356326-8113-4b28-b085-3f68866702bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:48.024558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1356326-8113-4b28-b085-3f68866702bb None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:48.040420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 323/651] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:48.040614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c6de9-3b2e-4c16-9359-96b2c553127a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:48.040713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1356326-8113-4b28-b085-3f68866702bb None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:48.076801 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581df86c-5c0b-484b-9864-8f2dd19840c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:48.077467 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581df86c-5c0b-484b-9864-8f2dd19840c8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:48.077740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581df86c-5c0b-484b-9864-8f2dd19840c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:48.078011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581df86c-5c0b-484b-9864-8f2dd19840c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:48.088907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581df86c-5c0b-484b-9864-8f2dd19840c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:48.090378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581df86c-5c0b-484b-9864-8f2dd19840c8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:48.101973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-581df86c-5c0b-484b-9864-8f2dd19840c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:48.104561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:48.105547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:48.116975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:48.116975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:48.116975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:48.116975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 329/652] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:48.116975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581df86c-5c0b-484b-9864-8f2dd19840c8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:48.152246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1356326-8113-4b28-b085-3f68866702bb None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:48.188995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cc701-7369-488a-9bd5-745222c40fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:48.189522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cc701-7369-488a-9bd5-745222c40fbd None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:48.189798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cc701-7369-488a-9bd5-745222c40fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:48.190068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cc701-7369-488a-9bd5-745222c40fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:48.190814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cc701-7369-488a-9bd5-745222c40fbd None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=41f7a6292d004a648c3c92526d1304ec) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:48.191121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cc701-7369-488a-9bd5-745222c40fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:48.192566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cc701-7369-488a-9bd5-745222c40fbd None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:48.198517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 324/653] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:48 2022] GET /identity/v3/role_assignments?user.id=41f7a6292d004a648c3c92526d1304ec&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:48.199361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cc701-7369-488a-9bd5-745222c40fbd None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:48.233883 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581df86c-5c0b-484b-9864-8f2dd19840c8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:48.280922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:48.288377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1264fd-11ed-4ebf-94e2-40ef604738ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:48.289431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1264fd-11ed-4ebf-94e2-40ef604738ac None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:48.290808 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1264fd-11ed-4ebf-94e2-40ef604738ac None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:48.293852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1264fd-11ed-4ebf-94e2-40ef604738ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:48.330552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cc701-7369-488a-9bd5-745222c40fbd None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:48.367782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:48.378527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1264fd-11ed-4ebf-94e2-40ef604738ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:48.382257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1264fd-11ed-4ebf-94e2-40ef604738ac None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:48.383677 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375908cf-1eb0-46b4-bf70-6dc1d52899fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:48.384554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375908cf-1eb0-46b4-bf70-6dc1d52899fe None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:48.385528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375908cf-1eb0-46b4-bf70-6dc1d52899fe None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:48.386027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375908cf-1eb0-46b4-bf70-6dc1d52899fe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:48.395825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375908cf-1eb0-46b4-bf70-6dc1d52899fe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:48.397613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375908cf-1eb0-46b4-bf70-6dc1d52899fe None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-375908cf-1eb0-46b4-bf70-6dc1d52899fe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:48.414696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:48.415689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:48.416622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:48.416622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:48.416622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:48.416622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:48.416622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:48.416622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:48.416622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:48.416622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:48.416622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 15:59:48.416622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:48.419827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 325/654] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:48.420863 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375908cf-1eb0-46b4-bf70-6dc1d52899fe None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:48.499535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 330/655] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:48.500321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1264fd-11ed-4ebf-94e2-40ef604738ac None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:48.534176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:48.543954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375908cf-1eb0-46b4-bf70-6dc1d52899fe None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:48.579635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e4c82-9f4f-4210-849d-ed5966f58710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:48.580649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e4c82-9f4f-4210-849d-ed5966f58710 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:48.581147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e4c82-9f4f-4210-849d-ed5966f58710 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:48.581650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e4c82-9f4f-4210-849d-ed5966f58710 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:48.582484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e4c82-9f4f-4210-849d-ed5966f58710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:48.583036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e4c82-9f4f-4210-849d-ed5966f58710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:48.584586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e4c82-9f4f-4210-849d-ed5966f58710 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:48.597889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 326/656] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:48.599391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a9d3-f182-4d86-9f38-b6b24bf5e8ba None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:48.599673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a9d3-f182-4d86-9f38-b6b24bf5e8ba None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:48.599943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a9d3-f182-4d86-9f38-b6b24bf5e8ba None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:48.601282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 327/657] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:48.601795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a9d3-f182-4d86-9f38-b6b24bf5e8ba None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:48.612771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1264fd-11ed-4ebf-94e2-40ef604738ac None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:48.651028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:48.653672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb1a8-eb55-472e-a328-11e10ddca969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:48.654295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb1a8-eb55-472e-a328-11e10ddca969 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:48.654561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb1a8-eb55-472e-a328-11e10ddca969 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:48.654862 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb1a8-eb55-472e-a328-11e10ddca969 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:48.655589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb1a8-eb55-472e-a328-11e10ddca969 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:48.655895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb1a8-eb55-472e-a328-11e10ddca969 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:48.657313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb1a8-eb55-472e-a328-11e10ddca969 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:48.682992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 331/658] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Sep 8 15:59:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:48.684933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb1a8-eb55-472e-a328-11e10ddca969 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:48.711611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a9d3-f182-4d86-9f38-b6b24bf5e8ba None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:48.751439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bca394-cb21-4456-a11c-dd20aec265bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:48.752249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca394-cb21-4456-a11c-dd20aec265bc None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:48.752592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca394-cb21-4456-a11c-dd20aec265bc None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:48.753021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bca394-cb21-4456-a11c-dd20aec265bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:48.764474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bca394-cb21-4456-a11c-dd20aec265bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:48.766017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bca394-cb21-4456-a11c-dd20aec265bc None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:48.776400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-c4bca394-cb21-4456-a11c-dd20aec265bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:48.783127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:48.792496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:48.794183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:48.794183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:48.794183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:48.794183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 328/659] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:48.794464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb1a8-eb55-472e-a328-11e10ddca969 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:48.794550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7720-99b2-4a21-8034-6b245b7229c1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:48.794550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7720-99b2-4a21-8034-6b245b7229c1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:48.794550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7720-99b2-4a21-8034-6b245b7229c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:48.815684 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-558a7720-99b2-4a21-8034-6b245b7229c1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:48.817161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-558a7720-99b2-4a21-8034-6b245b7229c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:48.826051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904efd6-4f1d-4a75-98ea-670e1f1a2a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:48.826700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904efd6-4f1d-4a75-98ea-670e1f1a2a04 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:48.826981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904efd6-4f1d-4a75-98ea-670e1f1a2a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:48.827249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904efd6-4f1d-4a75-98ea-670e1f1a2a04 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:48.834225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904efd6-4f1d-4a75-98ea-670e1f1a2a04 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:48.835679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904efd6-4f1d-4a75-98ea-670e1f1a2a04 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e904efd6-4f1d-4a75-98ea-670e1f1a2a04 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:48.848284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:48.849413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:48.850421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:48.850421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:48.850421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:48.850421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:48.850421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:48.850421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:48.850421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:48.850421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:48.850421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 15:59:48.850421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:48.850421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 332/660] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:48.851090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904efd6-4f1d-4a75-98ea-670e1f1a2a04 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:48.895194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 329/661] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:48.895949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a7720-99b2-4a21-8034-6b245b7229c1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:48.928265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:48.981136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904efd6-4f1d-4a75-98ea-670e1f1a2a04 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:49.009009 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a7720-99b2-4a21-8034-6b245b7229c1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:49.026241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f588aee-5425-4bc8-8bb1-6d09df6e5077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:49.027998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f588aee-5425-4bc8-8bb1-6d09df6e5077 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:49.028743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f588aee-5425-4bc8-8bb1-6d09df6e5077 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:49.029195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f588aee-5425-4bc8-8bb1-6d09df6e5077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:49.045602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a975-2d39-4550-94d0-3df456b3a651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:49.046108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a975-2d39-4550-94d0-3df456b3a651 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:49.046451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a975-2d39-4550-94d0-3df456b3a651 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:49.046830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a975-2d39-4550-94d0-3df456b3a651 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:49.047535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0a975-2d39-4550-94d0-3df456b3a651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:49.047904 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0a975-2d39-4550-94d0-3df456b3a651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:49.049441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0a975-2d39-4550-94d0-3df456b3a651 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:49.054528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:49.061593 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 330/662] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:49.062793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a975-2d39-4550-94d0-3df456b3a651 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:49.120979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f588aee-5425-4bc8-8bb1-6d09df6e5077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:49.123495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f588aee-5425-4bc8-8bb1-6d09df6e5077 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:49.151284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:49.170849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a975-2d39-4550-94d0-3df456b3a651 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:49.209370 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52600d8-346f-4cad-9fea-800545db769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:49.209985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52600d8-346f-4cad-9fea-800545db769b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:49.210261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52600d8-346f-4cad-9fea-800545db769b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:49.210529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52600d8-346f-4cad-9fea-800545db769b None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:49.211297 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52600d8-346f-4cad-9fea-800545db769b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:49.211635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52600d8-346f-4cad-9fea-800545db769b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:49.213520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52600d8-346f-4cad-9fea-800545db769b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:49.232152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 331/663] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Sep 8 15:59:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:49.233698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52600d8-346f-4cad-9fea-800545db769b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:49.242780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 333/664] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:49.243512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f588aee-5425-4bc8-8bb1-6d09df6e5077 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:49.298920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:49.335493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52600d8-346f-4cad-9fea-800545db769b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:49.351986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f588aee-5425-4bc8-8bb1-6d09df6e5077 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:49.369562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd024-7fd6-47b1-a3bb-7fb70e8da739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:49.370411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd024-7fd6-47b1-a3bb-7fb70e8da739 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:49.371450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd024-7fd6-47b1-a3bb-7fb70e8da739 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:49.371900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbd024-7fd6-47b1-a3bb-7fb70e8da739 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:49.379698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbd024-7fd6-47b1-a3bb-7fb70e8da739 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:49.381347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbd024-7fd6-47b1-a3bb-7fb70e8da739 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:49.387147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462cc96-56fd-4c3d-ad18-3a47d4579fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:49.388045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462cc96-56fd-4c3d-ad18-3a47d4579fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:49.388323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462cc96-56fd-4c3d-ad18-3a47d4579fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:49.388587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462cc96-56fd-4c3d-ad18-3a47d4579fb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-7fdbd024-7fd6-47b1-a3bb-7fb70e8da739 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:49.393198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:49.394052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:49.395611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:49.395611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:49.395611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:49.395611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:49.395611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:49.395611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:49.395611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:49.395611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:49.395611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 332/665] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:49.395611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd024-7fd6-47b1-a3bb-7fb70e8da739 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:49.397744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:49.405169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462cc96-56fd-4c3d-ad18-3a47d4579fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4462cc96-56fd-4c3d-ad18-3a47d4579fb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:49.409943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:49.410927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:49.411845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 334/666] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:49.412559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462cc96-56fd-4c3d-ad18-3a47d4579fb4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:49.509956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbd024-7fd6-47b1-a3bb-7fb70e8da739 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:49.524875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462cc96-56fd-4c3d-ad18-3a47d4579fb4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:49.537140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:49.546120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc9a62-733b-4c3b-b5db-acb4469ebc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:49.546816 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc9a62-733b-4c3b-b5db-acb4469ebc43 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:49.547059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc9a62-733b-4c3b-b5db-acb4469ebc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:49.547323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc9a62-733b-4c3b-b5db-acb4469ebc43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:49.563028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54fdb5-3f89-4cc4-a018-1731c038f7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:49.563592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54fdb5-3f89-4cc4-a018-1731c038f7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:49.563871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54fdb5-3f89-4cc4-a018-1731c038f7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:49.564139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54fdb5-3f89-4cc4-a018-1731c038f7a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:49.576034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54fdb5-3f89-4cc4-a018-1731c038f7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:49.577480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54fdb5-3f89-4cc4-a018-1731c038f7a5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ba54fdb5-3f89-4cc4-a018-1731c038f7a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:49.592440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:49.593591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:49.594513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:49.594513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:49.594513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:49.598377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 335/667] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:49.599250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54fdb5-3f89-4cc4-a018-1731c038f7a5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:49.623252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc9a62-733b-4c3b-b5db-acb4469ebc43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:49.624728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc9a62-733b-4c3b-b5db-acb4469ebc43 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:49.626681 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:49.705634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54fdb5-3f89-4cc4-a018-1731c038f7a5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:49.735968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 333/668] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:49.736806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc9a62-733b-4c3b-b5db-acb4469ebc43 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:49.745024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9576d-c645-44d9-93f9-1e1d9c762a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:49.745635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9576d-c645-44d9-93f9-1e1d9c762a4c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:49.746472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9576d-c645-44d9-93f9-1e1d9c762a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:49.746775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9576d-c645-44d9-93f9-1e1d9c762a4c None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:49.747481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9576d-c645-44d9-93f9-1e1d9c762a4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:49.747766 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9576d-c645-44d9-93f9-1e1d9c762a4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:49.749190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9576d-c645-44d9-93f9-1e1d9c762a4c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:49.766460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 336/669] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:49.766460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9576d-c645-44d9-93f9-1e1d9c762a4c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:49.789370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:49.842766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc9a62-733b-4c3b-b5db-acb4469ebc43 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:49.844224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:49.868395 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9576d-c645-44d9-93f9-1e1d9c762a4c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:49.880660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8990-8d8d-4fb5-976d-1178d0067765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:49.881333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8990-8d8d-4fb5-976d-1178d0067765 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:49.881595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8990-8d8d-4fb5-976d-1178d0067765 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:49.881867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d8990-8d8d-4fb5-976d-1178d0067765 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:49.882530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d8990-8d8d-4fb5-976d-1178d0067765 None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:49.882873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d8990-8d8d-4fb5-976d-1178d0067765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:49.889522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d8990-8d8d-4fb5-976d-1178d0067765 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:49.893824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 334/670] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:49.895275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8990-8d8d-4fb5-976d-1178d0067765 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:49.905834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488809f6-2e41-4346-a802-86eb285ae5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:49.906451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488809f6-2e41-4346-a802-86eb285ae5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:49.912530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488809f6-2e41-4346-a802-86eb285ae5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:49.912530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488809f6-2e41-4346-a802-86eb285ae5f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:49.912530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488809f6-2e41-4346-a802-86eb285ae5f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:49.912530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488809f6-2e41-4346-a802-86eb285ae5f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:49.912530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488809f6-2e41-4346-a802-86eb285ae5f3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:49.922163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 337/671] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:49.923025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488809f6-2e41-4346-a802-86eb285ae5f3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:50.009440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:50.013967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d8990-8d8d-4fb5-976d-1178d0067765 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:50.027800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488809f6-2e41-4346-a802-86eb285ae5f3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:50.050653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f6c83-ec6e-4fc4-9815-a21a499dc087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:50.051910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f6c83-ec6e-4fc4-9815-a21a499dc087 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:50.052801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f6c83-ec6e-4fc4-9815-a21a499dc087 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:50.053522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f6c83-ec6e-4fc4-9815-a21a499dc087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:50.062697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb7c25-ec90-4780-9b85-4175f2142e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:50.063295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb7c25-ec90-4780-9b85-4175f2142e5a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:50.063675 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb7c25-ec90-4780-9b85-4175f2142e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:50.063949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb7c25-ec90-4780-9b85-4175f2142e5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:50.064535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb7c25-ec90-4780-9b85-4175f2142e5a None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=d0892bfab3ce435b90b93b0786899f84) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:50.064640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f6c83-ec6e-4fc4-9815-a21a499dc087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:50.064840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb7c25-ec90-4780-9b85-4175f2142e5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:50.066037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f6c83-ec6e-4fc4-9815-a21a499dc087 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:50.066251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb7c25-ec90-4780-9b85-4175f2142e5a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:50.082690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 338/672] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:49 2022] GET /identity/v3/role_assignments?user.id=d0892bfab3ce435b90b93b0786899f84&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:50.082690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb7c25-ec90-4780-9b85-4175f2142e5a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-9a4f6c83-ec6e-4fc4-9815-a21a499dc087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:50.083047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:50.083913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:50.084793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:50.084793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:50.084793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:50.084793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 335/673] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:50.084793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f6c83-ec6e-4fc4-9815-a21a499dc087 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:50.107819 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:50.209144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f6c83-ec6e-4fc4-9815-a21a499dc087 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:50.210328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb7c25-ec90-4780-9b85-4175f2142e5a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:50.255285 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40b348-16c2-4a7b-9437-4ffce057d663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:50.255937 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40b348-16c2-4a7b-9437-4ffce057d663 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:50.256214 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40b348-16c2-4a7b-9437-4ffce057d663 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:50.256526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40b348-16c2-4a7b-9437-4ffce057d663 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:50.258621 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4ed85-bcfe-4266-9306-bce5f783d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:50.259979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ed85-bcfe-4266-9306-bce5f783d1bd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:50.260463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ed85-bcfe-4266-9306-bce5f783d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:50.260919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ed85-bcfe-4266-9306-bce5f783d1bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:50.264641 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40b348-16c2-4a7b-9437-4ffce057d663 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:50.266133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40b348-16c2-4a7b-9437-4ffce057d663 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:50.274322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4ed85-bcfe-4266-9306-bce5f783d1bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:50.276212 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4ed85-bcfe-4266-9306-bce5f783d1bd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-4e40b348-16c2-4a7b-9437-4ffce057d663 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:50.280909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:50.281814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:50.282730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:50.282730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:50.282730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:50.282730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:50.282730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:50.282730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:50.282730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:50.282730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:50.282730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 336/674] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:50.283220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40b348-16c2-4a7b-9437-4ffce057d663 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:50.289753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-7bc4ed85-bcfe-4266-9306-bce5f783d1bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:50.300723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:50.302377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:50.303526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:50.303526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:50.303526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:50.306749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 339/675] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:50.307510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4ed85-bcfe-4266-9306-bce5f783d1bd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:50.379300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:50.415388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40b348-16c2-4a7b-9437-4ffce057d663 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:50.445150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4ed85-bcfe-4266-9306-bce5f783d1bd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:50.458694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a6a4c-f753-44fa-b988-7c62eb0a8752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:50.459304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a6a4c-f753-44fa-b988-7c62eb0a8752 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:50.459712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a6a4c-f753-44fa-b988-7c62eb0a8752 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:50.459985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a6a4c-f753-44fa-b988-7c62eb0a8752 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:50.460626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a6a4c-f753-44fa-b988-7c62eb0a8752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:50.460927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a6a4c-f753-44fa-b988-7c62eb0a8752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:50.462385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a6a4c-f753-44fa-b988-7c62eb0a8752 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:50.477158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 337/676] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:50.478091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a6a4c-f753-44fa-b988-7c62eb0a8752 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:50.488104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932fd82-e751-40a0-b41f-02dcf43d45b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:50.488720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932fd82-e751-40a0-b41f-02dcf43d45b1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:50.488998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932fd82-e751-40a0-b41f-02dcf43d45b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:50.489266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932fd82-e751-40a0-b41f-02dcf43d45b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:50.490309 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932fd82-e751-40a0-b41f-02dcf43d45b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:50.490615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932fd82-e751-40a0-b41f-02dcf43d45b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:50.492388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932fd82-e751-40a0-b41f-02dcf43d45b1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:50.509651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 340/677] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:50.509651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d006-0d41-4ccc-a2dd-074cd5157ba7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:50.509651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d006-0d41-4ccc-a2dd-074cd5157ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:50.509651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5d006-0d41-4ccc-a2dd-074cd5157ba7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:50.509651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 341/678] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:50.509651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5d006-0d41-4ccc-a2dd-074cd5157ba7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:50.571962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:50.600599 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a6a4c-f753-44fa-b988-7c62eb0a8752 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:50.617269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5d006-0d41-4ccc-a2dd-074cd5157ba7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:50.635830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5b826-64d2-482f-a290-9f9e6c9c5317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:50.636913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5b826-64d2-482f-a290-9f9e6c9c5317 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:50.637188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5b826-64d2-482f-a290-9f9e6c9c5317 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:50.637452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5b826-64d2-482f-a290-9f9e6c9c5317 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:50.638081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5b826-64d2-482f-a290-9f9e6c9c5317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:50.638376 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5b826-64d2-482f-a290-9f9e6c9c5317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:50.639777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5b826-64d2-482f-a290-9f9e6c9c5317 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:50.642829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:50.653445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 338/679] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:50.656646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5b826-64d2-482f-a290-9f9e6c9c5317 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:50.659655 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4a1e6-0e81-451f-ad9a-056cee469f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:50.660293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4a1e6-0e81-451f-ad9a-056cee469f99 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:50.660570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4a1e6-0e81-451f-ad9a-056cee469f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:50.660832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4a1e6-0e81-451f-ad9a-056cee469f99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:50.667910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4a1e6-0e81-451f-ad9a-056cee469f99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:50.669378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4a1e6-0e81-451f-ad9a-056cee469f99 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ebd4a1e6-0e81-451f-ad9a-056cee469f99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:50.681244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:50.682139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:50.683121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:50.683121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:50.683121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:50.683121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:50.683121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:50.683121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:50.683121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:50.683121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:50.683121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 342/680] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:50.683627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da595bd-f4d2-43ff-885d-05413c06a8b3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:50.684474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da595bd-f4d2-43ff-885d-05413c06a8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:50.684474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da595bd-f4d2-43ff-885d-05413c06a8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:50.704913 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0da595bd-f4d2-43ff-885d-05413c06a8b3 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:50.706770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0da595bd-f4d2-43ff-885d-05413c06a8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:50.769103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5b826-64d2-482f-a290-9f9e6c9c5317 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:50.783496 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 343/681] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:50.784572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da595bd-f4d2-43ff-885d-05413c06a8b3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:50.822322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92825aa0-7d57-4b59-9642-73613d4215a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:50.823102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92825aa0-7d57-4b59-9642-73613d4215a5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:50.823456 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92825aa0-7d57-4b59-9642-73613d4215a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:50.823849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92825aa0-7d57-4b59-9642-73613d4215a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:50.825138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92825aa0-7d57-4b59-9642-73613d4215a5 None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=e08c9de660c04ed98f6100be2d687ea6) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:50.825749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92825aa0-7d57-4b59-9642-73613d4215a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:50.828175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92825aa0-7d57-4b59-9642-73613d4215a5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:50.835355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 339/682] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:50 2022] GET /identity/v3/role_assignments?user.id=e08c9de660c04ed98f6100be2d687ea6&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:50.836081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92825aa0-7d57-4b59-9642-73613d4215a5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:50.853620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:50.970393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da595bd-f4d2-43ff-885d-05413c06a8b3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:50.971264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:51.032453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04737202-96c9-4fc6-985a-c2fb98c0bd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:51.033089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737202-96c9-4fc6-985a-c2fb98c0bd12 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:51.033362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737202-96c9-4fc6-985a-c2fb98c0bd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:51.033630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737202-96c9-4fc6-985a-c2fb98c0bd12 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:51.046399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04737202-96c9-4fc6-985a-c2fb98c0bd12 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:51.046399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04737202-96c9-4fc6-985a-c2fb98c0bd12 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-04737202-96c9-4fc6-985a-c2fb98c0bd12 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:51.057336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:51.058915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:51.059873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:51.059873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:51.059873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:51.059873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:51.059873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:51.059873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:51.059873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:51.059873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:51.059873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 15:59:51.059873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:51.062819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 344/683] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:59:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:51.065223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04737202-96c9-4fc6-985a-c2fb98c0bd12 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:51.067917 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92825aa0-7d57-4b59-9642-73613d4215a5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:51.108292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcc35a-a4b6-4042-9f58-8f4ebb49048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:51.108292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc35a-a4b6-4042-9f58-8f4ebb49048c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:51.108565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc35a-a4b6-4042-9f58-8f4ebb49048c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:51.108657 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc35a-a4b6-4042-9f58-8f4ebb49048c None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:51.109312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcc35a-a4b6-4042-9f58-8f4ebb49048c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:51.109620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcc35a-a4b6-4042-9f58-8f4ebb49048c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:51.111095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcc35a-a4b6-4042-9f58-8f4ebb49048c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:51.127210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 340/684] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:51.127210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcc35a-a4b6-4042-9f58-8f4ebb49048c None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:51.194427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04737202-96c9-4fc6-985a-c2fb98c0bd12 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:51.204748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:51.237678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3eec5-ab9b-42a2-a0aa-abf227660822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:51.238209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3eec5-ab9b-42a2-a0aa-abf227660822 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:51.238486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3eec5-ab9b-42a2-a0aa-abf227660822 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:51.238886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3eec5-ab9b-42a2-a0aa-abf227660822 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:51.239624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3eec5-ab9b-42a2-a0aa-abf227660822 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:51.239927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3eec5-ab9b-42a2-a0aa-abf227660822 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:51.241608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3eec5-ab9b-42a2-a0aa-abf227660822 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:51.260878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcc35a-a4b6-4042-9f58-8f4ebb49048c None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:51.263000 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 345/685] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Sep 8 15:59:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:51.264780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3eec5-ab9b-42a2-a0aa-abf227660822 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:51.288257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:51.303852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3064ad-14df-4010-b168-47d434d97a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:51.304496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3064ad-14df-4010-b168-47d434d97a4a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:51.304797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3064ad-14df-4010-b168-47d434d97a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:51.305763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3064ad-14df-4010-b168-47d434d97a4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:51.316520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3064ad-14df-4010-b168-47d434d97a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-2f3064ad-14df-4010-b168-47d434d97a4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:51.322741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:51.323672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:51.324543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:51.328902 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 341/686] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:51.329906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3064ad-14df-4010-b168-47d434d97a4a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:51.377871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3eec5-ab9b-42a2-a0aa-abf227660822 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:51.414055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6311e-9f9d-46f1-ab16-21cddd6f103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:51.415164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6311e-9f9d-46f1-ab16-21cddd6f103b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:51.415641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6311e-9f9d-46f1-ab16-21cddd6f103b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:51.416219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6311e-9f9d-46f1-ab16-21cddd6f103b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:51.417158 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6311e-9f9d-46f1-ab16-21cddd6f103b None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=e1d9c18139104883848f3ba22b38b360) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:51.418224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6311e-9f9d-46f1-ab16-21cddd6f103b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:51.420026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6311e-9f9d-46f1-ab16-21cddd6f103b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:51.429773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 346/687] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:51 2022] GET /identity/v3/role_assignments?user.id=e1d9c18139104883848f3ba22b38b360&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:51.430987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6311e-9f9d-46f1-ab16-21cddd6f103b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:51.465261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3064ad-14df-4010-b168-47d434d97a4a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:51.466974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:51.537943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bedac8-3170-4b5a-8c18-cad9448a543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:51.538484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bedac8-3170-4b5a-8c18-cad9448a543c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:51.538788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bedac8-3170-4b5a-8c18-cad9448a543c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:51.539059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bedac8-3170-4b5a-8c18-cad9448a543c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:51.626572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6311e-9f9d-46f1-ab16-21cddd6f103b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:51.627487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:51.653578 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bedac8-3170-4b5a-8c18-cad9448a543c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:51.655095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bedac8-3170-4b5a-8c18-cad9448a543c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:51.678045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307274fa-e681-4071-b05c-ee411cd64fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:51.679292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307274fa-e681-4071-b05c-ee411cd64fea None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:51.679766 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307274fa-e681-4071-b05c-ee411cd64fea None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:51.680227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307274fa-e681-4071-b05c-ee411cd64fea None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:51.681070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307274fa-e681-4071-b05c-ee411cd64fea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:51.681557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307274fa-e681-4071-b05c-ee411cd64fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:51.683156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307274fa-e681-4071-b05c-ee411cd64fea None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:51.693174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 347/688] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:51.698515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307274fa-e681-4071-b05c-ee411cd64fea None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:51.790318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 342/689] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:51.796425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bedac8-3170-4b5a-8c18-cad9448a543c None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:51.820419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:51.828711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307274fa-e681-4071-b05c-ee411cd64fea None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:51.865388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6bbd0-31b7-400c-aa1e-7aa86132af0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:51.866473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bbd0-31b7-400c-aa1e-7aa86132af0d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:51.867001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bbd0-31b7-400c-aa1e-7aa86132af0d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:51.867462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6bbd0-31b7-400c-aa1e-7aa86132af0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:51.879098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6bbd0-31b7-400c-aa1e-7aa86132af0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:51.880865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6bbd0-31b7-400c-aa1e-7aa86132af0d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:51.881367 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-77a6bbd0-31b7-400c-aa1e-7aa86132af0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:51.897589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:51.898598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:51.899526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:51.899526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:51.899526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:51.901319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bedac8-3170-4b5a-8c18-cad9448a543c None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:51.902451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 348/690] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:51.911595 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6bbd0-31b7-400c-aa1e-7aa86132af0d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:51.938454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ead84-d0f1-4c5d-8cfd-1cbdf3e68271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:51.939131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ead84-d0f1-4c5d-8cfd-1cbdf3e68271 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:51.939454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ead84-d0f1-4c5d-8cfd-1cbdf3e68271 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:51.939785 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ead84-d0f1-4c5d-8cfd-1cbdf3e68271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:51.951137 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ead84-d0f1-4c5d-8cfd-1cbdf3e68271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:51.953003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ead84-d0f1-4c5d-8cfd-1cbdf3e68271 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-e92ead84-d0f1-4c5d-8cfd-1cbdf3e68271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:51.970735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:51.971942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:51.973018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:51.973018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:51.973018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:51.974632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 343/691] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:51.980510 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ead84-d0f1-4c5d-8cfd-1cbdf3e68271 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:52.095375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ead84-d0f1-4c5d-8cfd-1cbdf3e68271 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:52.131045 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:52.135842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0f4b1-0373-4890-912c-14e24eb8a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:52.136639 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0f4b1-0373-4890-912c-14e24eb8a4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:52.137010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0f4b1-0373-4890-912c-14e24eb8a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:52.137378 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0f4b1-0373-4890-912c-14e24eb8a4b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:52.138116 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0f4b1-0373-4890-912c-14e24eb8a4b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:52.138515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0f4b1-0373-4890-912c-14e24eb8a4b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:52.140005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0f4b1-0373-4890-912c-14e24eb8a4b5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:52.163491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6bbd0-31b7-400c-aa1e-7aa86132af0d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:52.173949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 344/692] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:52.179547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0f4b1-0373-4890-912c-14e24eb8a4b5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:52.239902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee9c61-fd37-4800-ad3c-33bd45445dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:52.241864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee9c61-fd37-4800-ad3c-33bd45445dbb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:52.242363 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee9c61-fd37-4800-ad3c-33bd45445dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:52.242880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee9c61-fd37-4800-ad3c-33bd45445dbb None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:52.244001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee9c61-fd37-4800-ad3c-33bd45445dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:52.248162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee9c61-fd37-4800-ad3c-33bd45445dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:52.249561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee9c61-fd37-4800-ad3c-33bd45445dbb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:52.279097 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 349/693] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:52.282556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee9c61-fd37-4800-ad3c-33bd45445dbb None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:52.323051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:52.399004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee9c61-fd37-4800-ad3c-33bd45445dbb None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:52.417013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0f4b1-0373-4890-912c-14e24eb8a4b5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:52.460872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9ec84-f3ca-45b3-a492-16b19b8cb0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:52.461516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9ec84-f3ca-45b3-a492-16b19b8cb0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:52.461792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9ec84-f3ca-45b3-a492-16b19b8cb0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:52.462062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9ec84-f3ca-45b3-a492-16b19b8cb0e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:52.474884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9ec84-f3ca-45b3-a492-16b19b8cb0e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:52.476341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9ec84-f3ca-45b3-a492-16b19b8cb0e3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:52.483155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e69bd-b3e4-4fc3-ba54-77f37e11704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:52.483791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e69bd-b3e4-4fc3-ba54-77f37e11704f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:52.484065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e69bd-b3e4-4fc3-ba54-77f37e11704f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:52.484336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e69bd-b3e4-4fc3-ba54-77f37e11704f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-05c9ec84-f3ca-45b3-a492-16b19b8cb0e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:52.499973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:52.500959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:52.501942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:52.501942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:52.501942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:52.501942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:52.501942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:52.501942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:52.501942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:52.501942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:52.501942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 15:59:52.501942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:52.501942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 350/694] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Sep 8 15:59:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:52.502537 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e69bd-b3e4-4fc3-ba54-77f37e11704f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:52.503806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e69bd-b3e4-4fc3-ba54-77f37e11704f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:52.510222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9ec84-f3ca-45b3-a492-16b19b8cb0e3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-888e69bd-b3e4-4fc3-ba54-77f37e11704f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:52.516647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:52.518896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:52.521035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:52.521035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:52.521035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:52.521035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:52.521035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:52.521035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:52.521035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:52.521035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:52.522005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 345/695] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:52.527941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e69bd-b3e4-4fc3-ba54-77f37e11704f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:52.587745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:52.592668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:52.632058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9ec84-f3ca-45b3-a492-16b19b8cb0e3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:52.647833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e69bd-b3e4-4fc3-ba54-77f37e11704f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:52.675903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b07bb-7ea2-477f-9d8b-fd86d8436504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:52.676486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b07bb-7ea2-477f-9d8b-fd86d8436504 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:52.676769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b07bb-7ea2-477f-9d8b-fd86d8436504 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:52.677045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b07bb-7ea2-477f-9d8b-fd86d8436504 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:52.677775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b07bb-7ea2-477f-9d8b-fd86d8436504 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:52.678081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b07bb-7ea2-477f-9d8b-fd86d8436504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:52.679833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b07bb-7ea2-477f-9d8b-fd86d8436504 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:52.692304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ee244-c89f-45da-b7d4-3afebdbcea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:52.693127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ee244-c89f-45da-b7d4-3afebdbcea5f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:52.693558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ee244-c89f-45da-b7d4-3afebdbcea5f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:52.693972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ee244-c89f-45da-b7d4-3afebdbcea5f None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:52.694835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ee244-c89f-45da-b7d4-3afebdbcea5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:52.695281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ee244-c89f-45da-b7d4-3afebdbcea5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:52.697343 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ee244-c89f-45da-b7d4-3afebdbcea5f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:52.700623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 351/696] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 8 15:59:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:52.702059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed32ce9-e386-4331-9540-332f9f791280 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:52.702417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed32ce9-e386-4331-9540-332f9f791280 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:52.702781 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed32ce9-e386-4331-9540-332f9f791280 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:52.708213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 352/697] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:52.708213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed32ce9-e386-4331-9540-332f9f791280 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:52.722307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 346/698] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:52.725028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e539-ad4f-4fff-be2b-5ef25e99bba6 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:52.725307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e539-ad4f-4fff-be2b-5ef25e99bba6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:52.725576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e539-ad4f-4fff-be2b-5ef25e99bba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:52.747281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-aae1e539-ad4f-4fff-be2b-5ef25e99bba6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:52.748582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-aae1e539-ad4f-4fff-be2b-5ef25e99bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:52.821196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 347/699] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:52.822223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1e539-ad4f-4fff-be2b-5ef25e99bba6 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:52.831338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed32ce9-e386-4331-9540-332f9f791280 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:52.858347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:52.871339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2f0f2-ac54-4319-9338-311ae7e1a397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:52.871938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2f0f2-ac54-4319-9338-311ae7e1a397 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:52.872220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2f0f2-ac54-4319-9338-311ae7e1a397 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:52.872505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2f0f2-ac54-4319-9338-311ae7e1a397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:52.898051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:52.950136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2f0f2-ac54-4319-9338-311ae7e1a397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:52.951697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2f0f2-ac54-4319-9338-311ae7e1a397 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:53.029011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1e539-ad4f-4fff-be2b-5ef25e99bba6 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:53.060719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 353/700] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:53.070289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2f0f2-ac54-4319-9338-311ae7e1a397 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:53.082199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679bfe3-54ff-4264-84c9-4cf8cd7bd15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:53.082834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679bfe3-54ff-4264-84c9-4cf8cd7bd15f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:53.083109 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679bfe3-54ff-4264-84c9-4cf8cd7bd15f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:53.083382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679bfe3-54ff-4264-84c9-4cf8cd7bd15f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:53.084103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679bfe3-54ff-4264-84c9-4cf8cd7bd15f None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=50c9553845ba42e78de0293fd3a338d1) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:53.084408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679bfe3-54ff-4264-84c9-4cf8cd7bd15f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:53.085836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679bfe3-54ff-4264-84c9-4cf8cd7bd15f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:53.098860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 348/701] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:52 2022] GET /identity/v3/role_assignments?user.id=50c9553845ba42e78de0293fd3a338d1&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:53.099535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:53.183985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2f0f2-ac54-4319-9338-311ae7e1a397 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:53.229620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238eb6-ee94-4208-8ab0-fcf1e74084d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:53.230217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238eb6-ee94-4208-8ab0-fcf1e74084d6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:53.230490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238eb6-ee94-4208-8ab0-fcf1e74084d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:53.230844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238eb6-ee94-4208-8ab0-fcf1e74084d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:53.242820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238eb6-ee94-4208-8ab0-fcf1e74084d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:53.244298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238eb6-ee94-4208-8ab0-fcf1e74084d6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e4238eb6-ee94-4208-8ab0-fcf1e74084d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:53.261943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:53.263130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:53.264348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:53.264348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:53.264348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:53.264348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 354/702] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:53.268869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679bfe3-54ff-4264-84c9-4cf8cd7bd15f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:53.286188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238eb6-ee94-4208-8ab0-fcf1e74084d6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:53.379141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:53.387619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679bfe3-54ff-4264-84c9-4cf8cd7bd15f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:53.395248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:53.407220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238eb6-ee94-4208-8ab0-fcf1e74084d6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:53.431918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f61fb2-3ede-4abc-947c-a838f3577eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:53.432745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f61fb2-3ede-4abc-947c-a838f3577eff None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:53.433694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f61fb2-3ede-4abc-947c-a838f3577eff None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:53.434099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f61fb2-3ede-4abc-947c-a838f3577eff None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:53.434789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f61fb2-3ede-4abc-947c-a838f3577eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:53.435091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f61fb2-3ede-4abc-947c-a838f3577eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:53.436625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f61fb2-3ede-4abc-947c-a838f3577eff None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:53.445642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c395c-2698-4d86-b8ee-39bdf2044eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:53.446281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c395c-2698-4d86-b8ee-39bdf2044eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:53.447313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c395c-2698-4d86-b8ee-39bdf2044eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:53.447610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c395c-2698-4d86-b8ee-39bdf2044eb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:53.449830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 349/703] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:53.455176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f61fb2-3ede-4abc-947c-a838f3577eff None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:53.459085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c395c-2698-4d86-b8ee-39bdf2044eb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:53.460701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c395c-2698-4d86-b8ee-39bdf2044eb9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-057c395c-2698-4d86-b8ee-39bdf2044eb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:53.475798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:53.477529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:53.478754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:53.478754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:53.478754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:53.478754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 355/704] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:53.478754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fafba-9803-43ae-afbe-09357bf95b62 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:53.478754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fafba-9803-43ae-afbe-09357bf95b62 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:53.479099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fafba-9803-43ae-afbe-09357bf95b62 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:53.480992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 356/705] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:53.484176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fafba-9803-43ae-afbe-09357bf95b62 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:53.573718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f61fb2-3ede-4abc-947c-a838f3577eff None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:53.596391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fafba-9803-43ae-afbe-09357bf95b62 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:53.611176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9aa02c-2722-4fd5-a587-59648a9d6b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:53.612112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aa02c-2722-4fd5-a587-59648a9d6b46 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:53.612675 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aa02c-2722-4fd5-a587-59648a9d6b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:53.613143 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aa02c-2722-4fd5-a587-59648a9d6b46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:53.621168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9aa02c-2722-4fd5-a587-59648a9d6b46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:53.622930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9aa02c-2722-4fd5-a587-59648a9d6b46 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:53.623779 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:53.633094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac05688-8114-431c-a14e-6624686e101f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:53.641477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac05688-8114-431c-a14e-6624686e101f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:53.641477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac05688-8114-431c-a14e-6624686e101f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:53.641477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac05688-8114-431c-a14e-6624686e101f None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:53.641477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac05688-8114-431c-a14e-6624686e101f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:53.641477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac05688-8114-431c-a14e-6624686e101f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-2e9aa02c-2722-4fd5-a587-59648a9d6b46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:53.641858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:53.642973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:53.643892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:53.643892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:53.643892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:53.643892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:53.643892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:53.643892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:53.643892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:53.643892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:53.644324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac05688-8114-431c-a14e-6624686e101f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:53.644401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 350/706] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:53.644401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8910a-a473-4063-8cd1-36c8c6e977df None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:53.644401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8910a-a473-4063-8cd1-36c8c6e977df None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:53.644401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8910a-a473-4063-8cd1-36c8c6e977df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:53.655370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 357/707] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:53.656408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac05688-8114-431c-a14e-6624686e101f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:53.663828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-1df8910a-a473-4063-8cd1-36c8c6e977df None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:53.666279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1df8910a-a473-4063-8cd1-36c8c6e977df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:53.690304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:53.741954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 351/708] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:53.743148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8910a-a473-4063-8cd1-36c8c6e977df None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:53.778378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac05688-8114-431c-a14e-6624686e101f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:53.843286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad334da3-779e-4470-98d5-db3685bd263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:53.844323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad334da3-779e-4470-98d5-db3685bd263a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:53.844816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad334da3-779e-4470-98d5-db3685bd263a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:53.845275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad334da3-779e-4470-98d5-db3685bd263a None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:53.846148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad334da3-779e-4470-98d5-db3685bd263a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:53.846653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad334da3-779e-4470-98d5-db3685bd263a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:53.855045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad334da3-779e-4470-98d5-db3685bd263a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:53.886722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 358/709] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:53.891456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad334da3-779e-4470-98d5-db3685bd263a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:53.910544 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8910a-a473-4063-8cd1-36c8c6e977df None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:53.981391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a87d97-c245-4f53-a366-a74859b3e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:53.983410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a87d97-c245-4f53-a366-a74859b3e62f None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:53.984985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a87d97-c245-4f53-a366-a74859b3e62f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:53.986200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a87d97-c245-4f53-a366-a74859b3e62f None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:53.987074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a87d97-c245-4f53-a366-a74859b3e62f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:53.989884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a87d97-c245-4f53-a366-a74859b3e62f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:53.992747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:54.069093 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad334da3-779e-4470-98d5-db3685bd263a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:54.092632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 352/710] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 15:59:53 2022] POST /identity/v3/users => generated 254 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:59:54.093747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a87d97-c245-4f53-a366-a74859b3e62f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:54.116958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:54.136947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f352f13-cb09-40b5-b1d2-c920172efd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:54.137921 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f352f13-cb09-40b5-b1d2-c920172efd8a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:54.138396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f352f13-cb09-40b5-b1d2-c920172efd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:54.138869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f352f13-cb09-40b5-b1d2-c920172efd8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:54.139787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f352f13-cb09-40b5-b1d2-c920172efd8a None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=41f7a6292d004a648c3c92526d1304ec) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:54.140276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f352f13-cb09-40b5-b1d2-c920172efd8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:54.141916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f352f13-cb09-40b5-b1d2-c920172efd8a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:54.149981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 359/711] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:53 2022] GET /identity/v3/role_assignments?user.id=41f7a6292d004a648c3c92526d1304ec&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=519b356d36364663a59265dc7eeff0b8 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:54.151677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c4c0f-164b-4312-9fab-4ebcc84aaad8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:54.152395 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c4c0f-164b-4312-9fab-4ebcc84aaad8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:54.153730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c4c0f-164b-4312-9fab-4ebcc84aaad8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:54.155770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 360/712] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:54.161465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8fd9c-7dbe-4790-bb65-4e1a461032ea None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:54.162076 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8fd9c-7dbe-4790-bb65-4e1a461032ea None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:54.162548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8fd9c-7dbe-4790-bb65-4e1a461032ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:54.187529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bce8fd9c-7dbe-4790-bb65-4e1a461032ea None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:54.189840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bce8fd9c-7dbe-4790-bb65-4e1a461032ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:54.279702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a87d97-c245-4f53-a366-a74859b3e62f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:54.331858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 361/713] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:54.348192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6812ae-093b-4bcf-a421-913d581b7d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:54.349257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6812ae-093b-4bcf-a421-913d581b7d9b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:54.349747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6812ae-093b-4bcf-a421-913d581b7d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:54.350350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6812ae-093b-4bcf-a421-913d581b7d9b None admin] PATH_INFO: `/v3/services/network` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:54.351248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6812ae-093b-4bcf-a421-913d581b7d9b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:54.352963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6812ae-093b-4bcf-a421-913d581b7d9b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-9d6812ae-093b-4bcf-a421-913d581b7d9b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:54.365990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:54.367230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 15:59:54.368100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:54.371796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 353/714] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:54 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:54.380611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8fd9c-7dbe-4790-bb65-4e1a461032ea None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:54.443025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:54.498503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8fd9c-7dbe-4790-bb65-4e1a461032ea None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:54.536678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f34f9-8fa2-4757-8e5e-f93c2ee2db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:54.537217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f34f9-8fa2-4757-8e5e-f93c2ee2db0b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:54.537492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f34f9-8fa2-4757-8e5e-f93c2ee2db0b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:54.537763 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f34f9-8fa2-4757-8e5e-f93c2ee2db0b None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:54.538393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f34f9-8fa2-4757-8e5e-f93c2ee2db0b None admin] RBAC: Adding query filter params (name=network) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:54.538706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f34f9-8fa2-4757-8e5e-f93c2ee2db0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:54.540071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f34f9-8fa2-4757-8e5e-f93c2ee2db0b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:54.545769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 362/715] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 15:59:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:54.550915 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6812ae-093b-4bcf-a421-913d581b7d9b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:54.637891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:54.663289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6812ae-093b-4bcf-a421-913d581b7d9b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:54.684138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f34f9-8fa2-4757-8e5e-f93c2ee2db0b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:54.709055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4e10a-90ed-4ac6-9311-1bbc819d1b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:54.710296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4e10a-90ed-4ac6-9311-1bbc819d1b70 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:54.710795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4e10a-90ed-4ac6-9311-1bbc819d1b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:54.711240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4e10a-90ed-4ac6-9311-1bbc819d1b70 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:54.712041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4e10a-90ed-4ac6-9311-1bbc819d1b70 None admin] RBAC: Adding query filter params (type=network) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:54.712533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4e10a-90ed-4ac6-9311-1bbc819d1b70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:54.714654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4e10a-90ed-4ac6-9311-1bbc819d1b70 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:54.721875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 354/716] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 15:59:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:54.802991 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f34f9-8fa2-4757-8e5e-f93c2ee2db0b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:54.805982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:54.852231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287aeb9-37e9-4be6-bd14-e875a44b15d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:54.853249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287aeb9-37e9-4be6-bd14-e875a44b15d7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:54.853729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287aeb9-37e9-4be6-bd14-e875a44b15d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:54.854200 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287aeb9-37e9-4be6-bd14-e875a44b15d7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:54.855629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287aeb9-37e9-4be6-bd14-e875a44b15d7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:54.857370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287aeb9-37e9-4be6-bd14-e875a44b15d7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d287aeb9-37e9-4be6-bd14-e875a44b15d7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:54.872276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:54.873332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 15:59:54.874152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:54.877318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 363/717] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Sep 8 15:59:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:54.882632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4e10a-90ed-4ac6-9311-1bbc819d1b70 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:55.044961 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4e10a-90ed-4ac6-9311-1bbc819d1b70 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:55.087976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8264ee-124d-41af-bf99-9befe50f503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:55.088937 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8264ee-124d-41af-bf99-9befe50f503e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:55.089983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8264ee-124d-41af-bf99-9befe50f503e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:55.090454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8264ee-124d-41af-bf99-9befe50f503e None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:55.091332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8264ee-124d-41af-bf99-9befe50f503e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:55.091837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8264ee-124d-41af-bf99-9befe50f503e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:55.093475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8264ee-124d-41af-bf99-9befe50f503e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:55.102418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 355/718] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 8 15:59:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 15:59:55.108044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287aeb9-37e9-4be6-bd14-e875a44b15d7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:55.258399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287aeb9-37e9-4be6-bd14-e875a44b15d7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:55.303477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964ea1e-dbd9-474f-8f85-fa6e4b12297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:55.304089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964ea1e-dbd9-474f-8f85-fa6e4b12297e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:55.304361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964ea1e-dbd9-474f-8f85-fa6e4b12297e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:55.304627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964ea1e-dbd9-474f-8f85-fa6e4b12297e None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:55.305248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964ea1e-dbd9-474f-8f85-fa6e4b12297e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:55.305553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964ea1e-dbd9-474f-8f85-fa6e4b12297e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:55.306941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964ea1e-dbd9-474f-8f85-fa6e4b12297e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:55.319626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 364/719] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 8 15:59:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:55.762996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddbc75-3a0a-417c-81c2-1627ffbbf6ab None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:55.763514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddbc75-3a0a-417c-81c2-1627ffbbf6ab None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:55.763592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddbc75-3a0a-417c-81c2-1627ffbbf6ab None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:55.765146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 356/720] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:55.770629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35d53-8321-4e9f-b48e-eb5e5511acfc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:55.771053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35d53-8321-4e9f-b48e-eb5e5511acfc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:55.771222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35d53-8321-4e9f-b48e-eb5e5511acfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:55.793588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2df35d53-8321-4e9f-b48e-eb5e5511acfc None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:55.794822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2df35d53-8321-4e9f-b48e-eb5e5511acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:55.831427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:55.893022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 365/721] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:56.362252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddbc75-3a0a-417c-81c2-1627ffbbf6ab None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:56.366284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:56.515857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddbc75-3a0a-417c-81c2-1627ffbbf6ab None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:56.557815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137e054-3d01-4526-b607-22af308ab34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:56.558448 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e054-3d01-4526-b607-22af308ab34d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:56.558747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e054-3d01-4526-b607-22af308ab34d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:56.559025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e054-3d01-4526-b607-22af308ab34d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:56.576355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137e054-3d01-4526-b607-22af308ab34d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-6137e054-3d01-4526-b607-22af308ab34d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:56.581258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:56.582174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:56.583061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:56.583705 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d617-72ff-45f0-b9ba-7d5d2f89b7cd None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:56.583705 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d617-72ff-45f0-b9ba-7d5d2f89b7cd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:56.583842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d617-72ff-45f0-b9ba-7d5d2f89b7cd None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:56.585397 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 366/722] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:56.586174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 357/723] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:56.590895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23f0e8-2af8-4524-8638-10522de61868 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:56.591234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23f0e8-2af8-4524-8638-10522de61868 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:56.591513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23f0e8-2af8-4524-8638-10522de61868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:56.592050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137e054-3d01-4526-b607-22af308ab34d None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:56.620672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0d23f0e8-2af8-4524-8638-10522de61868 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:56.623411 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0d23f0e8-2af8-4524-8638-10522de61868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:56.710153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:56.755195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 367/724] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:56.775368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137e054-3d01-4526-b607-22af308ab34d None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:56.822392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa39c0-965d-4b29-adca-8ef8871e0df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:56.823028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa39c0-965d-4b29-adca-8ef8871e0df0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:56.823329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa39c0-965d-4b29-adca-8ef8871e0df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:56.824166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa39c0-965d-4b29-adca-8ef8871e0df0 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:56.824826 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa39c0-965d-4b29-adca-8ef8871e0df0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:56.825128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa39c0-965d-4b29-adca-8ef8871e0df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:56.826499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa39c0-965d-4b29-adca-8ef8871e0df0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:56.837869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 358/725] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:56.843600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23f0e8-2af8-4524-8638-10522de61868 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:56.948386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:56.962469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23f0e8-2af8-4524-8638-10522de61868 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:57.012111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1902e-b130-4282-bbc9-cde0da3b34e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:57.012762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1902e-b130-4282-bbc9-cde0da3b34e2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.013042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1902e-b130-4282-bbc9-cde0da3b34e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.013312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1902e-b130-4282-bbc9-cde0da3b34e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.024207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1902e-b130-4282-bbc9-cde0da3b34e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:57.025657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1902e-b130-4282-bbc9-cde0da3b34e2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3ef1902e-b130-4282-bbc9-cde0da3b34e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:57.045319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:57.046473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:57.047592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:57.047592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:57.047592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:57.050927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 368/726] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:57.053598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa39c0-965d-4b29-adca-8ef8871e0df0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:57.164632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1902e-b130-4282-bbc9-cde0da3b34e2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:57.197686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa39c0-965d-4b29-adca-8ef8871e0df0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:57.234719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b4abd-ca13-4d9f-abee-07b014ef7b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:57.235424 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b4abd-ca13-4d9f-abee-07b014ef7b01 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.235707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b4abd-ca13-4d9f-abee-07b014ef7b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.235979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b4abd-ca13-4d9f-abee-07b014ef7b01 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.236777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b4abd-ca13-4d9f-abee-07b014ef7b01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:57.237082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b4abd-ca13-4d9f-abee-07b014ef7b01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:57.238459 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b4abd-ca13-4d9f-abee-07b014ef7b01 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:57.254535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 359/727] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:57.259127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1be50-eab2-46b2-b4f2-e57c0bf8a5d7 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.259127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1be50-eab2-46b2-b4f2-e57c0bf8a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.259127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1be50-eab2-46b2-b4f2-e57c0bf8a5d7 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.259127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:57.259127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 360/728] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:57.263597 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1be50-eab2-46b2-b4f2-e57c0bf8a5d7 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:57.293204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1902e-b130-4282-bbc9-cde0da3b34e2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:57.330079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b36a27-a2df-447d-8c5a-90e90ee3314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:57.330738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b36a27-a2df-447d-8c5a-90e90ee3314b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.331018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b36a27-a2df-447d-8c5a-90e90ee3314b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.331287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b36a27-a2df-447d-8c5a-90e90ee3314b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.342759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b36a27-a2df-447d-8c5a-90e90ee3314b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a4b36a27-a2df-447d-8c5a-90e90ee3314b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:57.348311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:57.349326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:57.350173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 369/729] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:59:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 15:59:57.351400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d8ba-177d-42de-bbf0-f86f5b2c820c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.351400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d8ba-177d-42de-bbf0-f86f5b2c820c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.351635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d8ba-177d-42de-bbf0-f86f5b2c820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.359646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:57.372989 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cbb2d8ba-177d-42de-bbf0-f86f5b2c820c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:57.374225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cbb2d8ba-177d-42de-bbf0-f86f5b2c820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:57.379293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1be50-eab2-46b2-b4f2-e57c0bf8a5d7 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:57.428089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7085a-04f8-48b1-b363-47ce624fe18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:57.429031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7085a-04f8-48b1-b363-47ce624fe18e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.429031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7085a-04f8-48b1-b363-47ce624fe18e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.429272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7085a-04f8-48b1-b363-47ce624fe18e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.438026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7085a-04f8-48b1-b363-47ce624fe18e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:57.439543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7085a-04f8-48b1-b363-47ce624fe18e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-33b7085a-04f8-48b1-b363-47ce624fe18e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:57.451524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:57.452682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 361/730] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 15:59:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:57.453788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7085a-04f8-48b1-b363-47ce624fe18e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:57.460833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 370/731] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:57.467789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2d8ba-177d-42de-bbf0-f86f5b2c820c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:57.508851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:57.564803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7085a-04f8-48b1-b363-47ce624fe18e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:57.586214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2d8ba-177d-42de-bbf0-f86f5b2c820c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:57.599812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb72be-efe5-4adf-896b-fe3c84ddf59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:57.600481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb72be-efe5-4adf-896b-fe3c84ddf59a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.600763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb72be-efe5-4adf-896b-fe3c84ddf59a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.601036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb72be-efe5-4adf-896b-fe3c84ddf59a None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.601696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb72be-efe5-4adf-896b-fe3c84ddf59a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:57.601997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb72be-efe5-4adf-896b-fe3c84ddf59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:57.603649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb72be-efe5-4adf-896b-fe3c84ddf59a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:57.612838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 362/732] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 15:59:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:57.614057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86141-d304-4432-8134-608e56528726 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.614348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86141-d304-4432-8134-608e56528726 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.614621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d86141-d304-4432-8134-608e56528726 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.620299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 363/733] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:57.621000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d86141-d304-4432-8134-608e56528726 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:57.627578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a02a9-74f2-48ae-b0f1-a6ec87d66c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:57.628403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a02a9-74f2-48ae-b0f1-a6ec87d66c7d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.628859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a02a9-74f2-48ae-b0f1-a6ec87d66c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.629321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a02a9-74f2-48ae-b0f1-a6ec87d66c7d None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.630310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a02a9-74f2-48ae-b0f1-a6ec87d66c7d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:57.630828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a02a9-74f2-48ae-b0f1-a6ec87d66c7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:57.632509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a02a9-74f2-48ae-b0f1-a6ec87d66c7d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:57.634414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:57.654031 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 371/734] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Sep 8 15:59:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:57.658654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43a7d1-84e6-49b0-8f8c-871da194728c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.658654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43a7d1-84e6-49b0-8f8c-871da194728c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.658654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43a7d1-84e6-49b0-8f8c-871da194728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.684668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2f43a7d1-84e6-49b0-8f8c-871da194728c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:57.685938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2f43a7d1-84e6-49b0-8f8c-871da194728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:57.759634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d86141-d304-4432-8134-608e56528726 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:57.761124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 372/735] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:57.762010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43a7d1-84e6-49b0-8f8c-871da194728c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:57.771009 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:57.801771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e2bcf-cd26-46ce-ac0b-d9e7813c287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:57.803369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e2bcf-cd26-46ce-ac0b-d9e7813c287d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.804141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e2bcf-cd26-46ce-ac0b-d9e7813c287d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.804857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e2bcf-cd26-46ce-ac0b-d9e7813c287d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.818659 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e2bcf-cd26-46ce-ac0b-d9e7813c287d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:57.821315 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e2bcf-cd26-46ce-ac0b-d9e7813c287d None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-592e2bcf-cd26-46ce-ac0b-d9e7813c287d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:57.840478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:57.841606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:57.842772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:57.842772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:57.842772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:57.844996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 364/736] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:57.846034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e2bcf-cd26-46ce-ac0b-d9e7813c287d None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:57.887686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43a7d1-84e6-49b0-8f8c-871da194728c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:57.918600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:57.933369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61241e-5baf-40a0-bb8e-9d2aea8e22a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:57.934278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61241e-5baf-40a0-bb8e-9d2aea8e22a6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:57.934706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61241e-5baf-40a0-bb8e-9d2aea8e22a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:57.935114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61241e-5baf-40a0-bb8e-9d2aea8e22a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:57.976846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e2bcf-cd26-46ce-ac0b-d9e7813c287d None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:58.017465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61241e-5baf-40a0-bb8e-9d2aea8e22a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:58.019089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bdf0c-ff5a-47e8-8db1-b7198624c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:58.019881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bdf0c-ff5a-47e8-8db1-b7198624c0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:58.020294 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bdf0c-ff5a-47e8-8db1-b7198624c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:58.020652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61241e-5baf-40a0-bb8e-9d2aea8e22a6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:58.020774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bdf0c-ff5a-47e8-8db1-b7198624c0e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:58.035727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21bdf0c-ff5a-47e8-8db1-b7198624c0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-c21bdf0c-ff5a-47e8-8db1-b7198624c0e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 15:59:58.041918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:58.042964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 15:59:58.043812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:58.048054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 365/737] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 15:59:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:58.048673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bdf0c-ff5a-47e8-8db1-b7198624c0e1 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:58.072315 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:58.136765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 373/738] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 15:59:58.138165 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61241e-5baf-40a0-bb8e-9d2aea8e22a6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:58.159080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bdf0c-ff5a-47e8-8db1-b7198624c0e1 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:58.163985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:58.196997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360d68a-6c1a-4128-9b17-832b4e653055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:58.197654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360d68a-6c1a-4128-9b17-832b4e653055 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:58.197927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360d68a-6c1a-4128-9b17-832b4e653055 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:58.198749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360d68a-6c1a-4128-9b17-832b4e653055 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:58.199432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360d68a-6c1a-4128-9b17-832b4e653055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:58.199735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360d68a-6c1a-4128-9b17-832b4e653055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:58.201168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360d68a-6c1a-4128-9b17-832b4e653055 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:58.214622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 366/739] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:58.216126 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360d68a-6c1a-4128-9b17-832b4e653055 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:58.254538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61241e-5baf-40a0-bb8e-9d2aea8e22a6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:58.296463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5195f-0ff5-43f6-bde4-02519b28b601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:58.296997 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5195f-0ff5-43f6-bde4-02519b28b601 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:58.297273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5195f-0ff5-43f6-bde4-02519b28b601 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:58.297548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5195f-0ff5-43f6-bde4-02519b28b601 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:58.298206 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5195f-0ff5-43f6-bde4-02519b28b601 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:58.299604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5195f-0ff5-43f6-bde4-02519b28b601 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:58.302481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:58.322502 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360d68a-6c1a-4128-9b17-832b4e653055 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:58.356091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b87f2-49e1-4ae0-a558-04e237cf0e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:58.356682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b87f2-49e1-4ae0-a558-04e237cf0e41 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:58.356958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b87f2-49e1-4ae0-a558-04e237cf0e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:58.357229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b87f2-49e1-4ae0-a558-04e237cf0e41 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:58.357879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b87f2-49e1-4ae0-a558-04e237cf0e41 None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:58.358181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b87f2-49e1-4ae0-a558-04e237cf0e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:58.359598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b87f2-49e1-4ae0-a558-04e237cf0e41 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:58.372226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 367/740] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 15:59:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:58.372226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b87f2-49e1-4ae0-a558-04e237cf0e41 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:58.393266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 374/741] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 15:59:58 2022] POST /identity/v3/services => generated 240 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:59:58.394317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5195f-0ff5-43f6-bde4-02519b28b601 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:58.497683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b87f2-49e1-4ae0-a558-04e237cf0e41 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:58.505870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:58.539614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5195f-0ff5-43f6-bde4-02519b28b601 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:58.544360 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d89621-d339-4fb8-a719-7ce870fd297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:58.545006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d89621-d339-4fb8-a719-7ce870fd297b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:58.545368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d89621-d339-4fb8-a719-7ce870fd297b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:58.545564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d89621-d339-4fb8-a719-7ce870fd297b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:58.553454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:58.579198 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8757f-f74e-4652-af51-480ff197374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:58.580191 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8757f-f74e-4652-af51-480ff197374d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:58.580470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8757f-f74e-4652-af51-480ff197374d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:58.580740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8757f-f74e-4652-af51-480ff197374d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:58.590618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8757f-f74e-4652-af51-480ff197374d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:58.592144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8757f-f74e-4652-af51-480ff197374d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-08b8757f-f74e-4652-af51-480ff197374d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:58.607649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:58.608688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:58.609631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:58.609631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:58.609631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:58.609631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:58.609631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:58.609631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:58.609631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:58.609631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:58.609631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 15:59:58.609631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:58.609631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 375/742] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Sep 8 15:59:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:58.610843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090af81-b0ee-4137-aba8-5a911b6039a0 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:58.610948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090af81-b0ee-4137-aba8-5a911b6039a0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:58.611349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090af81-b0ee-4137-aba8-5a911b6039a0 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:58.612819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 376/743] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 15:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 15:59:58.613897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090af81-b0ee-4137-aba8-5a911b6039a0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:58.673802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d89621-d339-4fb8-a719-7ce870fd297b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:58.677444 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d89621-d339-4fb8-a719-7ce870fd297b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-54d89621-d339-4fb8-a719-7ce870fd297b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:58.695311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:58.696935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:58.698007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:58.698007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:58.698007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:58.705362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 368/744] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:58.705362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d89621-d339-4fb8-a719-7ce870fd297b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:58.755085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090af81-b0ee-4137-aba8-5a911b6039a0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:58.789717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d03627-b0f8-45d8-9f6a-a6d8f78f6b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:58.790437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03627-b0f8-45d8-9f6a-a6d8f78f6b7a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:58.790820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03627-b0f8-45d8-9f6a-a6d8f78f6b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:58.791094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03627-b0f8-45d8-9f6a-a6d8f78f6b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:58.798366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:58.802281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d03627-b0f8-45d8-9f6a-a6d8f78f6b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:58.803861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d03627-b0f8-45d8-9f6a-a6d8f78f6b7a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:58.814605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d89621-d339-4fb8-a719-7ce870fd297b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c7d03627-b0f8-45d8-9f6a-a6d8f78f6b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:58.819258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:58.820528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:58.821630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:58.821630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:58.821630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:58.826741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 377/745] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:58.826741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e9a23-e7c1-4c83-9be1-3d84e887303b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:58.826741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e9a23-e7c1-4c83-9be1-3d84e887303b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:58.826741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e9a23-e7c1-4c83-9be1-3d84e887303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:58.846352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-515e9a23-e7c1-4c83-9be1-3d84e887303b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 15:59:58.847686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-515e9a23-e7c1-4c83-9be1-3d84e887303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 15:59:58.853587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287662a9-0149-47ca-9a44-5ec31cafdda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:58.854269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287662a9-0149-47ca-9a44-5ec31cafdda1 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:58.854640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287662a9-0149-47ca-9a44-5ec31cafdda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:58.855000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287662a9-0149-47ca-9a44-5ec31cafdda1 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:58.855792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287662a9-0149-47ca-9a44-5ec31cafdda1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:58.856085 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287662a9-0149-47ca-9a44-5ec31cafdda1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:58.857506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287662a9-0149-47ca-9a44-5ec31cafdda1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:58.880071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 369/746] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 8 15:59:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:58.880071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287662a9-0149-47ca-9a44-5ec31cafdda1 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:58.927010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 378/747] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 15:59:58 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 15:59:58.928050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e9a23-e7c1-4c83-9be1-3d84e887303b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:58.939935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:58.996325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287662a9-0149-47ca-9a44-5ec31cafdda1 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:59.033283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a424f2-0631-4390-a0f5-35950d8b399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:59.034173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a424f2-0631-4390-a0f5-35950d8b399a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:59.034594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a424f2-0631-4390-a0f5-35950d8b399a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:59.035044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a424f2-0631-4390-a0f5-35950d8b399a None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:59.035947 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a424f2-0631-4390-a0f5-35950d8b399a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:59.036408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a424f2-0631-4390-a0f5-35950d8b399a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:59.038010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a424f2-0631-4390-a0f5-35950d8b399a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:59.047418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e9a23-e7c1-4c83-9be1-3d84e887303b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:59.051822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 370/748] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:59.052851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a424f2-0631-4390-a0f5-35950d8b399a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:59.076180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:59.092322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18068a70-820c-4c31-9d51-150b51e11a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:59.093137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18068a70-820c-4c31-9d51-150b51e11a80 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:59.093739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18068a70-820c-4c31-9d51-150b51e11a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:59.094307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18068a70-820c-4c31-9d51-150b51e11a80 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:59.095602 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18068a70-820c-4c31-9d51-150b51e11a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:59.096231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18068a70-820c-4c31-9d51-150b51e11a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:59.099536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18068a70-820c-4c31-9d51-150b51e11a80 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:59.112410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 379/749] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:59.113758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18068a70-820c-4c31-9d51-150b51e11a80 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:59.158700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a424f2-0631-4390-a0f5-35950d8b399a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:59.167876 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:59.193284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a7839-d047-405b-971a-b8241f8a35c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:59.193743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7839-d047-405b-971a-b8241f8a35c9 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:59.194031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7839-d047-405b-971a-b8241f8a35c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:59.194300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7839-d047-405b-971a-b8241f8a35c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:59.205895 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a7839-d047-405b-971a-b8241f8a35c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:59.207444 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a7839-d047-405b-971a-b8241f8a35c9 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-aa4a7839-d047-405b-971a-b8241f8a35c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 15:59:59.221764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:59.222806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 15:59:59.223713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 15:59:59.223713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 15:59:59.223713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:59.223713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 371/750] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 15:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:59.223713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a7839-d047-405b-971a-b8241f8a35c9 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:59.233123 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18068a70-820c-4c31-9d51-150b51e11a80 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:59.271498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79d8dc-51ec-4b39-ae56-eca66a29a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:59.272399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79d8dc-51ec-4b39-ae56-eca66a29a026 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:59.272858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79d8dc-51ec-4b39-ae56-eca66a29a026 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:59.273303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79d8dc-51ec-4b39-ae56-eca66a29a026 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:59.281565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79d8dc-51ec-4b39-ae56-eca66a29a026 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:59.283483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79d8dc-51ec-4b39-ae56-eca66a29a026 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9e79d8dc-51ec-4b39-ae56-eca66a29a026 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:59.297525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:59.298632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:59.299680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:59.299680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:59.299680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:59.299680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:59.299680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:59.299680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:59.299680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:59.299680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:59.301572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 380/751] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:59.302774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79d8dc-51ec-4b39-ae56-eca66a29a026 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:59.333366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a7839-d047-405b-971a-b8241f8a35c9 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:59.348209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:59.371533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df079bf-6164-4e07-a043-dcb8c8034a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:59.372400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df079bf-6164-4e07-a043-dcb8c8034a38 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:59.372823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df079bf-6164-4e07-a043-dcb8c8034a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:59.373237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df079bf-6164-4e07-a043-dcb8c8034a38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:59.380968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df079bf-6164-4e07-a043-dcb8c8034a38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:59.382574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df079bf-6164-4e07-a043-dcb8c8034a38 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-2df079bf-6164-4e07-a043-dcb8c8034a38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 15:59:59.395165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:59.396122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 372/752] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Sep 8 15:59:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:59.397088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df079bf-6164-4e07-a043-dcb8c8034a38 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:59.424691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:59.425726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79d8dc-51ec-4b39-ae56-eca66a29a026 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:59.461893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2678b-892c-441a-87f3-17fa5833c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:59.462703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2678b-892c-441a-87f3-17fa5833c37b None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:59.463073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2678b-892c-441a-87f3-17fa5833c37b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:59.463419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2678b-892c-441a-87f3-17fa5833c37b None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:59.464197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2678b-892c-441a-87f3-17fa5833c37b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:59.465556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2678b-892c-441a-87f3-17fa5833c37b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:59.503595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df079bf-6164-4e07-a043-dcb8c8034a38 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:59.534357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 381/753] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 15:59:59 2022] POST /identity/v3/services => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 15:59:59.535094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2678b-892c-441a-87f3-17fa5833c37b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:59.550471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399999d-eea7-4ed7-afd7-9adc654f70a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:59.552166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399999d-eea7-4ed7-afd7-9adc654f70a7 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:59.553030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399999d-eea7-4ed7-afd7-9adc654f70a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:59.553567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399999d-eea7-4ed7-afd7-9adc654f70a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:59.554885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399999d-eea7-4ed7-afd7-9adc654f70a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:59.556132 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399999d-eea7-4ed7-afd7-9adc654f70a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:59.558846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399999d-eea7-4ed7-afd7-9adc654f70a7 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:59.577883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 373/754] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 15:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:59.579196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399999d-eea7-4ed7-afd7-9adc654f70a7 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:59.670809 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:59.676902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2678b-892c-441a-87f3-17fa5833c37b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:59.696463 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399999d-eea7-4ed7-afd7-9adc654f70a7 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:59.711521 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:59.726289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ded7f-5b86-465b-8843-694da25f3438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:59.730071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ded7f-5b86-465b-8843-694da25f3438 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:59.730071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ded7f-5b86-465b-8843-694da25f3438 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:59.730071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ded7f-5b86-465b-8843-694da25f3438 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:59.730071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ded7f-5b86-465b-8843-694da25f3438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:59.730071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ded7f-5b86-465b-8843-694da25f3438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:59.731301 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ded7f-5b86-465b-8843-694da25f3438 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:59.738983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f0bcb-583a-4550-81fa-b4b293faf03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:59.739889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f0bcb-583a-4550-81fa-b4b293faf03a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:59.740382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f0bcb-583a-4550-81fa-b4b293faf03a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:59.740663 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f0bcb-583a-4550-81fa-b4b293faf03a None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:59.741456 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f0bcb-583a-4550-81fa-b4b293faf03a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:59.741767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f0bcb-583a-4550-81fa-b4b293faf03a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:59.743250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f0bcb-583a-4550-81fa-b4b293faf03a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:59.744748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 382/755] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:59.746160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ded7f-5b86-465b-8843-694da25f3438 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:59.764021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 374/756] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Sep 8 15:59:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:59.764828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f0bcb-583a-4550-81fa-b4b293faf03a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:59.870282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ded7f-5b86-465b-8843-694da25f3438 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:59.886319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f0bcb-583a-4550-81fa-b4b293faf03a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 15:59:59.907182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af42aa-0a47-4d6d-99fe-8b172c074101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:59.907803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af42aa-0a47-4d6d-99fe-8b172c074101 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:59.908079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af42aa-0a47-4d6d-99fe-8b172c074101 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:59.908440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af42aa-0a47-4d6d-99fe-8b172c074101 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:59.915889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af42aa-0a47-4d6d-99fe-8b172c074101 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:59.918144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af42aa-0a47-4d6d-99fe-8b172c074101 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:59.929052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d403-b959-47a7-9fb4-f2da243b8544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 15:59:59.929892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d403-b959-47a7-9fb4-f2da243b8544 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d3af42aa-0a47-4d6d-99fe-8b172c074101 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 15:59:59.930066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 15:59:59.931261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 15:59:59.932266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 15:59:59.932266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 15:59:59.932266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 15:59:59.932266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 15:59:59.932266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 15:59:59.932266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 15:59:59.932266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 15:59:59.932266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 15:59:59.932266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 383/757] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 15:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 15:59:59.932842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af42aa-0a47-4d6d-99fe-8b172c074101 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:59.933826 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d403-b959-47a7-9fb4-f2da243b8544 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 15:59:59.934271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d403-b959-47a7-9fb4-f2da243b8544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 15:59:59.942693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469d403-b959-47a7-9fb4-f2da243b8544 None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=50c9553845ba42e78de0293fd3a338d1) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 15:59:59.942693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469d403-b959-47a7-9fb4-f2da243b8544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 15:59:59.942693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469d403-b959-47a7-9fb4-f2da243b8544 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 15:59:59.947633 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 15:59:59.947912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 375/758] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 15:59:59 2022] GET /identity/v3/role_assignments?user.id=50c9553845ba42e78de0293fd3a338d1&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=519b356d36364663a59265dc7eeff0b8 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 15:59:59.949575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d403-b959-47a7-9fb4-f2da243b8544 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 15:59:59.956795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:00.059021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af42aa-0a47-4d6d-99fe-8b172c074101 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:00.102134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d403-b959-47a7-9fb4-f2da243b8544 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:00.127445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d3bb4-ef8d-4f6d-bdac-cd645aa13e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:00.128079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3bb4-ef8d-4f6d-bdac-cd645aa13e9b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:00.128356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3bb4-ef8d-4f6d-bdac-cd645aa13e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:00.128630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3bb4-ef8d-4f6d-bdac-cd645aa13e9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:00.140919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a3947-0fb6-4593-b256-bec2d6e9f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:00.142439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a3947-0fb6-4593-b256-bec2d6e9f047 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:00.142954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a3947-0fb6-4593-b256-bec2d6e9f047 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:00.143427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a3947-0fb6-4593-b256-bec2d6e9f047 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:00.144337 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a3947-0fb6-4593-b256-bec2d6e9f047 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:00.144862 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a3947-0fb6-4593-b256-bec2d6e9f047 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:00.146644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a3947-0fb6-4593-b256-bec2d6e9f047 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:00.160970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 376/759] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 15:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:00.167717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a3947-0fb6-4593-b256-bec2d6e9f047 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:00.272451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:00.275704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d3bb4-ef8d-4f6d-bdac-cd645aa13e9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:00.277219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d3bb4-ef8d-4f6d-bdac-cd645aa13e9b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:00.311400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:00.372734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a3947-0fb6-4593-b256-bec2d6e9f047 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:00.394984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 384/760] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 15:59:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:00.401759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d3bb4-ef8d-4f6d-bdac-cd645aa13e9b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:00.436180 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128dc6-8d45-4950-b626-5bc12f928181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:00.436859 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128dc6-8d45-4950-b626-5bc12f928181 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:00.437138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128dc6-8d45-4950-b626-5bc12f928181 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:00.437412 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128dc6-8d45-4950-b626-5bc12f928181 None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/41f7a6292d004a648c3c92526d1304ec/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:00.443467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5128dc6-8d45-4950-b626-5bc12f928181 None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=41f7a6292d004a648c3c92526d1304ec, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:00.444930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5128dc6-8d45-4950-b626-5bc12f928181 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:00.504316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 377/761] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 16:00:00 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/41f7a6292d004a648c3c92526d1304ec/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:00:00.548177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d3bb4-ef8d-4f6d-bdac-cd645aa13e9b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:00.579051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:00.595955 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597f7f0-108d-4afb-9cf8-3b64857eae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:00.596606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597f7f0-108d-4afb-9cf8-3b64857eae3b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:00.596884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597f7f0-108d-4afb-9cf8-3b64857eae3b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:00.597155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597f7f0-108d-4afb-9cf8-3b64857eae3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:00.609488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597f7f0-108d-4afb-9cf8-3b64857eae3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:00.610989 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597f7f0-108d-4afb-9cf8-3b64857eae3b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9597f7f0-108d-4afb-9cf8-3b64857eae3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:00.635056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:00.636112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:00.637022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:00.637022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:00.637022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:00.637022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 385/762] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:00.643556 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128dc6-8d45-4950-b626-5bc12f928181 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:00.676164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05891830-ed50-4d6d-b50d-808708f94af8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:00.676448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05891830-ed50-4d6d-b50d-808708f94af8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:00.676745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05891830-ed50-4d6d-b50d-808708f94af8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:00.678103 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 386/763] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:00:00.684137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d7c04-3385-44a9-adea-060fdb2aaf24 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:00.684558 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d7c04-3385-44a9-adea-060fdb2aaf24 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:00.684933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d7c04-3385-44a9-adea-060fdb2aaf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:00.708424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-562d7c04-3385-44a9-adea-060fdb2aaf24 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:00.709899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-562d7c04-3385-44a9-adea-060fdb2aaf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:00.783539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128dc6-8d45-4950-b626-5bc12f928181 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:00.804574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:00.825569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 387/764] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:00.826267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e894cde-1ea1-46a5-a01c-ded06290b831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:00.826963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e894cde-1ea1-46a5-a01c-ded06290b831 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:00.827247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e894cde-1ea1-46a5-a01c-ded06290b831 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:00.830886 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e894cde-1ea1-46a5-a01c-ded06290b831 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:00.830886 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e894cde-1ea1-46a5-a01c-ded06290b831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:00.830886 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e894cde-1ea1-46a5-a01c-ded06290b831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:00.830886 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e894cde-1ea1-46a5-a01c-ded06290b831 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:00.849822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 378/765] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:00.856153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d7c04-3385-44a9-adea-060fdb2aaf24 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:01.001519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d7c04-3385-44a9-adea-060fdb2aaf24 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:01.019254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:01.052355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1e5af-0a4a-4d27-911a-266a982f6d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:01.053001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e5af-0a4a-4d27-911a-266a982f6d38 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:01.053273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e5af-0a4a-4d27-911a-266a982f6d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:01.053542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e5af-0a4a-4d27-911a-266a982f6d38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:01.060986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1e5af-0a4a-4d27-911a-266a982f6d38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:01.062375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1e5af-0a4a-4d27-911a-266a982f6d38 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-16a1e5af-0a4a-4d27-911a-266a982f6d38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:01.083420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:01.084357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:01.085328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:01.085328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:01.085328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:01.085328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:01.085328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:01.085328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:01.085328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:01.085328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:01.085328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 388/766] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:01.090530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e894cde-1ea1-46a5-a01c-ded06290b831 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:01.102823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1e5af-0a4a-4d27-911a-266a982f6d38 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:01.241887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1e5af-0a4a-4d27-911a-266a982f6d38 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:01.283199 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b9c5a-673f-4050-81dc-62158ddeb246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:01.284469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b9c5a-673f-4050-81dc-62158ddeb246 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:01.284982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b9c5a-673f-4050-81dc-62158ddeb246 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:01.285730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b9c5a-673f-4050-81dc-62158ddeb246 None admin] PATH_INFO: `/v3/services/network` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:01.286525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b9c5a-673f-4050-81dc-62158ddeb246 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:01.288640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b9c5a-673f-4050-81dc-62158ddeb246 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c92b9c5a-673f-4050-81dc-62158ddeb246 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:01.299926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:01.300927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 16:00:01.301770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:01.304861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 389/767] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:01 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:01.311071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b9c5a-673f-4050-81dc-62158ddeb246 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:01.318096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e894cde-1ea1-46a5-a01c-ded06290b831 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:01.350007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:01.387949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e104f-bb43-4170-8333-c32f1c5c9f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:01.388929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e104f-bb43-4170-8333-c32f1c5c9f6d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:01.389615 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e104f-bb43-4170-8333-c32f1c5c9f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:01.391683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e104f-bb43-4170-8333-c32f1c5c9f6d None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:01.393038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e104f-bb43-4170-8333-c32f1c5c9f6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:01.394592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e104f-bb43-4170-8333-c32f1c5c9f6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:01.396281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e104f-bb43-4170-8333-c32f1c5c9f6d None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:01.418419 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 379/768] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:01.430355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e104f-bb43-4170-8333-c32f1c5c9f6d None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:01.491971 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b9c5a-673f-4050-81dc-62158ddeb246 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:01.513417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:01.532398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818e6e0-9002-494d-82c7-a584bc0a308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:01.533478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818e6e0-9002-494d-82c7-a584bc0a308e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:01.533723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818e6e0-9002-494d-82c7-a584bc0a308e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:01.533998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818e6e0-9002-494d-82c7-a584bc0a308e None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:01.534825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818e6e0-9002-494d-82c7-a584bc0a308e None admin] RBAC: Adding query filter params (name=network) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:01.535129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818e6e0-9002-494d-82c7-a584bc0a308e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:01.536551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818e6e0-9002-494d-82c7-a584bc0a308e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:01.543823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 390/769] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 16:00:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:01.549508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818e6e0-9002-494d-82c7-a584bc0a308e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:01.623506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e104f-bb43-4170-8333-c32f1c5c9f6d None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:01.662978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03864cb-51a0-48da-b798-f731a6713968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:01.663726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03864cb-51a0-48da-b798-f731a6713968 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:01.664006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03864cb-51a0-48da-b798-f731a6713968 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:01.664333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03864cb-51a0-48da-b798-f731a6713968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:01.665063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03864cb-51a0-48da-b798-f731a6713968 None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=ce22dab95b864b84812335cc050ca2c7) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:01.665420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03864cb-51a0-48da-b798-f731a6713968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:01.667452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03864cb-51a0-48da-b798-f731a6713968 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:01.673927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 380/770] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:00:01 2022] GET /identity/v3/role_assignments?user.id=ce22dab95b864b84812335cc050ca2c7&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:01.726796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:01.737378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818e6e0-9002-494d-82c7-a584bc0a308e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:01.776933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88844963-8b1c-48b4-84f8-b5ec7734a4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:01.777686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88844963-8b1c-48b4-84f8-b5ec7734a4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:01.778002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88844963-8b1c-48b4-84f8-b5ec7734a4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:01.778280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88844963-8b1c-48b4-84f8-b5ec7734a4a3 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:01.778989 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88844963-8b1c-48b4-84f8-b5ec7734a4a3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:01.779293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88844963-8b1c-48b4-84f8-b5ec7734a4a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:01.780713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88844963-8b1c-48b4-84f8-b5ec7734a4a3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:01.787288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 391/771] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 16:00:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:01.793191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03864cb-51a0-48da-b798-f731a6713968 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:01.907167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03864cb-51a0-48da-b798-f731a6713968 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:01.908592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:01.946404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2728cdb-2c3c-49fd-95c0-717d65f6e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:01.947063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728cdb-2c3c-49fd-95c0-717d65f6e1ec None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:01.947339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728cdb-2c3c-49fd-95c0-717d65f6e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:01.947730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728cdb-2c3c-49fd-95c0-717d65f6e1ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:01.948996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2728cdb-2c3c-49fd-95c0-717d65f6e1ec None admin] RBAC: Adding query filter params (interface=public, service_id=1ed04669d9c7400c83f7cac64bc0bf5f, region_id=RegionOne) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:01.949307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2728cdb-2c3c-49fd-95c0-717d65f6e1ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:01.950746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2728cdb-2c3c-49fd-95c0-717d65f6e1ec None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:01.959954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 381/772] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Sep 8 16:00:01 2022] GET /identity/v3/endpoints?service_id=1ed04669d9c7400c83f7cac64bc0bf5f&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:01.966745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88844963-8b1c-48b4-84f8-b5ec7734a4a3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:02.081062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88844963-8b1c-48b4-84f8-b5ec7734a4a3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:02.116629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870630d-dddb-43d4-b7f8-94c8ddab030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:02.117243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870630d-dddb-43d4-b7f8-94c8ddab030f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:02.117518 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870630d-dddb-43d4-b7f8-94c8ddab030f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:02.117789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870630d-dddb-43d4-b7f8-94c8ddab030f None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:02.118392 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870630d-dddb-43d4-b7f8-94c8ddab030f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:02.119796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870630d-dddb-43d4-b7f8-94c8ddab030f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:02.126126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 392/773] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Sep 8 16:00:01 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:02.142569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cbc46-4c5d-410c-8074-ead92f1b1729 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:02.143121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cbc46-4c5d-410c-8074-ead92f1b1729 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:02.143121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cbc46-4c5d-410c-8074-ead92f1b1729 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:02.144623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 382/774] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:02.150641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420590b-8189-4d4a-97a2-c698d486d63e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:02.151330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420590b-8189-4d4a-97a2-c698d486d63e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:02.151833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420590b-8189-4d4a-97a2-c698d486d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:02.171550 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9420590b-8189-4d4a-97a2-c698d486d63e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:02.173098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9420590b-8189-4d4a-97a2-c698d486d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:02.188742 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:02.262798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 393/775] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:02.531170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cbc46-4c5d-410c-8074-ead92f1b1729 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:02.664291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cbc46-4c5d-410c-8074-ead92f1b1729 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:02.708316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18dd85-fc99-456f-b4b6-80cf9f0b81d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:02.709059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18dd85-fc99-456f-b4b6-80cf9f0b81d1 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:02.709341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18dd85-fc99-456f-b4b6-80cf9f0b81d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:02.709616 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18dd85-fc99-456f-b4b6-80cf9f0b81d1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:02.710208 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18dd85-fc99-456f-b4b6-80cf9f0b81d1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:02.711613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18dd85-fc99-456f-b4b6-80cf9f0b81d1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-8d18dd85-fc99-456f-b4b6-80cf9f0b81d1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:02.722017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:02.723051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 16:00:02.723881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:02.726748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 383/776] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Sep 8 16:00:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:02.729950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420590b-8189-4d4a-97a2-c698d486d63e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:02.872476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420590b-8189-4d4a-97a2-c698d486d63e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:02.887920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58969df-be87-48ae-bff0-f838a5ec3a4a None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:02.888766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58969df-be87-48ae-bff0-f838a5ec3a4a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:02.889054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58969df-be87-48ae-bff0-f838a5ec3a4a None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:02.894421 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 384/777] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:02.898828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1913-62f8-41a3-ac7d-bcfcd9116e19 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:02.905911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1913-62f8-41a3-ac7d-bcfcd9116e19 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:02.905911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1913-62f8-41a3-ac7d-bcfcd9116e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:02.921022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2f050-06fa-48fe-b53d-b1d60fbe7435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:02.921957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2f050-06fa-48fe-b53d-b1d60fbe7435 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:02.922426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2f050-06fa-48fe-b53d-b1d60fbe7435 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:02.922940 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2f050-06fa-48fe-b53d-b1d60fbe7435 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:02.923758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2f050-06fa-48fe-b53d-b1d60fbe7435 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:02.924250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2f050-06fa-48fe-b53d-b1d60fbe7435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:02.926010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2f050-06fa-48fe-b53d-b1d60fbe7435 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:02.931366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 394/778] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 8 16:00:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:02.936225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-9edd1913-62f8-41a3-ac7d-bcfcd9116e19 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:02.937451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9edd1913-62f8-41a3-ac7d-bcfcd9116e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:02.945257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2f050-06fa-48fe-b53d-b1d60fbe7435 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:02.972610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:02.985445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:03.065118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 385/779] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:03.119623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2f050-06fa-48fe-b53d-b1d60fbe7435 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:03.162645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c721deb-98fe-4195-aa36-66c254c52ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:03.163281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c721deb-98fe-4195-aa36-66c254c52ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:03.163559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c721deb-98fe-4195-aa36-66c254c52ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:03.163830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c721deb-98fe-4195-aa36-66c254c52ee7 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:03.164461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c721deb-98fe-4195-aa36-66c254c52ee7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:03.164818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c721deb-98fe-4195-aa36-66c254c52ee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:03.166184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c721deb-98fe-4195-aa36-66c254c52ee7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:03.175170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 395/780] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 8 16:00:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:03.181060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd1913-62f8-41a3-ac7d-bcfcd9116e19 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:03.191125 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926a6a1-e875-4b67-825f-d200b21e348b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:03.191406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926a6a1-e875-4b67-825f-d200b21e348b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:03.191682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926a6a1-e875-4b67-825f-d200b21e348b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:03.193268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 396/781] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:03.198974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5330-1f1d-4d5c-a64b-7ccbbd35fa8b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:03.199253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5330-1f1d-4d5c-a64b-7ccbbd35fa8b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:03.199526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5330-1f1d-4d5c-a64b-7ccbbd35fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:03.218248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-657b5330-1f1d-4d5c-a64b-7ccbbd35fa8b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:03.219481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-657b5330-1f1d-4d5c-a64b-7ccbbd35fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:03.332959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 397/782] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:03.354396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd1913-62f8-41a3-ac7d-bcfcd9116e19 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:03.405070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31808d09-1bda-4cb4-9ff5-ddcae582668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:03.405689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31808d09-1bda-4cb4-9ff5-ddcae582668c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:03.405966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31808d09-1bda-4cb4-9ff5-ddcae582668c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:03.406233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31808d09-1bda-4cb4-9ff5-ddcae582668c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:03.406959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31808d09-1bda-4cb4-9ff5-ddcae582668c None admin] RBAC: Adding query filter params (interface=public, service_id=0c06b12977764afb8ed9040811308c3f, region_id=RegionOne) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:03.407265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31808d09-1bda-4cb4-9ff5-ddcae582668c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:03.413969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31808d09-1bda-4cb4-9ff5-ddcae582668c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:03.417764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 386/783] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Sep 8 16:00:03 2022] GET /identity/v3/endpoints?service_id=0c06b12977764afb8ed9040811308c3f&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:03.423463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b5330-1f1d-4d5c-a64b-7ccbbd35fa8b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:03.432107 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:03.449171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31808d09-1bda-4cb4-9ff5-ddcae582668c None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:03.488411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:03.602735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b5330-1f1d-4d5c-a64b-7ccbbd35fa8b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:03.631406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31808d09-1bda-4cb4-9ff5-ddcae582668c None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:03.675217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acc7ad-19ef-4a84-b5e0-98b8cfcfe34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:03.675836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acc7ad-19ef-4a84-b5e0-98b8cfcfe34c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:03.676114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acc7ad-19ef-4a84-b5e0-98b8cfcfe34c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:03.676555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acc7ad-19ef-4a84-b5e0-98b8cfcfe34c None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:03.677308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acc7ad-19ef-4a84-b5e0-98b8cfcfe34c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:03.679075 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acc7ad-19ef-4a84-b5e0-98b8cfcfe34c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:03.684201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c22f-3f86-4488-ae9d-3d268c301b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:03.684835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c22f-3f86-4488-ae9d-3d268c301b9e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:03.685110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c22f-3f86-4488-ae9d-3d268c301b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:03.685375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c22f-3f86-4488-ae9d-3d268c301b9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:03.697762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 398/784] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Sep 8 16:00:03 2022] GET /identity/v3/services => generated 772 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:03.711617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3c22f-3f86-4488-ae9d-3d268c301b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:03.716575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acc7ad-19ef-4a84-b5e0-98b8cfcfe34c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-6ee3c22f-3f86-4488-ae9d-3d268c301b9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:03.720477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:03.721648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:03.722719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 387/785] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:03.730931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c22f-3f86-4488-ae9d-3d268c301b9e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:03.795055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:03.828529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acc7ad-19ef-4a84-b5e0-98b8cfcfe34c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:03.864771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed66ce-28c9-483f-b84d-ddccbbc63bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:03.865678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed66ce-28c9-483f-b84d-ddccbbc63bac None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:03.866105 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed66ce-28c9-483f-b84d-ddccbbc63bac None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:03.866521 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed66ce-28c9-483f-b84d-ddccbbc63bac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:03.876447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:03.879730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed66ce-28c9-483f-b84d-ddccbbc63bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-aeed66ce-28c9-483f-b84d-ddccbbc63bac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:03.884798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:03.886476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:03.894444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 399/786] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:03.895188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c22f-3f86-4488-ae9d-3d268c301b9e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:03.896557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed66ce-28c9-483f-b84d-ddccbbc63bac None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:03.935347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2496c-04f5-4d39-b7ec-ee9f122bfbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:03.935596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2496c-04f5-4d39-b7ec-ee9f122bfbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:03.935780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2496c-04f5-4d39-b7ec-ee9f122bfbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:03.936013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2496c-04f5-4d39-b7ec-ee9f122bfbd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:03.936737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2496c-04f5-4d39-b7ec-ee9f122bfbd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:03.937043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2496c-04f5-4d39-b7ec-ee9f122bfbd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:03.938507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2496c-04f5-4d39-b7ec-ee9f122bfbd6 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:03.960554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 388/787] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:00:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:03.963487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2496c-04f5-4d39-b7ec-ee9f122bfbd6 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:04.008328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed66ce-28c9-483f-b84d-ddccbbc63bac None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:04.043182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:04.048275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e55955-6450-4f39-ac76-da127a276ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:04.049150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e55955-6450-4f39-ac76-da127a276ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:04.049606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e55955-6450-4f39-ac76-da127a276ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:04.050053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e55955-6450-4f39-ac76-da127a276ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:04.050992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e55955-6450-4f39-ac76-da127a276ff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:04.051577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e55955-6450-4f39-ac76-da127a276ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:04.056623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e55955-6450-4f39-ac76-da127a276ff0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:04.062882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 400/788] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:00:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:04.068837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e55955-6450-4f39-ac76-da127a276ff0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:04.097730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2496c-04f5-4d39-b7ec-ee9f122bfbd6 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:04.133602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5c936-bdee-4fae-864f-f8dca14b5bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:04.134209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c936-bdee-4fae-864f-f8dca14b5bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:04.134485 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c936-bdee-4fae-864f-f8dca14b5bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:04.134785 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5c936-bdee-4fae-864f-f8dca14b5bd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:04.147146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5c936-bdee-4fae-864f-f8dca14b5bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:04.147861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5c936-bdee-4fae-864f-f8dca14b5bd2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:04.155670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-67d5c936-bdee-4fae-864f-f8dca14b5bd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:04.168239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:04.175643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:04.176773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:04.176773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:04.176773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:04.176773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 389/789] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:04.178176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5c936-bdee-4fae-864f-f8dca14b5bd2 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:04.185982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e55955-6450-4f39-ac76-da127a276ff0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:04.221737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19ae8-3a7f-48f1-8d63-074b7200492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:04.223068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19ae8-3a7f-48f1-8d63-074b7200492b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:04.223447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19ae8-3a7f-48f1-8d63-074b7200492b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:04.223888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19ae8-3a7f-48f1-8d63-074b7200492b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:04.239180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c19ae8-3a7f-48f1-8d63-074b7200492b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:04.241084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c19ae8-3a7f-48f1-8d63-074b7200492b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e7c19ae8-3a7f-48f1-8d63-074b7200492b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:04.257536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:04.258725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:04.259624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:04.259624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:04.259624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:04.261551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 401/790] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:04.267478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19ae8-3a7f-48f1-8d63-074b7200492b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:04.296470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5c936-bdee-4fae-864f-f8dca14b5bd2 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:04.317727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:04.337938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45f3bf-fbdc-4f28-b567-ca7a478d86b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:04.339108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45f3bf-fbdc-4f28-b567-ca7a478d86b3 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:04.339385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45f3bf-fbdc-4f28-b567-ca7a478d86b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:04.339652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45f3bf-fbdc-4f28-b567-ca7a478d86b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:04.340354 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45f3bf-fbdc-4f28-b567-ca7a478d86b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:04.340655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45f3bf-fbdc-4f28-b567-ca7a478d86b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:04.342071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45f3bf-fbdc-4f28-b567-ca7a478d86b3 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:04.360961 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 390/791] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:04.362430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45f3bf-fbdc-4f28-b567-ca7a478d86b3 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:04.378527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19ae8-3a7f-48f1-8d63-074b7200492b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:04.431434 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e4244-d88a-4ef4-95a8-f77c5a03ccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:04.432348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4244-d88a-4ef4-95a8-f77c5a03ccba None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:04.432880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4244-d88a-4ef4-95a8-f77c5a03ccba None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:04.433367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e4244-d88a-4ef4-95a8-f77c5a03ccba None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:04.434271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e4244-d88a-4ef4-95a8-f77c5a03ccba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:04.434865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e4244-d88a-4ef4-95a8-f77c5a03ccba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:04.436432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e4244-d88a-4ef4-95a8-f77c5a03ccba None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:04.447336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:04.450234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 402/792] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:04.455949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b01a-27ce-4094-ae85-201616e62c5d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:04.462795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b01a-27ce-4094-ae85-201616e62c5d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:04.462795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b01a-27ce-4094-ae85-201616e62c5d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:04.462795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 403/793] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:04.462795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420b01a-27ce-4094-ae85-201616e62c5d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:04.494212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45f3bf-fbdc-4f28-b567-ca7a478d86b3 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:04.533633 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22b03a-cbe7-42ae-b3c0-25ba9b4c2838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:04.534272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22b03a-cbe7-42ae-b3c0-25ba9b4c2838 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:04.534546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22b03a-cbe7-42ae-b3c0-25ba9b4c2838 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:04.534840 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22b03a-cbe7-42ae-b3c0-25ba9b4c2838 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:04.543184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22b03a-cbe7-42ae-b3c0-25ba9b4c2838 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:04.544803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22b03a-cbe7-42ae-b3c0-25ba9b4c2838 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-ea22b03a-cbe7-42ae-b3c0-25ba9b4c2838 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:04.557810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:04.559108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:04.560091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:04.560091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:04.560091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:04.560091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:04.560091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:04.560091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:04.560091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:04.560091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:04.560091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 16:00:04.560091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:04.563703 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 391/794] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:00:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:04.564956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec9f3a-32bf-405d-ac72-403df25c493b None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:04.565221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec9f3a-32bf-405d-ac72-403df25c493b None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:04.565486 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec9f3a-32bf-405d-ac72-403df25c493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:04.574341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420b01a-27ce-4094-ae85-201616e62c5d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:04.576888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:04.588142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b5ec9f3a-32bf-405d-ac72-403df25c493b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:04.591670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b5ec9f3a-32bf-405d-ac72-403df25c493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:04.612677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c89a11-4709-4dbf-9be5-e5810c260e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:04.613037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c89a11-4709-4dbf-9be5-e5810c260e25 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:04.613313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c89a11-4709-4dbf-9be5-e5810c260e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:04.613637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c89a11-4709-4dbf-9be5-e5810c260e25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:04.621580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c89a11-4709-4dbf-9be5-e5810c260e25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:04.623130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c89a11-4709-4dbf-9be5-e5810c260e25 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-71c89a11-4709-4dbf-9be5-e5810c260e25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:04.635807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:04.636800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:04.637720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:04.637720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:04.637720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:04.637720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:04.637720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:04.637720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:04.637720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:04.637720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:04.637720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 16:00:04.637720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:04.641735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 404/795] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Sep 8 16:00:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:04.643106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c89a11-4709-4dbf-9be5-e5810c260e25 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:04.670967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 392/796] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:04.672293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec9f3a-32bf-405d-ac72-403df25c493b None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:04.725701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:04.749040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c89a11-4709-4dbf-9be5-e5810c260e25 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:04.792941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523efcf1-7ec5-4e67-ac9c-e6fb95c73e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:04.794280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523efcf1-7ec5-4e67-ac9c-e6fb95c73e3b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:04.794563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523efcf1-7ec5-4e67-ac9c-e6fb95c73e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:04.794856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523efcf1-7ec5-4e67-ac9c-e6fb95c73e3b None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:04.795599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523efcf1-7ec5-4e67-ac9c-e6fb95c73e3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:04.795902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523efcf1-7ec5-4e67-ac9c-e6fb95c73e3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:04.797355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523efcf1-7ec5-4e67-ac9c-e6fb95c73e3b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:04.805966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec9f3a-32bf-405d-ac72-403df25c493b None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:04.839460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 405/797] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Sep 8 16:00:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:04.848151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523efcf1-7ec5-4e67-ac9c-e6fb95c73e3b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:04.877562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4be1-db86-401f-9ef9-257407539710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:04.878185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4be1-db86-401f-9ef9-257407539710 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:04.878457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4be1-db86-401f-9ef9-257407539710 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:04.878747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4be1-db86-401f-9ef9-257407539710 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:04.879487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa4be1-db86-401f-9ef9-257407539710 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:04.879792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa4be1-db86-401f-9ef9-257407539710 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:04.881230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa4be1-db86-401f-9ef9-257407539710 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:04.897995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:04.932960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 393/798] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 8 16:00:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:04.941627 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4be1-db86-401f-9ef9-257407539710 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:05.000516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523efcf1-7ec5-4e67-ac9c-e6fb95c73e3b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:05.038327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a8db9-b2cf-49ba-98f7-fc3ce87563a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:05.038985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a8db9-b2cf-49ba-98f7-fc3ce87563a5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:05.039260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a8db9-b2cf-49ba-98f7-fc3ce87563a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:05.039530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a8db9-b2cf-49ba-98f7-fc3ce87563a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:05.052828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a8db9-b2cf-49ba-98f7-fc3ce87563a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:05.054311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a8db9-b2cf-49ba-98f7-fc3ce87563a5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-871a8db9-b2cf-49ba-98f7-fc3ce87563a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:05.072420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:05.074014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:05.075033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:05.075033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:05.075033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:05.078774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 406/799] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:05.080273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a8db9-b2cf-49ba-98f7-fc3ce87563a5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:05.091981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4be1-db86-401f-9ef9-257407539710 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:05.103167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:05.136395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1916d-6d07-40e3-a120-f6f7b4bb4b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:05.137470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1916d-6d07-40e3-a120-f6f7b4bb4b90 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:05.137984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1916d-6d07-40e3-a120-f6f7b4bb4b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:05.138521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1916d-6d07-40e3-a120-f6f7b4bb4b90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:05.176846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:05.206878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a8db9-b2cf-49ba-98f7-fc3ce87563a5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:05.208921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1916d-6d07-40e3-a120-f6f7b4bb4b90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:05.210384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1916d-6d07-40e3-a120-f6f7b4bb4b90 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:05.246069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0010e1-2b1e-4444-aa8a-daf3fb458553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:05.246726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0010e1-2b1e-4444-aa8a-daf3fb458553 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:05.247008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0010e1-2b1e-4444-aa8a-daf3fb458553 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:05.247279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0010e1-2b1e-4444-aa8a-daf3fb458553 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:05.257687 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0010e1-2b1e-4444-aa8a-daf3fb458553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-cc0010e1-2b1e-4444-aa8a-daf3fb458553 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:05.263489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:05.264587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:05.265459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 407/800] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 16:00:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:05.266164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0010e1-2b1e-4444-aa8a-daf3fb458553 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:05.322207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 394/801] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:00:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 16:00:05.324679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa7933-6e1b-4a80-b4a9-55ab95f0d38a None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:05.325006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa7933-6e1b-4a80-b4a9-55ab95f0d38a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:05.325243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa7933-6e1b-4a80-b4a9-55ab95f0d38a None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:05.330548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 395/802] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:05.330548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa7933-6e1b-4a80-b4a9-55ab95f0d38a None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:05.336160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:05.379318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0010e1-2b1e-4444-aa8a-daf3fb458553 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:05.425546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f9ffd-62c4-4dd8-aa25-c86a546c8e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:05.426171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f9ffd-62c4-4dd8-aa25-c86a546c8e92 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:05.426452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f9ffd-62c4-4dd8-aa25-c86a546c8e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:05.426784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f9ffd-62c4-4dd8-aa25-c86a546c8e92 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:05.427379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f9ffd-62c4-4dd8-aa25-c86a546c8e92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:05.427677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f9ffd-62c4-4dd8-aa25-c86a546c8e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:05.429500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f9ffd-62c4-4dd8-aa25-c86a546c8e92 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:05.431232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:05.438016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa7933-6e1b-4a80-b4a9-55ab95f0d38a None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:05.448692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 408/803] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:05.448692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f9ffd-62c4-4dd8-aa25-c86a546c8e92 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:05.476000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2efd06-9621-40f4-ae81-d3eb224a0e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:05.476610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2efd06-9621-40f4-ae81-d3eb224a0e75 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:05.476890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2efd06-9621-40f4-ae81-d3eb224a0e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:05.477164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2efd06-9621-40f4-ae81-d3eb224a0e75 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:05.477820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2efd06-9621-40f4-ae81-d3eb224a0e75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:05.478125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2efd06-9621-40f4-ae81-d3eb224a0e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:05.480053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2efd06-9621-40f4-ae81-d3eb224a0e75 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:05.487777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 396/804] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 16:00:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:05.488913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e456fc-8b62-45ef-a6f6-4503e31cf629 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:05.489194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e456fc-8b62-45ef-a6f6-4503e31cf629 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:05.489468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e456fc-8b62-45ef-a6f6-4503e31cf629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:05.507015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a0e456fc-8b62-45ef-a6f6-4503e31cf629 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:05.508259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a0e456fc-8b62-45ef-a6f6-4503e31cf629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:05.558986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f9ffd-62c4-4dd8-aa25-c86a546c8e92 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:05.567458 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:05.572460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 397/805] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:05.573295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e456fc-8b62-45ef-a6f6-4503e31cf629 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:05.606959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d36e09-5068-49fc-b2bf-9c43114bfbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:05.607594 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d36e09-5068-49fc-b2bf-9c43114bfbbe None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:05.607872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d36e09-5068-49fc-b2bf-9c43114bfbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:05.608144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d36e09-5068-49fc-b2bf-9c43114bfbbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:05.618645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d36e09-5068-49fc-b2bf-9c43114bfbbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:05.620695 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d36e09-5068-49fc-b2bf-9c43114bfbbe None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c2d36e09-5068-49fc-b2bf-9c43114bfbbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:05.635574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:05.636553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:05.637475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:05.637475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:05.637475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:05.637475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 409/806] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:05.637848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d36e09-5068-49fc-b2bf-9c43114bfbbe None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:05.699375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:05.717667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e456fc-8b62-45ef-a6f6-4503e31cf629 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:05.763231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d36e09-5068-49fc-b2bf-9c43114bfbbe None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:05.767225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53acc99-917d-474f-9b0e-46d742908c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:05.767880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53acc99-917d-474f-9b0e-46d742908c65 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:05.768168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53acc99-917d-474f-9b0e-46d742908c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:05.768437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53acc99-917d-474f-9b0e-46d742908c65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:05.779601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53acc99-917d-474f-9b0e-46d742908c65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:05.782119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53acc99-917d-474f-9b0e-46d742908c65 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-b53acc99-917d-474f-9b0e-46d742908c65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:05.799152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:05.800070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:05.800971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:05.800971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:05.800971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:05.800971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:05.800971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:05.800971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:05.800971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:05.800971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:05.803045 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 398/807] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:05.804074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53acc99-917d-474f-9b0e-46d742908c65 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:05.805615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22319bf-e42d-4da8-b486-a3bf6f079320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:05.806384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22319bf-e42d-4da8-b486-a3bf6f079320 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:05.806822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22319bf-e42d-4da8-b486-a3bf6f079320 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:05.807224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22319bf-e42d-4da8-b486-a3bf6f079320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:05.821086 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22319bf-e42d-4da8-b486-a3bf6f079320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:05.822819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22319bf-e42d-4da8-b486-a3bf6f079320 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f22319bf-e42d-4da8-b486-a3bf6f079320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:05.840322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:05.841322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:05.842220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:05.842220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:05.842220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:05.842220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 410/808] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:05.843057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22319bf-e42d-4da8-b486-a3bf6f079320 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:05.882688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:05.929181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53acc99-917d-474f-9b0e-46d742908c65 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:05.956356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:05.961120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22319bf-e42d-4da8-b486-a3bf6f079320 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:05.964326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a85d-8858-49f4-aac9-1c25a99be894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:05.964940 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a85d-8858-49f4-aac9-1c25a99be894 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:05.965216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a85d-8858-49f4-aac9-1c25a99be894 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:05.965492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a85d-8858-49f4-aac9-1c25a99be894 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:05.966132 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4a85d-8858-49f4-aac9-1c25a99be894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:05.970650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4a85d-8858-49f4-aac9-1c25a99be894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:05.970650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4a85d-8858-49f4-aac9-1c25a99be894 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:05.980632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 399/809] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:05.981448 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a85d-8858-49f4-aac9-1c25a99be894 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:06.005005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915eecd-eb7e-422e-a72b-76a6b14a46f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:06.005618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915eecd-eb7e-422e-a72b-76a6b14a46f9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.005902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915eecd-eb7e-422e-a72b-76a6b14a46f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.006157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915eecd-eb7e-422e-a72b-76a6b14a46f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.006876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915eecd-eb7e-422e-a72b-76a6b14a46f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:06.007181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915eecd-eb7e-422e-a72b-76a6b14a46f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:06.008641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915eecd-eb7e-422e-a72b-76a6b14a46f9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:06.021116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 411/810] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:06.021851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915eecd-eb7e-422e-a72b-76a6b14a46f9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:06.093911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a85d-8858-49f4-aac9-1c25a99be894 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:06.113718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:06.128892 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915eecd-eb7e-422e-a72b-76a6b14a46f9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:06.133528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97cbe8-f5c2-4e9e-8f86-10ba1f98b1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:06.134150 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97cbe8-f5c2-4e9e-8f86-10ba1f98b1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.134430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97cbe8-f5c2-4e9e-8f86-10ba1f98b1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.134734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97cbe8-f5c2-4e9e-8f86-10ba1f98b1b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.135424 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97cbe8-f5c2-4e9e-8f86-10ba1f98b1b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:06.135729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97cbe8-f5c2-4e9e-8f86-10ba1f98b1b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:06.137698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97cbe8-f5c2-4e9e-8f86-10ba1f98b1b4 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:06.151894 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 400/811] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:06.152800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97cbe8-f5c2-4e9e-8f86-10ba1f98b1b4 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:06.175171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c72f7-bba2-498f-9106-a255495874c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:06.175813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c72f7-bba2-498f-9106-a255495874c7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.176087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c72f7-bba2-498f-9106-a255495874c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.176354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c72f7-bba2-498f-9106-a255495874c7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.176934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c72f7-bba2-498f-9106-a255495874c7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:06.178291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c72f7-bba2-498f-9106-a255495874c7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-694c72f7-bba2-498f-9106-a255495874c7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:06.187460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:06.188460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 16:00:06.189288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:06.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 412/812] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:06 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:06.194293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c72f7-bba2-498f-9106-a255495874c7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:06.219346 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:06.258222 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97cbe8-f5c2-4e9e-8f86-10ba1f98b1b4 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:06.292524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1613b84-c729-4994-874f-a8b99c008084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:06.293075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1613b84-c729-4994-874f-a8b99c008084 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.293358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1613b84-c729-4994-874f-a8b99c008084 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.293634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1613b84-c729-4994-874f-a8b99c008084 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.297018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c72f7-bba2-498f-9106-a255495874c7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:06.300125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1613b84-c729-4994-874f-a8b99c008084 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:06.301575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1613b84-c729-4994-874f-a8b99c008084 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-a1613b84-c729-4994-874f-a8b99c008084 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:06.312699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:06.313769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:06.314718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:06.314718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:06.314718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:06.314718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:06.314718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:06.314718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:06.314718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:06.314718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:06.314718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 401/813] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:06.314718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1613b84-c729-4994-874f-a8b99c008084 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:06.333866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82ac18-f916-4762-aa3c-d41584a01f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:06.334525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ac18-f916-4762-aa3c-d41584a01f89 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.334842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ac18-f916-4762-aa3c-d41584a01f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.335118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ac18-f916-4762-aa3c-d41584a01f89 None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/50c9553845ba42e78de0293fd3a338d1/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.337044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82ac18-f916-4762-aa3c-d41584a01f89 None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=50c9553845ba42e78de0293fd3a338d1, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:06.339121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82ac18-f916-4762-aa3c-d41584a01f89 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:06.353921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:06.406435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 413/814] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 16:00:06 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/50c9553845ba42e78de0293fd3a338d1/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:00:06.407305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82ac18-f916-4762-aa3c-d41584a01f89 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:06.412601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1613b84-c729-4994-874f-a8b99c008084 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:06.455994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baa3e3-4611-4f7f-a8b5-29aba85e012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:06.456643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa3e3-4611-4f7f-a8b5-29aba85e012f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.456969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa3e3-4611-4f7f-a8b5-29aba85e012f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.457182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa3e3-4611-4f7f-a8b5-29aba85e012f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.466334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8baa3e3-4611-4f7f-a8b5-29aba85e012f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:06.467897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8baa3e3-4611-4f7f-a8b5-29aba85e012f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-b8baa3e3-4611-4f7f-a8b5-29aba85e012f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:06.480832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:06.481872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:06.482853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:06.482853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:06.482853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:06.482853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:06.482853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:06.482853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:06.482853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:06.482853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:06.482853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 16:00:06.482853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:06.482853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 402/815] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Sep 8 16:00:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:06.483449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490a90-7fc0-41ff-aedd-2d082adecd95 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.483518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490a90-7fc0-41ff-aedd-2d082adecd95 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.484102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51490a90-7fc0-41ff-aedd-2d082adecd95 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.489256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 403/816] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:06.489256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51490a90-7fc0-41ff-aedd-2d082adecd95 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:06.520383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:06.542121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82ac18-f916-4762-aa3c-d41584a01f89 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:06.582557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fa10b-f1ae-4bbe-8394-dbdec4b37bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:06.583565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fa10b-f1ae-4bbe-8394-dbdec4b37bce None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.583565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fa10b-f1ae-4bbe-8394-dbdec4b37bce None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.583565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fa10b-f1ae-4bbe-8394-dbdec4b37bce None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.584049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fa10b-f1ae-4bbe-8394-dbdec4b37bce None admin] RBAC: Adding query filter params (name=network) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:06.584739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fa10b-f1ae-4bbe-8394-dbdec4b37bce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:06.585817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fa10b-f1ae-4bbe-8394-dbdec4b37bce None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:06.593554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 414/817] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 16:00:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:06.594404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fa10b-f1ae-4bbe-8394-dbdec4b37bce None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:06.607049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:06.611754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51490a90-7fc0-41ff-aedd-2d082adecd95 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:06.648687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8f415-2bb4-4a1e-bedd-56b1484bb1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:06.649373 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8f415-2bb4-4a1e-bedd-56b1484bb1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.649651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8f415-2bb4-4a1e-bedd-56b1484bb1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.649918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8f415-2bb4-4a1e-bedd-56b1484bb1d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.650592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8f415-2bb4-4a1e-bedd-56b1484bb1d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:06.650963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8f415-2bb4-4a1e-bedd-56b1484bb1d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:06.652388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8f415-2bb4-4a1e-bedd-56b1484bb1d9 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:06.669700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 404/818] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:06.669700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8fc53-ad9c-466a-b9b8-c8918e8166e8 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.669700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8fc53-ad9c-466a-b9b8-c8918e8166e8 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.669700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8fc53-ad9c-466a-b9b8-c8918e8166e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.686484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-9bb8fc53-ad9c-466a-b9b8-c8918e8166e8 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:06.687739 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9bb8fc53-ad9c-466a-b9b8-c8918e8166e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:06.767361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 405/819] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:06.768725 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8fc53-ad9c-466a-b9b8-c8918e8166e8 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:06.824276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fa10b-f1ae-4bbe-8394-dbdec4b37bce None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:06.869309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:06.872046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b94d8f-f5d6-4800-88bd-f9c9333778ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:06.873051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b94d8f-f5d6-4800-88bd-f9c9333778ab None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.873957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b94d8f-f5d6-4800-88bd-f9c9333778ab None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.874437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b94d8f-f5d6-4800-88bd-f9c9333778ab None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.875668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b94d8f-f5d6-4800-88bd-f9c9333778ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:06.876486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b94d8f-f5d6-4800-88bd-f9c9333778ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:06.878788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b94d8f-f5d6-4800-88bd-f9c9333778ab None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:06.882924 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8fc53-ad9c-466a-b9b8-c8918e8166e8 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:06.904484 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 415/820] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Sep 8 16:00:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:06.905458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b94d8f-f5d6-4800-88bd-f9c9333778ab None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:06.919060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:06.925367 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d9d41-8560-4979-b959-946ce7341b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:06.925986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9d41-8560-4979-b959-946ce7341b4b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:06.926290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9d41-8560-4979-b959-946ce7341b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:06.932668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d9d41-8560-4979-b959-946ce7341b4b None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:06.932668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d9d41-8560-4979-b959-946ce7341b4b None admin] RBAC: Adding query filter params (type=network) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:06.932668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d9d41-8560-4979-b959-946ce7341b4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:06.932668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d9d41-8560-4979-b959-946ce7341b4b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:06.935359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 406/821] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 16:00:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:06.936705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d9d41-8560-4979-b959-946ce7341b4b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:07.035745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b94d8f-f5d6-4800-88bd-f9c9333778ab None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:07.058819 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d9d41-8560-4979-b959-946ce7341b4b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:07.071919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24139-2d33-4155-a85b-3290ad79583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:07.072643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24139-2d33-4155-a85b-3290ad79583e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:07.072984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24139-2d33-4155-a85b-3290ad79583e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:07.073319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df24139-2d33-4155-a85b-3290ad79583e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:07.074095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df24139-2d33-4155-a85b-3290ad79583e None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=41f7a6292d004a648c3c92526d1304ec) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:07.074468 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df24139-2d33-4155-a85b-3290ad79583e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:07.075966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df24139-2d33-4155-a85b-3290ad79583e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:07.081830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 416/822] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:00:06 2022] GET /identity/v3/role_assignments?user.id=41f7a6292d004a648c3c92526d1304ec&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=519b356d36364663a59265dc7eeff0b8 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:07.082394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24139-2d33-4155-a85b-3290ad79583e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:07.105526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c06bad-2443-4fdf-8d58-ec042b08763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:07.106222 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c06bad-2443-4fdf-8d58-ec042b08763e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:07.106501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c06bad-2443-4fdf-8d58-ec042b08763e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:07.106818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c06bad-2443-4fdf-8d58-ec042b08763e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:07.120244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c06bad-2443-4fdf-8d58-ec042b08763e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:07.121954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c06bad-2443-4fdf-8d58-ec042b08763e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-18c06bad-2443-4fdf-8d58-ec042b08763e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:07.139374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:07.140573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:07.141654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:07.141654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:07.141654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:07.148271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 407/823] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:07.149475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c06bad-2443-4fdf-8d58-ec042b08763e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:07.154167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:07.167283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:07.203833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df24139-2d33-4155-a85b-3290ad79583e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:07.241798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f26a63-5eb9-4f2c-8780-7644e6b82e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:07.242447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f26a63-5eb9-4f2c-8780-7644e6b82e01 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:07.242803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f26a63-5eb9-4f2c-8780-7644e6b82e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:07.243144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f26a63-5eb9-4f2c-8780-7644e6b82e01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:07.243970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f26a63-5eb9-4f2c-8780-7644e6b82e01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:07.246329 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f26a63-5eb9-4f2c-8780-7644e6b82e01 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:07.270074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c06bad-2443-4fdf-8d58-ec042b08763e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:07.310393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d781e02-63c7-49ae-af15-5e0bf44c63b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:07.311363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781e02-63c7-49ae-af15-5e0bf44c63b5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:07.311698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781e02-63c7-49ae-af15-5e0bf44c63b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:07.312641 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d781e02-63c7-49ae-af15-5e0bf44c63b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:07.312641 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d781e02-63c7-49ae-af15-5e0bf44c63b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:07.314203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d781e02-63c7-49ae-af15-5e0bf44c63b5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-4d781e02-63c7-49ae-af15-5e0bf44c63b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:07.323692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:07.324942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:07.325946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 408/824] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Sep 8 16:00:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:07.327209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d781e02-63c7-49ae-af15-5e0bf44c63b5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:07.336513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 417/825] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:00:07 2022] POST /identity/v3/endpoints => generated 337 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:00:07.340719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f26a63-5eb9-4f2c-8780-7644e6b82e01 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:07.414508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:07.467277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d781e02-63c7-49ae-af15-5e0bf44c63b5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:07.489953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f26a63-5eb9-4f2c-8780-7644e6b82e01 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:07.517725 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf3d9d-5e31-4f88-af16-3a17b24a8dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:07.519155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3d9d-5e31-4f88-af16-3a17b24a8dbe None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:07.521098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3d9d-5e31-4f88-af16-3a17b24a8dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:07.521548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3d9d-5e31-4f88-af16-3a17b24a8dbe None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:07.522386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf3d9d-5e31-4f88-af16-3a17b24a8dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:07.523946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf3d9d-5e31-4f88-af16-3a17b24a8dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:07.525519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf3d9d-5e31-4f88-af16-3a17b24a8dbe None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:07.533021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:07.558089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 409/826] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:07.564075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf3d9d-5e31-4f88-af16-3a17b24a8dbe None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:07.565037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d89df-6da7-4085-8635-0ed398c3585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:07.566250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d89df-6da7-4085-8635-0ed398c3585b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:07.575312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d89df-6da7-4085-8635-0ed398c3585b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:07.575830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d89df-6da7-4085-8635-0ed398c3585b None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:07.576695 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d89df-6da7-4085-8635-0ed398c3585b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:07.577287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d89df-6da7-4085-8635-0ed398c3585b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:07.578909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d89df-6da7-4085-8635-0ed398c3585b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:07.586968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 418/827] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 8 16:00:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:07.593368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d89df-6da7-4085-8635-0ed398c3585b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:07.705231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf3d9d-5e31-4f88-af16-3a17b24a8dbe None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:07.705447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d89df-6da7-4085-8635-0ed398c3585b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:07.742501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:07.746631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f68a3-5bd8-4da3-ac00-0c10068c5878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:07.747128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f68a3-5bd8-4da3-ac00-0c10068c5878 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:07.747502 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f68a3-5bd8-4da3-ac00-0c10068c5878 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:07.747825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f68a3-5bd8-4da3-ac00-0c10068c5878 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:07.748587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f68a3-5bd8-4da3-ac00-0c10068c5878 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:07.748949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f68a3-5bd8-4da3-ac00-0c10068c5878 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:07.751343 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f68a3-5bd8-4da3-ac00-0c10068c5878 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:07.757036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb5319-fe78-4300-a495-740619394f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:07.757173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5319-fe78-4300-a495-740619394f9b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:07.757355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5319-fe78-4300-a495-740619394f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:07.757800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5319-fe78-4300-a495-740619394f9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:07.760824 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 419/828] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Sep 8 16:00:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:07.766511 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f68a3-5bd8-4da3-ac00-0c10068c5878 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:07.770528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb5319-fe78-4300-a495-740619394f9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:07.772287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb5319-fe78-4300-a495-740619394f9b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-7ecb5319-fe78-4300-a495-740619394f9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:07.788072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:07.789186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:07.790342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:07.790342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:07.790342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:07.790342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:07.790342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:07.790342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:07.790342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:07.790342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:07.792011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 410/829] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:07.797371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb5319-fe78-4300-a495-740619394f9b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:07.832951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:07.896846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f68a3-5bd8-4da3-ac00-0c10068c5878 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:07.916777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb5319-fe78-4300-a495-740619394f9b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:07.938872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ca67b-e3bf-4ce1-be47-7e2ca4507a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:07.939491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ca67b-e3bf-4ce1-be47-7e2ca4507a10 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:07.939763 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ca67b-e3bf-4ce1-be47-7e2ca4507a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:07.940032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ca67b-e3bf-4ce1-be47-7e2ca4507a10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:07.940700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ca67b-e3bf-4ce1-be47-7e2ca4507a10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:07.942761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ca67b-e3bf-4ce1-be47-7e2ca4507a10 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:07.957410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8972988-79ed-41b7-97fa-b077997a8de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:07.958327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8972988-79ed-41b7-97fa-b077997a8de0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:07.958836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8972988-79ed-41b7-97fa-b077997a8de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:07.959323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8972988-79ed-41b7-97fa-b077997a8de0 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:07.960251 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8972988-79ed-41b7-97fa-b077997a8de0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:07.960793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8972988-79ed-41b7-97fa-b077997a8de0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:07.962409 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8972988-79ed-41b7-97fa-b077997a8de0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:07.976041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 411/830] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:07.981469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8972988-79ed-41b7-97fa-b077997a8de0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:08.032310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 420/831] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:00:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:00:08.034386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:08.097197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8972988-79ed-41b7-97fa-b077997a8de0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:08.144382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665a7ce-8431-4fc1-b1d5-7afc44ce3b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:08.145472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a7ce-8431-4fc1-b1d5-7afc44ce3b99 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:08.145960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a7ce-8431-4fc1-b1d5-7afc44ce3b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:08.146429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a7ce-8431-4fc1-b1d5-7afc44ce3b99 None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/ce22dab95b864b84812335cc050ca2c7/roles/7323f34f91ec4c9c90fc0e4e8a705ebb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:08.163420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665a7ce-8431-4fc1-b1d5-7afc44ce3b99 None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=ce22dab95b864b84812335cc050ca2c7, role_id=7323f34f91ec4c9c90fc0e4e8a705ebb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:08.165257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665a7ce-8431-4fc1-b1d5-7afc44ce3b99 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:08.236478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 412/832] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 16:00:07 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/ce22dab95b864b84812335cc050ca2c7/roles/7323f34f91ec4c9c90fc0e4e8a705ebb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:00:08.646889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53908d-27f5-4e3e-9624-75b0744a6170 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:08.647376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53908d-27f5-4e3e-9624-75b0744a6170 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:08.647376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53908d-27f5-4e3e-9624-75b0744a6170 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:08.648901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 421/833] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:08.654900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd9bb0-c549-49bb-9c7f-c0f7175aa0f6 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:08.655282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd9bb0-c549-49bb-9c7f-c0f7175aa0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:08.655445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd9bb0-c549-49bb-9c7f-c0f7175aa0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:08.673679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-7ccd9bb0-c549-49bb-9c7f-c0f7175aa0f6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:08.674917 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7ccd9bb0-c549-49bb-9c7f-c0f7175aa0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:08.743795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 413/834] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:09.022894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53908d-27f5-4e3e-9624-75b0744a6170 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:09.131864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53908d-27f5-4e3e-9624-75b0744a6170 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:09.134897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:09.170777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3b244-2615-466c-9ab6-970847661648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:09.171484 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3b244-2615-466c-9ab6-970847661648 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:09.171818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3b244-2615-466c-9ab6-970847661648 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:09.172097 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3b244-2615-466c-9ab6-970847661648 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:09.183630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3b244-2615-466c-9ab6-970847661648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-99f3b244-2615-466c-9ab6-970847661648 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:09.188552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:09.194856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:09.195715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 422/835] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:00:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:09.196426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd9bb0-c549-49bb-9c7f-c0f7175aa0f6 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:09.225851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:09.301765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd9bb0-c549-49bb-9c7f-c0f7175aa0f6 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:09.337269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51352be-d9f5-4eb1-8943-0ec912f46ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:09.337883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51352be-d9f5-4eb1-8943-0ec912f46ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:09.338199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51352be-d9f5-4eb1-8943-0ec912f46ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:09.338474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51352be-d9f5-4eb1-8943-0ec912f46ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:09.339169 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51352be-d9f5-4eb1-8943-0ec912f46ce0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:09.339474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51352be-d9f5-4eb1-8943-0ec912f46ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:09.340910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51352be-d9f5-4eb1-8943-0ec912f46ce0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:09.349640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 414/836] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:00:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:09.356156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3b244-2615-466c-9ab6-970847661648 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:09.464800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3b244-2615-466c-9ab6-970847661648 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:09.496977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efa838-b18e-44db-978a-3fa7c0de36c2 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:09.497284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efa838-b18e-44db-978a-3fa7c0de36c2 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:09.497533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27efa838-b18e-44db-978a-3fa7c0de36c2 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:09.499513 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 415/837] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:00:09.507536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aacf52-4d76-4b12-9fe9-119f5a059164 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:09.507684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b4669-8562-4f0c-99f4-48c2ae49326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:09.508192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aacf52-4d76-4b12-9fe9-119f5a059164 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:09.508381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4669-8562-4f0c-99f4-48c2ae49326d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:09.508629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4669-8562-4f0c-99f4-48c2ae49326d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:09.508905 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b4669-8562-4f0c-99f4-48c2ae49326d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:09.509250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aacf52-4d76-4b12-9fe9-119f5a059164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:09.521137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b4669-8562-4f0c-99f4-48c2ae49326d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:09.523044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b4669-8562-4f0c-99f4-48c2ae49326d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:09.528874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-30aacf52-4d76-4b12-9fe9-119f5a059164 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:09.530305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-30aacf52-4d76-4b12-9fe9-119f5a059164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5f8b4669-8562-4f0c-99f4-48c2ae49326d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:09.540965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:09.542477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:09.543786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:09.543786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:09.543786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:09.543786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 423/838] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:09.548456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b4669-8562-4f0c-99f4-48c2ae49326d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:09.570072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:09.622704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 416/839] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:09.663659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b4669-8562-4f0c-99f4-48c2ae49326d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:09.698761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0db052-4d58-498c-9e10-33fda76ee934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:09.699415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0db052-4d58-498c-9e10-33fda76ee934 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:09.699753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0db052-4d58-498c-9e10-33fda76ee934 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:09.700035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0db052-4d58-498c-9e10-33fda76ee934 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:09.700670 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0db052-4d58-498c-9e10-33fda76ee934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:09.701027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0db052-4d58-498c-9e10-33fda76ee934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:09.702385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0db052-4d58-498c-9e10-33fda76ee934 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:09.715355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 424/840] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:09.720885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aacf52-4d76-4b12-9fe9-119f5a059164 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:09.743080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:09.832063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aacf52-4d76-4b12-9fe9-119f5a059164 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:09.867700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bf589-0edf-4032-b696-dbf2682e11fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:09.868344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bf589-0edf-4032-b696-dbf2682e11fd None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:09.868621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bf589-0edf-4032-b696-dbf2682e11fd None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:09.868897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bf589-0edf-4032-b696-dbf2682e11fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:09.876499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bf589-0edf-4032-b696-dbf2682e11fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:09.877965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bf589-0edf-4032-b696-dbf2682e11fd None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-099bf589-0edf-4032-b696-dbf2682e11fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:09.889802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:09.892997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:09.894017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:09.894017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:09.894017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:09.894017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:09.894017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:09.894017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:09.894017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:09.894017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:09.894017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 16:00:09.894017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:09.894017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 417/841] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:00:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:09.897661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0db052-4d58-498c-9e10-33fda76ee934 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:09.915111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bf589-0edf-4032-b696-dbf2682e11fd None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:09.994013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:09.995030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:10.019071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bf589-0edf-4032-b696-dbf2682e11fd None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:10.024115 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0db052-4d58-498c-9e10-33fda76ee934 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:10.054432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933031c3-2b2f-4025-b70a-4a5ad78b92c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:10.055666 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933031c3-2b2f-4025-b70a-4a5ad78b92c6 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.056147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933031c3-2b2f-4025-b70a-4a5ad78b92c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.056704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933031c3-2b2f-4025-b70a-4a5ad78b92c6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.057516 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933031c3-2b2f-4025-b70a-4a5ad78b92c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:10.059147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933031c3-2b2f-4025-b70a-4a5ad78b92c6 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:10.065617 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bf179-1f72-43d9-b8b6-6680f3985aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:10.066236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bf179-1f72-43d9-b8b6-6680f3985aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.066515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bf179-1f72-43d9-b8b6-6680f3985aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.066816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bf179-1f72-43d9-b8b6-6680f3985aa4 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.067549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bf179-1f72-43d9-b8b6-6680f3985aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:10.067854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bf179-1f72-43d9-b8b6-6680f3985aa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:10.069279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84bf179-1f72-43d9-b8b6-6680f3985aa4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-933031c3-2b2f-4025-b70a-4a5ad78b92c6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:10.070111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:10.071022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 16:00:10.071914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:10.078801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 418/842] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Sep 8 16:00:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:10.081328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933031c3-2b2f-4025-b70a-4a5ad78b92c6 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:10.090472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 425/843] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Sep 8 16:00:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:10.096836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bf179-1f72-43d9-b8b6-6680f3985aa4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:10.189691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933031c3-2b2f-4025-b70a-4a5ad78b92c6 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:10.215807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bf179-1f72-43d9-b8b6-6680f3985aa4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:10.226891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a31f-e97a-4c43-a732-cb5e6f662422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:10.227926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a31f-e97a-4c43-a732-cb5e6f662422 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.228414 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a31f-e97a-4c43-a732-cb5e6f662422 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.228930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a31f-e97a-4c43-a732-cb5e6f662422 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.229814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a31f-e97a-4c43-a732-cb5e6f662422 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:10.230365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a31f-e97a-4c43-a732-cb5e6f662422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:10.232051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a31f-e97a-4c43-a732-cb5e6f662422 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:10.242810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 419/844] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Sep 8 16:00:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:10.244564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a31f-e97a-4c43-a732-cb5e6f662422 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:10.255093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:10.257384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fea59-c58f-4c01-8807-9393f9d9afba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:10.258162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fea59-c58f-4c01-8807-9393f9d9afba None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.258273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fea59-c58f-4c01-8807-9393f9d9afba None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.258536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fea59-c58f-4c01-8807-9393f9d9afba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.262224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:10.334185 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fea59-c58f-4c01-8807-9393f9d9afba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:10.335712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fea59-c58f-4c01-8807-9393f9d9afba None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:10.355647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a31f-e97a-4c43-a732-cb5e6f662422 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:10.394187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcf8c3-beb8-4710-9a24-d3fab7c239f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:10.394834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcf8c3-beb8-4710-9a24-d3fab7c239f4 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.395115 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcf8c3-beb8-4710-9a24-d3fab7c239f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.395663 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcf8c3-beb8-4710-9a24-d3fab7c239f4 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.396012 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcf8c3-beb8-4710-9a24-d3fab7c239f4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:10.396315 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcf8c3-beb8-4710-9a24-d3fab7c239f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:10.397683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcf8c3-beb8-4710-9a24-d3fab7c239f4 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:10.402449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 420/845] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Sep 8 16:00:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:10.403704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7bf03-abc3-4ec7-b17b-43ac92ecca36 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.404004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7bf03-abc3-4ec7-b17b-43ac92ecca36 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.404262 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7bf03-abc3-4ec7-b17b-43ac92ecca36 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.409663 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 421/846] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:10.413057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f028-a10d-46dc-8aed-9f068b0eda73 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.413372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f028-a10d-46dc-8aed-9f068b0eda73 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.413602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f028-a10d-46dc-8aed-9f068b0eda73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.439445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b039f028-a10d-46dc-8aed-9f068b0eda73 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:10.441015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b039f028-a10d-46dc-8aed-9f068b0eda73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:10.468975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 426/847] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:00:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:10.470382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11698018-6966-4991-8f03-65faf5492e6f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.470865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11698018-6966-4991-8f03-65faf5492e6f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.471101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11698018-6966-4991-8f03-65faf5492e6f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.472702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 427/848] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:10.474782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11698018-6966-4991-8f03-65faf5492e6f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:10.518942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:10.519160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:10.525551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 422/849] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:10.527188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa449e-577e-4d16-9f63-7ce51010dcdc None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.527612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa449e-577e-4d16-9f63-7ce51010dcdc None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.528015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa449e-577e-4d16-9f63-7ce51010dcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.549156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-94fa449e-577e-4d16-9f63-7ce51010dcdc None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:10.550638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-94fa449e-577e-4d16-9f63-7ce51010dcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:10.611491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11698018-6966-4991-8f03-65faf5492e6f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:10.643110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 423/850] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:10.656645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87304a81-e19d-437f-b3f5-b0381ce345ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:10.657272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304a81-e19d-437f-b3f5-b0381ce345ec None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.657548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304a81-e19d-437f-b3f5-b0381ce345ec None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.657819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304a81-e19d-437f-b3f5-b0381ce345ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.668653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87304a81-e19d-437f-b3f5-b0381ce345ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:10.670136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87304a81-e19d-437f-b3f5-b0381ce345ec None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-87304a81-e19d-437f-b3f5-b0381ce345ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:10.687364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:10.688321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:10.689239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:10.689239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:10.689239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:10.689239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 428/851] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:10.694012 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa449e-577e-4d16-9f63-7ce51010dcdc None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:10.799144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa449e-577e-4d16-9f63-7ce51010dcdc None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:10.806590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87304a81-e19d-437f-b3f5-b0381ce345ec None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:10.833155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:10.844013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46fb2a-51d2-44ea-9586-cc0846b87ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:10.845580 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fb2a-51d2-44ea-9586-cc0846b87ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.851366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fb2a-51d2-44ea-9586-cc0846b87ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.851366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fb2a-51d2-44ea-9586-cc0846b87ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.851366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46fb2a-51d2-44ea-9586-cc0846b87ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:10.851366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46fb2a-51d2-44ea-9586-cc0846b87ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:10.851366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46fb2a-51d2-44ea-9586-cc0846b87ab9 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:10.864755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 424/852] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:10.874132 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46fb2a-51d2-44ea-9586-cc0846b87ab9 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:10.920379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:10.927679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87304a81-e19d-437f-b3f5-b0381ce345ec None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:10.972091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df4c2e-8b4f-4453-bd86-15ff8ef1419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:10.973458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df4c2e-8b4f-4453-bd86-15ff8ef1419f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:10.973885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df4c2e-8b4f-4453-bd86-15ff8ef1419f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:10.974302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df4c2e-8b4f-4453-bd86-15ff8ef1419f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:10.975337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df4c2e-8b4f-4453-bd86-15ff8ef1419f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:10.977246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df4c2e-8b4f-4453-bd86-15ff8ef1419f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-37df4c2e-8b4f-4453-bd86-15ff8ef1419f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:10.989238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:10.990525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 16:00:10.991625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:10.995160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46fb2a-51d2-44ea-9586-cc0846b87ab9 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:10.995770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 429/853] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 16:00:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:10.996938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df4c2e-8b4f-4453-bd86-15ff8ef1419f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:11.030430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baa308-100c-41f2-abb4-fb5aeb07028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:11.031074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baa308-100c-41f2-abb4-fb5aeb07028e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:11.031354 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baa308-100c-41f2-abb4-fb5aeb07028e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:11.031629 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baa308-100c-41f2-abb4-fb5aeb07028e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:11.038658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baa308-100c-41f2-abb4-fb5aeb07028e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:11.040136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baa308-100c-41f2-abb4-fb5aeb07028e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-29baa308-100c-41f2-abb4-fb5aeb07028e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:11.051804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:11.052891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:11.053805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:11.053805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:11.053805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:11.053805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:11.053805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:11.053805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:11.053805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:11.053805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:11.053805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 425/854] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:11.054291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baa308-100c-41f2-abb4-fb5aeb07028e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:11.104966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:11.120676 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df4c2e-8b4f-4453-bd86-15ff8ef1419f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:11.155966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baa308-100c-41f2-abb4-fb5aeb07028e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:11.158273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04ddcc-680a-4e5b-a15d-3fdf743f00f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:11.159090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ddcc-680a-4e5b-a15d-3fdf743f00f9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:11.159440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ddcc-680a-4e5b-a15d-3fdf743f00f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:11.159829 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ddcc-680a-4e5b-a15d-3fdf743f00f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:11.172625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04ddcc-680a-4e5b-a15d-3fdf743f00f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-bc04ddcc-680a-4e5b-a15d-3fdf743f00f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:11.178256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:11.179268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:11.180124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 430/855] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 16:00:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:11.180828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04ddcc-680a-4e5b-a15d-3fdf743f00f9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:11.194832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:11.198392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dc5d9-e661-4a03-bd4e-83b4146268a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:11.199052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc5d9-e661-4a03-bd4e-83b4146268a1 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:11.199328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc5d9-e661-4a03-bd4e-83b4146268a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:11.199597 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dc5d9-e661-4a03-bd4e-83b4146268a1 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:11.200229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dc5d9-e661-4a03-bd4e-83b4146268a1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:11.200533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dc5d9-e661-4a03-bd4e-83b4146268a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:11.201901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dc5d9-e661-4a03-bd4e-83b4146268a1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:11.206598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 426/856] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 16:00:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:11.211691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dc5d9-e661-4a03-bd4e-83b4146268a1 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:11.286548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04ddcc-680a-4e5b-a15d-3fdf743f00f9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:11.316476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dc5d9-e661-4a03-bd4e-83b4146268a1 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:11.319581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab775a-39f8-40b3-8401-e4405440abe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:11.320183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab775a-39f8-40b3-8401-e4405440abe8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:11.320456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab775a-39f8-40b3-8401-e4405440abe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:11.320724 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab775a-39f8-40b3-8401-e4405440abe8 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:11.321406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab775a-39f8-40b3-8401-e4405440abe8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:11.321711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab775a-39f8-40b3-8401-e4405440abe8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:11.323186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab775a-39f8-40b3-8401-e4405440abe8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:11.329339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:11.335509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 431/857] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:11.336551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab775a-39f8-40b3-8401-e4405440abe8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:11.359731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a426c1-24a6-41d1-a1c6-f63b30fc8bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:11.360601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a426c1-24a6-41d1-a1c6-f63b30fc8bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:11.361159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a426c1-24a6-41d1-a1c6-f63b30fc8bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:11.361442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a426c1-24a6-41d1-a1c6-f63b30fc8bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:11.362118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a426c1-24a6-41d1-a1c6-f63b30fc8bb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:11.362428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a426c1-24a6-41d1-a1c6-f63b30fc8bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:11.363857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a426c1-24a6-41d1-a1c6-f63b30fc8bb0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:11.377361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 427/858] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 16:00:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:11.377361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a426c1-24a6-41d1-a1c6-f63b30fc8bb0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:11.414612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:11.450292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab775a-39f8-40b3-8401-e4405440abe8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:11.485122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a426c1-24a6-41d1-a1c6-f63b30fc8bb0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:11.488303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f83c2-7950-4f3a-8727-ddeacd3fd836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:11.488903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f83c2-7950-4f3a-8727-ddeacd3fd836 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:11.489182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f83c2-7950-4f3a-8727-ddeacd3fd836 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:11.489454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f83c2-7950-4f3a-8727-ddeacd3fd836 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:11.490072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f83c2-7950-4f3a-8727-ddeacd3fd836 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:11.490372 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f83c2-7950-4f3a-8727-ddeacd3fd836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:11.491767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f83c2-7950-4f3a-8727-ddeacd3fd836 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:11.496447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 432/859] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 16:00:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:11.508011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f83c2-7950-4f3a-8727-ddeacd3fd836 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:11.529883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f91077-75a1-4d7a-a61d-013c908db6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:11.531113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f91077-75a1-4d7a-a61d-013c908db6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:11.531548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f91077-75a1-4d7a-a61d-013c908db6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:11.532434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f91077-75a1-4d7a-a61d-013c908db6b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:11.533596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f91077-75a1-4d7a-a61d-013c908db6b8 None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=50c9553845ba42e78de0293fd3a338d1) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:11.534072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f91077-75a1-4d7a-a61d-013c908db6b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:11.536563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f91077-75a1-4d7a-a61d-013c908db6b8 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:11.548751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 428/860] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:00:11 2022] GET /identity/v3/role_assignments?user.id=50c9553845ba42e78de0293fd3a338d1&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=519b356d36364663a59265dc7eeff0b8 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:11.639880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f83c2-7950-4f3a-8727-ddeacd3fd836 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:11.683199 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9dd21-2e46-432a-b3c1-6916f30d44c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:11.684522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9dd21-2e46-432a-b3c1-6916f30d44c3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:11.684978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9dd21-2e46-432a-b3c1-6916f30d44c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:11.685400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9dd21-2e46-432a-b3c1-6916f30d44c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:11.687874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:11.700387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9dd21-2e46-432a-b3c1-6916f30d44c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:11.701889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9dd21-2e46-432a-b3c1-6916f30d44c3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ecf9dd21-2e46-432a-b3c1-6916f30d44c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:11.720513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:11.721514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:11.722422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:11.722422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:11.722422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:11.722422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 433/861] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:11.728640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f91077-75a1-4d7a-a61d-013c908db6b8 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:11.772735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:11.840457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f91077-75a1-4d7a-a61d-013c908db6b8 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:11.876545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26372aa-edd2-49bd-aadb-18c0adc96e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:11.877182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26372aa-edd2-49bd-aadb-18c0adc96e59 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:11.877445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26372aa-edd2-49bd-aadb-18c0adc96e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:11.877717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26372aa-edd2-49bd-aadb-18c0adc96e59 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:11.878363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26372aa-edd2-49bd-aadb-18c0adc96e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:11.878687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26372aa-edd2-49bd-aadb-18c0adc96e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:11.880125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26372aa-edd2-49bd-aadb-18c0adc96e59 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:11.893460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 429/862] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:11.898929 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9dd21-2e46-432a-b3c1-6916f30d44c3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:12.004473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9dd21-2e46-432a-b3c1-6916f30d44c3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:12.039989 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab22e38-650e-4426-a61b-fbf7b14f6abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:12.040619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab22e38-650e-4426-a61b-fbf7b14f6abf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:12.040894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab22e38-650e-4426-a61b-fbf7b14f6abf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:12.041262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab22e38-650e-4426-a61b-fbf7b14f6abf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:12.049105 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab22e38-650e-4426-a61b-fbf7b14f6abf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:12.050539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab22e38-650e-4426-a61b-fbf7b14f6abf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-aab22e38-650e-4426-a61b-fbf7b14f6abf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:12.062382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:12.063374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:12.064306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:12.064306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:12.064306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:12.064306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:12.064306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:12.064306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:12.064306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:12.064306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:12.064306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 16:00:12.064306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:12.064306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 434/863] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Sep 8 16:00:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:12.069387 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26372aa-edd2-49bd-aadb-18c0adc96e59 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:12.172446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:12.176429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26372aa-edd2-49bd-aadb-18c0adc96e59 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:12.211328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd3e06-b81e-417d-8f6c-587595e8f9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:12.211938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd3e06-b81e-417d-8f6c-587595e8f9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:12.212219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd3e06-b81e-417d-8f6c-587595e8f9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:12.212496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd3e06-b81e-417d-8f6c-587595e8f9c2 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:12.213316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd3e06-b81e-417d-8f6c-587595e8f9c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:12.213624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd3e06-b81e-417d-8f6c-587595e8f9c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:12.215099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd3e06-b81e-417d-8f6c-587595e8f9c2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:12.234763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 430/864] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Sep 8 16:00:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:12.240177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab22e38-650e-4426-a61b-fbf7b14f6abf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:12.289577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:12.345291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab22e38-650e-4426-a61b-fbf7b14f6abf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:12.380501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b76a0-1221-4a9e-92b2-483ba8981175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:12.381112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b76a0-1221-4a9e-92b2-483ba8981175 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:12.381384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b76a0-1221-4a9e-92b2-483ba8981175 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:12.381650 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b76a0-1221-4a9e-92b2-483ba8981175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:12.453050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b76a0-1221-4a9e-92b2-483ba8981175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:12.454507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b76a0-1221-4a9e-92b2-483ba8981175 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:12.504053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:12.565285 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 435/865] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:00:12 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:12.570937 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd3e06-b81e-417d-8f6c-587595e8f9c2 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:12.656465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674a96f-b8c6-4518-a382-28e859c514a7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:12.656907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674a96f-b8c6-4518-a382-28e859c514a7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:12.657279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674a96f-b8c6-4518-a382-28e859c514a7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:12.659001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 436/866] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:00:12.663945 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6b41-3653-4ef1-a658-c1a46529d288 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:12.664332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6b41-3653-4ef1-a658-c1a46529d288 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:12.664698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6b41-3653-4ef1-a658-c1a46529d288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:12.678917 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd3e06-b81e-417d-8f6c-587595e8f9c2 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:12.683625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ac9a6b41-3653-4ef1-a658-c1a46529d288 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:12.684912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ac9a6b41-3653-4ef1-a658-c1a46529d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:12.716395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd281df7-934a-478b-be9f-ab59dc8ca885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:12.717250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281df7-934a-478b-be9f-ab59dc8ca885 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:12.717707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281df7-934a-478b-be9f-ab59dc8ca885 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:12.717977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281df7-934a-478b-be9f-ab59dc8ca885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:12.728415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd281df7-934a-478b-be9f-ab59dc8ca885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:12.730706 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd281df7-934a-478b-be9f-ab59dc8ca885 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-dd281df7-934a-478b-be9f-ab59dc8ca885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:12.745723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:12.746694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:12.747594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:12.747594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:12.747594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:12.747594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 431/867] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:12.753199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd281df7-934a-478b-be9f-ab59dc8ca885 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:12.770697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 437/868] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:12.772064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:12.862316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd281df7-934a-478b-be9f-ab59dc8ca885 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:12.896520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccb2a4-1332-4cd6-bf7a-0189b117341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:12.897127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccb2a4-1332-4cd6-bf7a-0189b117341c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:12.897402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccb2a4-1332-4cd6-bf7a-0189b117341c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:12.897673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccb2a4-1332-4cd6-bf7a-0189b117341c None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:12.898312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccb2a4-1332-4cd6-bf7a-0189b117341c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:12.898610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccb2a4-1332-4cd6-bf7a-0189b117341c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:12.900000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccb2a4-1332-4cd6-bf7a-0189b117341c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:12.912574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 432/869] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:12.919752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a6b41-3653-4ef1-a658-c1a46529d288 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:12.999487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:13.023393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a6b41-3653-4ef1-a658-c1a46529d288 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:13.058721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2521-9d23-42d0-a788-e54d92478ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:13.059845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2521-9d23-42d0-a788-e54d92478ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:13.060341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2521-9d23-42d0-a788-e54d92478ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:13.060843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2521-9d23-42d0-a788-e54d92478ad2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:13.061024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccb2a4-1332-4cd6-bf7a-0189b117341c None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:13.068568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de2521-9d23-42d0-a788-e54d92478ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:13.070413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de2521-9d23-42d0-a788-e54d92478ad2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-89de2521-9d23-42d0-a788-e54d92478ad2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:13.083317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:13.084209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:13.085092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:13.085092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:13.085092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:13.085092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:13.085092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:13.085092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:13.085092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:13.085092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:13.087624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 438/870] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:13.094323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2521-9d23-42d0-a788-e54d92478ad2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:13.130889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:13.168670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccb2a4-1332-4cd6-bf7a-0189b117341c None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:13.201959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2521-9d23-42d0-a788-e54d92478ad2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:13.207092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd5a38-af8b-404b-bb8f-023cec349570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:13.207702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd5a38-af8b-404b-bb8f-023cec349570 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:13.207977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd5a38-af8b-404b-bb8f-023cec349570 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:13.208247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd5a38-af8b-404b-bb8f-023cec349570 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:13.208895 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd5a38-af8b-404b-bb8f-023cec349570 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:13.210270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd5a38-af8b-404b-bb8f-023cec349570 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:13.245679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8a7bb-1c47-467d-8eb7-643f7967b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:13.246758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8a7bb-1c47-467d-8eb7-643f7967b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:13.247254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8a7bb-1c47-467d-8eb7-643f7967b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:13.247761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8a7bb-1c47-467d-8eb7-643f7967b6a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:13.248771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8a7bb-1c47-467d-8eb7-643f7967b6a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:13.249266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8a7bb-1c47-467d-8eb7-643f7967b6a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:13.253707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8a7bb-1c47-467d-8eb7-643f7967b6a1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:13.254311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:13.270047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 439/871] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:13.271009 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8a7bb-1c47-467d-8eb7-643f7967b6a1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:13.276386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 433/872] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 16:00:13 2022] POST /identity/v3/services => generated 269 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:00:13.387291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8a7bb-1c47-467d-8eb7-643f7967b6a1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:13.435867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92f2a-c0f3-452c-b56b-8d862faece93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:13.436486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92f2a-c0f3-452c-b56b-8d862faece93 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:13.436763 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92f2a-c0f3-452c-b56b-8d862faece93 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:13.437033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92f2a-c0f3-452c-b56b-8d862faece93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:13.437925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac92f2a-c0f3-452c-b56b-8d862faece93 None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=ce22dab95b864b84812335cc050ca2c7) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:13.438236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac92f2a-c0f3-452c-b56b-8d862faece93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:13.439805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac92f2a-c0f3-452c-b56b-8d862faece93 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:13.447235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 440/873] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:00:13 2022] GET /identity/v3/role_assignments?user.id=ce22dab95b864b84812335cc050ca2c7&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:13.816507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8c228-fd6d-4422-9794-2068bb74c906 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:13.816861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8c228-fd6d-4422-9794-2068bb74c906 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:13.817069 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8c228-fd6d-4422-9794-2068bb74c906 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:13.818687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 434/874] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:13.824873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3758d10-7516-4b20-ae7d-94e657ad0817 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:13.825332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3758d10-7516-4b20-ae7d-94e657ad0817 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:13.825433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3758d10-7516-4b20-ae7d-94e657ad0817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:13.844676 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e3758d10-7516-4b20-ae7d-94e657ad0817 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:13.845954 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e3758d10-7516-4b20-ae7d-94e657ad0817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:13.901335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc556-3520-4c99-9564-98d58e9eaf1f None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:13.901879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:13.901973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc556-3520-4c99-9564-98d58e9eaf1f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:13.901973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc556-3520-4c99-9564-98d58e9eaf1f None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:13.904667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 435/875] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:13.908809 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ddd69-69f9-4e80-87d5-9a7241d35919 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:13.909094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ddd69-69f9-4e80-87d5-9a7241d35919 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:13.909375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ddd69-69f9-4e80-87d5-9a7241d35919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:13.919599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 441/876] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:13.929233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-af3ddd69-69f9-4e80-87d5-9a7241d35919 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:13.930435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-af3ddd69-69f9-4e80-87d5-9a7241d35919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:14.002039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 436/877] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:14.193030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3758d10-7516-4b20-ae7d-94e657ad0817 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:14.277526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ddd69-69f9-4e80-87d5-9a7241d35919 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:14.303096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3758d10-7516-4b20-ae7d-94e657ad0817 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:14.342271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d102a-24b6-41ed-972e-4e0e2ca6456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:14.342936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d102a-24b6-41ed-972e-4e0e2ca6456f None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:14.343213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d102a-24b6-41ed-972e-4e0e2ca6456f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:14.343481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d102a-24b6-41ed-972e-4e0e2ca6456f None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:14.344130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d102a-24b6-41ed-972e-4e0e2ca6456f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:14.345669 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d102a-24b6-41ed-972e-4e0e2ca6456f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:14.352110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:14.395536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ddd69-69f9-4e80-87d5-9a7241d35919 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:14.435995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0159b2-a2ad-4f83-a32f-ca796eb8f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:14.436676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0159b2-a2ad-4f83-a32f-ca796eb8f91e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:14.436951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0159b2-a2ad-4f83-a32f-ca796eb8f91e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:14.437215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0159b2-a2ad-4f83-a32f-ca796eb8f91e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:14.437794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0159b2-a2ad-4f83-a32f-ca796eb8f91e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:14.439272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0159b2-a2ad-4f83-a32f-ca796eb8f91e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:14.449521 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 442/878] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 16:00:14 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-9e0159b2-a2ad-4f83-a32f-ca796eb8f91e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:14.450094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:14.456887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:14.457776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 437/879] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Sep 8 16:00:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:14.460728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d102a-24b6-41ed-972e-4e0e2ca6456f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:14.522788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:14.593834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d102a-24b6-41ed-972e-4e0e2ca6456f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:14.631493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc764613-5f5f-48f3-8a9e-a0f7638c872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:14.632111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc764613-5f5f-48f3-8a9e-a0f7638c872f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:14.632389 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc764613-5f5f-48f3-8a9e-a0f7638c872f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:14.632659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc764613-5f5f-48f3-8a9e-a0f7638c872f None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:14.633298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc764613-5f5f-48f3-8a9e-a0f7638c872f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:14.633600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc764613-5f5f-48f3-8a9e-a0f7638c872f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:14.635536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc764613-5f5f-48f3-8a9e-a0f7638c872f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:14.645745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 443/880] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Sep 8 16:00:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:14.647223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0159b2-a2ad-4f83-a32f-ca796eb8f91e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:14.754065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0159b2-a2ad-4f83-a32f-ca796eb8f91e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:14.778499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:14.790433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa162d-6a09-43ef-946d-d7312a2ef23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:14.791157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa162d-6a09-43ef-946d-d7312a2ef23c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:14.791517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa162d-6a09-43ef-946d-d7312a2ef23c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:14.791797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa162d-6a09-43ef-946d-d7312a2ef23c None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:14.792429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa162d-6a09-43ef-946d-d7312a2ef23c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:14.792736 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa162d-6a09-43ef-946d-d7312a2ef23c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:14.794199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa162d-6a09-43ef-946d-d7312a2ef23c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:14.802812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 438/881] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Sep 8 16:00:14 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:15.656381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65f90c-6ac8-4f15-925f-2c496075041d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:15.656381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65f90c-6ac8-4f15-925f-2c496075041d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:15.656381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65f90c-6ac8-4f15-925f-2c496075041d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:15.657367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 444/882] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:15.662921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6e0a-ec7f-40af-8221-31b2a7d23515 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:15.663728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6e0a-ec7f-40af-8221-31b2a7d23515 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:15.664229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6e0a-ec7f-40af-8221-31b2a7d23515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:15.683692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-dbff6e0a-ec7f-40af-8221-31b2a7d23515 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:15.685209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dbff6e0a-ec7f-40af-8221-31b2a7d23515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:15.760136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 439/883] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:15.826718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7e33b-7481-4ae5-b603-436b0afca5ad None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:15.827049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7e33b-7481-4ae5-b603-436b0afca5ad None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:15.827279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7e33b-7481-4ae5-b603-436b0afca5ad None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:15.828872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 445/884] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:15.833938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bcdad-65b4-4bdd-b7b4-59df3770bc81 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:15.834230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bcdad-65b4-4bdd-b7b4-59df3770bc81 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:15.834507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bcdad-65b4-4bdd-b7b4-59df3770bc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:15.854113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-204bcdad-65b4-4bdd-b7b4-59df3770bc81 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:15.855340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-204bcdad-65b4-4bdd-b7b4-59df3770bc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:15.930782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 440/885] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:16.036886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7e33b-7481-4ae5-b603-436b0afca5ad None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:16.145153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7e33b-7481-4ae5-b603-436b0afca5ad None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:16.152555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:16.178827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634082d-5b71-4d2e-8ce1-09c2d4288654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:16.179461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634082d-5b71-4d2e-8ce1-09c2d4288654 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:16.179737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634082d-5b71-4d2e-8ce1-09c2d4288654 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:16.180006 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634082d-5b71-4d2e-8ce1-09c2d4288654 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:16.180581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634082d-5b71-4d2e-8ce1-09c2d4288654 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:16.182058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634082d-5b71-4d2e-8ce1-09c2d4288654 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4634082d-5b71-4d2e-8ce1-09c2d4288654 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:16.192771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:16.193794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:16.194728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 446/886] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Sep 8 16:00:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:16.202047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bcdad-65b4-4bdd-b7b4-59df3770bc81 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:16.203760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634082d-5b71-4d2e-8ce1-09c2d4288654 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:16.263210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:16.326129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bcdad-65b4-4bdd-b7b4-59df3770bc81 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:16.326326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634082d-5b71-4d2e-8ce1-09c2d4288654 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:16.361729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8663754-68f3-48b4-83b7-0471bb71709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:16.362743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663754-68f3-48b4-83b7-0471bb71709b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:16.363235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663754-68f3-48b4-83b7-0471bb71709b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:16.363769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663754-68f3-48b4-83b7-0471bb71709b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:16.367962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e075c-db63-48ec-8a5f-bb454d10125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:16.368569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e075c-db63-48ec-8a5f-bb454d10125d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:16.369366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e075c-db63-48ec-8a5f-bb454d10125d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:16.369645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e075c-db63-48ec-8a5f-bb454d10125d None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:16.370267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e075c-db63-48ec-8a5f-bb454d10125d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:16.370567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e075c-db63-48ec-8a5f-bb454d10125d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:16.372249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e075c-db63-48ec-8a5f-bb454d10125d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:16.376926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8663754-68f3-48b4-83b7-0471bb71709b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:16.381903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 447/887] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Sep 8 16:00:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:16.383867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e075c-db63-48ec-8a5f-bb454d10125d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-a8663754-68f3-48b4-83b7-0471bb71709b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:16.387650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:16.388585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:16.389610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 441/888] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Sep 8 16:00:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:16.394703 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8663754-68f3-48b4-83b7-0471bb71709b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:16.433902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:16.509033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8663754-68f3-48b4-83b7-0471bb71709b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:16.518720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e075c-db63-48ec-8a5f-bb454d10125d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:16.519232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:16.555448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f48b15-bc8d-4a49-9f0b-67a88da04ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:16.556087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7a848-5c15-4c43-9758-139d87cbabfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:16.557110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48b15-bc8d-4a49-9f0b-67a88da04ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:16.557373 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7a848-5c15-4c43-9758-139d87cbabfd None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:16.557684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48b15-bc8d-4a49-9f0b-67a88da04ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:16.557803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7a848-5c15-4c43-9758-139d87cbabfd None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:16.558095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7a848-5c15-4c43-9758-139d87cbabfd None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:16.558350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48b15-bc8d-4a49-9f0b-67a88da04ed5 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:16.558928 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7a848-5c15-4c43-9758-139d87cbabfd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:16.559277 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48b15-bc8d-4a49-9f0b-67a88da04ed5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:16.559385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7a848-5c15-4c43-9758-139d87cbabfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:16.559819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48b15-bc8d-4a49-9f0b-67a88da04ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:16.560907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7a848-5c15-4c43-9758-139d87cbabfd None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:16.561525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48b15-bc8d-4a49-9f0b-67a88da04ed5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:16.567158 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 448/889] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Sep 8 16:00:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:16.570732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 442/890] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 8 16:00:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:16.575791 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f48b15-bc8d-4a49-9f0b-67a88da04ed5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:16.576870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7a848-5c15-4c43-9758-139d87cbabfd None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:16.682426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7a848-5c15-4c43-9758-139d87cbabfd None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:16.690850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:16.696890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f48b15-bc8d-4a49-9f0b-67a88da04ed5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:16.728097 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79764bb7-9d36-4287-be39-ad7eb0cc65af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:16.729590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79764bb7-9d36-4287-be39-ad7eb0cc65af None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:16.729871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79764bb7-9d36-4287-be39-ad7eb0cc65af None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:16.730145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79764bb7-9d36-4287-be39-ad7eb0cc65af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:16.740693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f772d2-e5a2-4fac-9c47-2783df5f38fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:16.741585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f772d2-e5a2-4fac-9c47-2783df5f38fa None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:16.742077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f772d2-e5a2-4fac-9c47-2783df5f38fa None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:16.742542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f772d2-e5a2-4fac-9c47-2783df5f38fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:16.742946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79764bb7-9d36-4287-be39-ad7eb0cc65af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:16.743675 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f772d2-e5a2-4fac-9c47-2783df5f38fa None admin] RBAC: Adding query filter params (interface=public, service_id=506a129aefe840b59d778d5d23160e8b, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:16.744819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f772d2-e5a2-4fac-9c47-2783df5f38fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:16.744991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79764bb7-9d36-4287-be39-ad7eb0cc65af None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:16.746903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f772d2-e5a2-4fac-9c47-2783df5f38fa None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:16.757301 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 449/891] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Sep 8 16:00:16 2022] GET /identity/v3/endpoints?service_id=506a129aefe840b59d778d5d23160e8b&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:16.764147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f772d2-e5a2-4fac-9c47-2783df5f38fa None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-79764bb7-9d36-4287-be39-ad7eb0cc65af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:16.766053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:16.767313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:16.768240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:16.768240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:16.768240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:16.770762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 443/892] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:16.774537 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79764bb7-9d36-4287-be39-ad7eb0cc65af None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:16.811599 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:16.892225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f772d2-e5a2-4fac-9c47-2783df5f38fa None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:16.914308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79764bb7-9d36-4287-be39-ad7eb0cc65af None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:16.933828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82678a-5eae-4b64-90c7-96715c34088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:16.934440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82678a-5eae-4b64-90c7-96715c34088a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:16.934744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82678a-5eae-4b64-90c7-96715c34088a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:16.935016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82678a-5eae-4b64-90c7-96715c34088a None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:16.935615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82678a-5eae-4b64-90c7-96715c34088a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:16.936976 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82678a-5eae-4b64-90c7-96715c34088a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:16.947752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 450/893] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Sep 8 16:00:16 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:00:16.947752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a360d0f-d893-43cf-a6fe-ec8daf0a6323 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:16.947752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a360d0f-d893-43cf-a6fe-ec8daf0a6323 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:16.947752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a360d0f-d893-43cf-a6fe-ec8daf0a6323 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:16.947752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 451/894] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:16.952465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e2d9a-f1f2-4104-94fe-89a227ca8600 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:16.952465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e2d9a-f1f2-4104-94fe-89a227ca8600 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:16.952740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e2d9a-f1f2-4104-94fe-89a227ca8600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:16.962955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7e969-791d-48ca-8af0-aa0328d5a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:16.963920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7e969-791d-48ca-8af0-aa0328d5a038 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:16.964384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7e969-791d-48ca-8af0-aa0328d5a038 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:16.964866 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7e969-791d-48ca-8af0-aa0328d5a038 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:16.965743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7e969-791d-48ca-8af0-aa0328d5a038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:16.966237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7e969-791d-48ca-8af0-aa0328d5a038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:16.967922 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7e969-791d-48ca-8af0-aa0328d5a038 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:16.973195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7e6e2d9a-f1f2-4104-94fe-89a227ca8600 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:16.974524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7e6e2d9a-f1f2-4104-94fe-89a227ca8600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:16.982783 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 444/895] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:16.989212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7e969-791d-48ca-8af0-aa0328d5a038 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:16.999991 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:17.062257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 452/896] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:17.093764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:17.115498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7e969-791d-48ca-8af0-aa0328d5a038 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:17.157483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b780bd-1db5-453e-9019-6c5ae5836d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:17.158065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b780bd-1db5-453e-9019-6c5ae5836d5e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:17.158343 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b780bd-1db5-453e-9019-6c5ae5836d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:17.158613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b780bd-1db5-453e-9019-6c5ae5836d5e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:17.168501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b780bd-1db5-453e-9019-6c5ae5836d5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:17.170361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b780bd-1db5-453e-9019-6c5ae5836d5e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-f6b780bd-1db5-453e-9019-6c5ae5836d5e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:17.184307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:17.185267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:17.186243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:17.186243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:17.186243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:17.186243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:17.186243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:17.186243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:17.186243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:17.186243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:17.186243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 16:00:17.186243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:17.187113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 445/897] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Sep 8 16:00:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:17.193177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e2d9a-f1f2-4104-94fe-89a227ca8600 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:17.265057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d93db1-e4d8-4afd-bac4-508ff288729e None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:17.265398 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d93db1-e4d8-4afd-bac4-508ff288729e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:17.265601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d93db1-e4d8-4afd-bac4-508ff288729e None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:17.267487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 446/898] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:00:17.272360 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844445a-cdf8-449c-b101-9ae0ee9b6a96 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:17.272636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844445a-cdf8-449c-b101-9ae0ee9b6a96 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:17.272904 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844445a-cdf8-449c-b101-9ae0ee9b6a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:17.292781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-7844445a-cdf8-449c-b101-9ae0ee9b6a96 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:17.294128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7844445a-cdf8-449c-b101-9ae0ee9b6a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:17.302972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e2d9a-f1f2-4104-94fe-89a227ca8600 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:17.338738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907d1ba-9445-4ac2-975d-692af9e6f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:17.339348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907d1ba-9445-4ac2-975d-692af9e6f2fa None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:17.339620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907d1ba-9445-4ac2-975d-692af9e6f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:17.339886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907d1ba-9445-4ac2-975d-692af9e6f2fa None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:17.340608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907d1ba-9445-4ac2-975d-692af9e6f2fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:17.341023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907d1ba-9445-4ac2-975d-692af9e6f2fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:17.342437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907d1ba-9445-4ac2-975d-692af9e6f2fa None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:17.360050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 453/899] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Sep 8 16:00:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:17.360879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907d1ba-9445-4ac2-975d-692af9e6f2fa None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:17.374878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 447/900] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:17.375721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844445a-cdf8-449c-b101-9ae0ee9b6a96 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:17.378283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:17.474383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:17.484315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907d1ba-9445-4ac2-975d-692af9e6f2fa None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:17.519175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844445a-cdf8-449c-b101-9ae0ee9b6a96 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:17.521377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b86d0-d27d-4f33-82cb-0246af59c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:17.524969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b86d0-d27d-4f33-82cb-0246af59c35a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:17.524969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b86d0-d27d-4f33-82cb-0246af59c35a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:17.524969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b86d0-d27d-4f33-82cb-0246af59c35a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:17.524969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b86d0-d27d-4f33-82cb-0246af59c35a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:17.527002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b86d0-d27d-4f33-82cb-0246af59c35a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d20b86d0-d27d-4f33-82cb-0246af59c35a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:17.537531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:17.539249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 16:00:17.541004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:17.545492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 454/901] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 16:00:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:17.551280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b86d0-d27d-4f33-82cb-0246af59c35a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:17.573758 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96469705-faed-466c-9db8-969a269909dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:17.574817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96469705-faed-466c-9db8-969a269909dc None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:17.575318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96469705-faed-466c-9db8-969a269909dc None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:17.576336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96469705-faed-466c-9db8-969a269909dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:17.644796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:17.668061 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b86d0-d27d-4f33-82cb-0246af59c35a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:17.672313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96469705-faed-466c-9db8-969a269909dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:17.673831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96469705-faed-466c-9db8-969a269909dc None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:17.707154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6e015-eb7e-45bb-875f-34cef66e753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:17.707814 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6e015-eb7e-45bb-875f-34cef66e753a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:17.708032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6e015-eb7e-45bb-875f-34cef66e753a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:17.708302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6e015-eb7e-45bb-875f-34cef66e753a None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:17.708927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6e015-eb7e-45bb-875f-34cef66e753a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:17.709228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6e015-eb7e-45bb-875f-34cef66e753a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:17.710635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6e015-eb7e-45bb-875f-34cef66e753a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:17.720645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 455/902] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 16:00:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:17.720645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6e015-eb7e-45bb-875f-34cef66e753a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:17.747508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:17.779831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 448/903] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:00:17 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:17.780781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96469705-faed-466c-9db8-969a269909dc None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:17.830699 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6e015-eb7e-45bb-875f-34cef66e753a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:17.865864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3fd16-5704-454b-ad1c-bd772c35bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:17.866475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3fd16-5704-454b-ad1c-bd772c35bfa4 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:17.866791 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3fd16-5704-454b-ad1c-bd772c35bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:17.867068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3fd16-5704-454b-ad1c-bd772c35bfa4 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:17.867713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3fd16-5704-454b-ad1c-bd772c35bfa4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:17.869609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3fd16-5704-454b-ad1c-bd772c35bfa4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:17.882072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96469705-faed-466c-9db8-969a269909dc None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:17.917114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a56777-7e18-40cf-9af5-e1d0712844ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:17.917732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56777-7e18-40cf-9af5-e1d0712844ab None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:17.918014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56777-7e18-40cf-9af5-e1d0712844ab None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:17.918281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56777-7e18-40cf-9af5-e1d0712844ab None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:17.918967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a56777-7e18-40cf-9af5-e1d0712844ab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:17.919268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a56777-7e18-40cf-9af5-e1d0712844ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:17.920640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a56777-7e18-40cf-9af5-e1d0712844ab None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:17.925609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 449/904] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 16:00:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:17.926320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a56777-7e18-40cf-9af5-e1d0712844ab None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:17.950137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 456/905] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 16:00:17 2022] POST /identity/v3/services => generated 241 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:00:17.953034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3fd16-5704-454b-ad1c-bd772c35bfa4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:17.955025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:17.970011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:18.057183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a56777-7e18-40cf-9af5-e1d0712844ab None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:18.082460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3fd16-5704-454b-ad1c-bd772c35bfa4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:18.107082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4edbee-4bce-42e0-a9d9-f42abe28184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:18.107744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4edbee-4bce-42e0-a9d9-f42abe28184e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:18.108025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4edbee-4bce-42e0-a9d9-f42abe28184e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:18.108304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4edbee-4bce-42e0-a9d9-f42abe28184e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:18.122396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4edbee-4bce-42e0-a9d9-f42abe28184e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:18.124395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4edbee-4bce-42e0-a9d9-f42abe28184e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:18.127316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af551731-42bf-4b01-8f50-095baea1252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:18.128458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551731-42bf-4b01-8f50-095baea1252d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:18.128743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551731-42bf-4b01-8f50-095baea1252d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:18.129021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af551731-42bf-4b01-8f50-095baea1252d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:18.129730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af551731-42bf-4b01-8f50-095baea1252d None admin] RBAC: Adding query filter params (interface=public, service_id=754bb48bb7d2440cac1803f7c45ba98b, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:18.130037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af551731-42bf-4b01-8f50-095baea1252d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:18.131452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af551731-42bf-4b01-8f50-095baea1252d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:18.139365 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 457/906] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Sep 8 16:00:17 2022] GET /identity/v3/endpoints?service_id=754bb48bb7d2440cac1803f7c45ba98b&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-bb4edbee-4bce-42e0-a9d9-f42abe28184e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:18.144552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:18.145511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:18.146430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:18.146430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:18.146430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:18.146614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af551731-42bf-4b01-8f50-095baea1252d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:18.146722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 450/907] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:18.155650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4edbee-4bce-42e0-a9d9-f42abe28184e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:18.226055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:18.264365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:18.274265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af551731-42bf-4b01-8f50-095baea1252d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:18.283224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4edbee-4bce-42e0-a9d9-f42abe28184e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:18.323103 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d6a89-5fc2-48ec-9bf8-bba838f1b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:18.323716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d6a89-5fc2-48ec-9bf8-bba838f1b73d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:18.323994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d6a89-5fc2-48ec-9bf8-bba838f1b73d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:18.324267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d6a89-5fc2-48ec-9bf8-bba838f1b73d None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:18.324874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d6a89-5fc2-48ec-9bf8-bba838f1b73d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:18.326074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472c186-dd47-4736-8e38-dc833baca636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:18.326215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d6a89-5fc2-48ec-9bf8-bba838f1b73d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:18.326836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472c186-dd47-4736-8e38-dc833baca636 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:18.327184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472c186-dd47-4736-8e38-dc833baca636 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:18.327525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472c186-dd47-4736-8e38-dc833baca636 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:18.328234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472c186-dd47-4736-8e38-dc833baca636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:18.328601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472c186-dd47-4736-8e38-dc833baca636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:18.330025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472c186-dd47-4736-8e38-dc833baca636 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:18.333739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 458/908] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Sep 8 16:00:18 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:00:18.345237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 451/909] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:18.350712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d6a89-5fc2-48ec-9bf8-bba838f1b73d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:18.467502 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d6a89-5fc2-48ec-9bf8-bba838f1b73d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:18.497319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:18.507040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c2608-d0e3-4b6b-80ab-96476f948a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:18.507683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c2608-d0e3-4b6b-80ab-96476f948a3b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:18.507981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c2608-d0e3-4b6b-80ab-96476f948a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:18.508289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c2608-d0e3-4b6b-80ab-96476f948a3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:18.515882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c2608-d0e3-4b6b-80ab-96476f948a3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:18.518036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c2608-d0e3-4b6b-80ab-96476f948a3b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-843c2608-d0e3-4b6b-80ab-96476f948a3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:18.532843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:18.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:18.535281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:18.535281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:18.535281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:18.535281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:18.535281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:18.535281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:18.535281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:18.535281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:18.535281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 459/910] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:18.540056 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472c186-dd47-4736-8e38-dc833baca636 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:18.654379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472c186-dd47-4736-8e38-dc833baca636 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:18.690208 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3004a4-dc6f-4ab6-837f-4578b0350e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:18.691147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3004a4-dc6f-4ab6-837f-4578b0350e5d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:18.691637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3004a4-dc6f-4ab6-837f-4578b0350e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:18.692364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3004a4-dc6f-4ab6-837f-4578b0350e5d None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:18.693228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3004a4-dc6f-4ab6-837f-4578b0350e5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:18.693719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3004a4-dc6f-4ab6-837f-4578b0350e5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:18.695462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3004a4-dc6f-4ab6-837f-4578b0350e5d None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:18.707969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 452/911] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:18.714820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c2608-d0e3-4b6b-80ab-96476f948a3b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:18.826003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c2608-d0e3-4b6b-80ab-96476f948a3b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:18.861510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0039af-1154-4a1c-8e97-d81fcc12828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:18.862110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0039af-1154-4a1c-8e97-d81fcc12828e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:18.862382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0039af-1154-4a1c-8e97-d81fcc12828e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:18.862647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0039af-1154-4a1c-8e97-d81fcc12828e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:18.863387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0039af-1154-4a1c-8e97-d81fcc12828e None admin] RBAC: Adding query filter params (role.id=cd03bc5d3f3f4da982ce0092790c9b47, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=ce22dab95b864b84812335cc050ca2c7) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:18.863833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0039af-1154-4a1c-8e97-d81fcc12828e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:18.865254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0039af-1154-4a1c-8e97-d81fcc12828e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:18.871337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 460/912] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:00:18 2022] GET /identity/v3/role_assignments?user.id=ce22dab95b864b84812335cc050ca2c7&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=cd03bc5d3f3f4da982ce0092790c9b47 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:19.215400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c7c2e-9405-4026-9be0-23578fbfa137 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:19.215955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c7c2e-9405-4026-9be0-23578fbfa137 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:19.215955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c7c2e-9405-4026-9be0-23578fbfa137 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:19.217554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 453/913] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:19.223452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26211a-c2a9-461a-9b48-135c65c34cb0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:19.223723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26211a-c2a9-461a-9b48-135c65c34cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:19.223998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26211a-c2a9-461a-9b48-135c65c34cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:19.242656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2d26211a-c2a9-461a-9b48-135c65c34cb0 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:19.243900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2d26211a-c2a9-461a-9b48-135c65c34cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:19.293534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:19.319441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 461/914] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:19.590399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c7c2e-9405-4026-9be0-23578fbfa137 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:19.599995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:19.701623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c7c2e-9405-4026-9be0-23578fbfa137 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:19.735916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c743f6d-6777-44f5-a982-03a3e93f3bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:19.736556 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c743f6d-6777-44f5-a982-03a3e93f3bab None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:19.736831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c743f6d-6777-44f5-a982-03a3e93f3bab None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:19.737099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c743f6d-6777-44f5-a982-03a3e93f3bab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:19.737686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c743f6d-6777-44f5-a982-03a3e93f3bab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:19.739099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c743f6d-6777-44f5-a982-03a3e93f3bab None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-1c743f6d-6777-44f5-a982-03a3e93f3bab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:19.748999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:19.750067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:19.751449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 454/915] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Sep 8 16:00:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:19.758881 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26211a-c2a9-461a-9b48-135c65c34cb0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:19.862727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26211a-c2a9-461a-9b48-135c65c34cb0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:19.897295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423b0be-f413-459b-bdd9-a0d0c6867b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:19.900627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b0be-f413-459b-bdd9-a0d0c6867b6a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:19.900627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b0be-f413-459b-bdd9-a0d0c6867b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:19.900627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b0be-f413-459b-bdd9-a0d0c6867b6a None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:19.900627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423b0be-f413-459b-bdd9-a0d0c6867b6a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:19.900627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423b0be-f413-459b-bdd9-a0d0c6867b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:19.901272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423b0be-f413-459b-bdd9-a0d0c6867b6a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:19.906281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 462/916] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Sep 8 16:00:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:19.912099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c743f6d-6777-44f5-a982-03a3e93f3bab None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:19.987705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:20.019953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c743f6d-6777-44f5-a982-03a3e93f3bab None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:20.059521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e52914-9b0a-4951-9a28-4c3ddf44880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:20.060224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52914-9b0a-4951-9a28-4c3ddf44880a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:20.060508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52914-9b0a-4951-9a28-4c3ddf44880a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:20.060777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52914-9b0a-4951-9a28-4c3ddf44880a None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:20.061404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e52914-9b0a-4951-9a28-4c3ddf44880a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:20.061755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e52914-9b0a-4951-9a28-4c3ddf44880a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:20.063203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e52914-9b0a-4951-9a28-4c3ddf44880a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:20.068611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 455/917] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Sep 8 16:00:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:20.074841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423b0be-f413-459b-bdd9-a0d0c6867b6a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:20.121972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:20.179289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423b0be-f413-459b-bdd9-a0d0c6867b6a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:20.215037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1d553-1c3d-4e85-bf68-27ca74eebc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:20.215672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1d553-1c3d-4e85-bf68-27ca74eebc3b None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:20.215948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1d553-1c3d-4e85-bf68-27ca74eebc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:20.216218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1d553-1c3d-4e85-bf68-27ca74eebc3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:20.216931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1d553-1c3d-4e85-bf68-27ca74eebc3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:20.218333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1d553-1c3d-4e85-bf68-27ca74eebc3b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:20.305045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 463/918] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:00:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:00:20.334218 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139b71-5b49-417c-9039-5369c53e1b84 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:20.334790 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139b71-5b49-417c-9039-5369c53e1b84 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:20.334790 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6139b71-5b49-417c-9039-5369c53e1b84 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:20.336452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 456/919] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:20.342290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8b59b-7dde-430e-9145-febbe5f9011d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:20.342610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8b59b-7dde-430e-9145-febbe5f9011d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:20.342872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8b59b-7dde-430e-9145-febbe5f9011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:20.362606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-91d8b59b-7dde-430e-9145-febbe5f9011d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:20.363916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-91d8b59b-7dde-430e-9145-febbe5f9011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:20.459693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 464/920] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:20.638133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d2344-f73a-42bb-bfef-d9deca0760e9 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:20.638477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d2344-f73a-42bb-bfef-d9deca0760e9 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:20.638652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d2344-f73a-42bb-bfef-d9deca0760e9 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:20.640276 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 457/921] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:20.645782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2a668-b29b-4a06-bdcd-71e361e7372c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:20.646073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2a668-b29b-4a06-bdcd-71e361e7372c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:20.646346 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2a668-b29b-4a06-bdcd-71e361e7372c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:20.664564 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-07b2a668-b29b-4a06-bdcd-71e361e7372c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:20.666300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-07b2a668-b29b-4a06-bdcd-71e361e7372c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:20.687198 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:20.730327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d2344-f73a-42bb-bfef-d9deca0760e9 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:20.741965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 465/922] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:20.840344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d2344-f73a-42bb-bfef-d9deca0760e9 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:20.877596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8437c-f103-452f-8287-d0aa016a84d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:20.878236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8437c-f103-452f-8287-d0aa016a84d6 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:20.878513 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8437c-f103-452f-8287-d0aa016a84d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:20.878939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8437c-f103-452f-8287-d0aa016a84d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:20.879594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8437c-f103-452f-8287-d0aa016a84d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:20.881039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8437c-f103-452f-8287-d0aa016a84d6 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:20.882927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-41a8437c-f103-452f-8287-d0aa016a84d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:20.891422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:20.892665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:20.893500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 458/923] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Sep 8 16:00:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:20.901314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2a668-b29b-4a06-bdcd-71e361e7372c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:21.007365 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2a668-b29b-4a06-bdcd-71e361e7372c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:21.033508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8437c-f103-452f-8287-d0aa016a84d6 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:21.048738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28c094-104d-4922-900d-c8db3adb6234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:21.049712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28c094-104d-4922-900d-c8db3adb6234 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.050196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28c094-104d-4922-900d-c8db3adb6234 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.050649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28c094-104d-4922-900d-c8db3adb6234 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.051488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28c094-104d-4922-900d-c8db3adb6234 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:21.052047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28c094-104d-4922-900d-c8db3adb6234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:21.053707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28c094-104d-4922-900d-c8db3adb6234 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:21.059613 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 466/924] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Sep 8 16:00:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:21.064889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28c094-104d-4922-900d-c8db3adb6234 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:21.088120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:21.162970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8437c-f103-452f-8287-d0aa016a84d6 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:21.168257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28c094-104d-4922-900d-c8db3adb6234 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:21.202469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea87a3-b991-4d94-8797-232ce306dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:21.203131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea87a3-b991-4d94-8797-232ce306dd97 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.203502 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea87a3-b991-4d94-8797-232ce306dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.203774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea87a3-b991-4d94-8797-232ce306dd97 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.204008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dc332-8be8-472b-be5b-25e45cec6dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:21.204358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea87a3-b991-4d94-8797-232ce306dd97 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:21.204615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc332-8be8-472b-be5b-25e45cec6dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.204890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc332-8be8-472b-be5b-25e45cec6dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.205159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc332-8be8-472b-be5b-25e45cec6dd7 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.205724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea87a3-b991-4d94-8797-232ce306dd97 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:21.205832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dc332-8be8-472b-be5b-25e45cec6dd7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:21.206084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dc332-8be8-472b-be5b-25e45cec6dd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:21.207439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dc332-8be8-472b-be5b-25e45cec6dd7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:21.212875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 467/925] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Sep 8 16:00:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:21.214027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171267-ad5a-404c-a4e7-6fe321ba1fb1 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.214305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171267-ad5a-404c-a4e7-6fe321ba1fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.214800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171267-ad5a-404c-a4e7-6fe321ba1fb1 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-2cea87a3-b991-4d94-8797-232ce306dd97 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:21.216966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:21.217927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 16:00:21.218792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:21.219535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 468/926] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:21.222811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 459/927] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 16:00:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:21.225501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea87a3-b991-4d94-8797-232ce306dd97 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:21.225871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c1512-5731-4e2c-8cbe-4d24f212c127 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.226160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c1512-5731-4e2c-8cbe-4d24f212c127 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.226453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c1512-5731-4e2c-8cbe-4d24f212c127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.247193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-321c1512-5731-4e2c-8cbe-4d24f212c127 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:21.248390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-321c1512-5731-4e2c-8cbe-4d24f212c127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:21.300414 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:21.321270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 469/928] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:21.322507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c1512-5731-4e2c-8cbe-4d24f212c127 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:21.344574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:21.350163 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea87a3-b991-4d94-8797-232ce306dd97 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:21.393266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd4595-c3a7-44c4-82f6-e8e36f09ce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:21.394762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd4595-c3a7-44c4-82f6-e8e36f09ce94 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.395193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd4595-c3a7-44c4-82f6-e8e36f09ce94 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.395871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd4595-c3a7-44c4-82f6-e8e36f09ce94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.396719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd4595-c3a7-44c4-82f6-e8e36f09ce94 None admin] RBAC: Adding query filter params (interface=public, service_id=d78fcace97084e8b9b928336054c6134, region_id=RegionOne) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:21.397200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd4595-c3a7-44c4-82f6-e8e36f09ce94 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:21.399574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd4595-c3a7-44c4-82f6-e8e36f09ce94 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:21.406759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 460/929] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Sep 8 16:00:21 2022] GET /identity/v3/endpoints?service_id=d78fcace97084e8b9b928336054c6134&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:21.415008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd4595-c3a7-44c4-82f6-e8e36f09ce94 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:21.449268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c1512-5731-4e2c-8cbe-4d24f212c127 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:21.485149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233666b-d424-4591-8d86-f22d2bd90ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:21.485752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233666b-d424-4591-8d86-f22d2bd90ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.486025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233666b-d424-4591-8d86-f22d2bd90ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.486291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233666b-d424-4591-8d86-f22d2bd90ff4 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.486943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233666b-d424-4591-8d86-f22d2bd90ff4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:21.487245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233666b-d424-4591-8d86-f22d2bd90ff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:21.488707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233666b-d424-4591-8d86-f22d2bd90ff4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:21.498079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 470/930] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 16:00:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:21.499227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233666b-d424-4591-8d86-f22d2bd90ff4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:21.563418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd4595-c3a7-44c4-82f6-e8e36f09ce94 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:21.584384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:21.597163 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:21.605751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a8c2d-b614-45a3-9a9d-92a712b831ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:21.606371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a8c2d-b614-45a3-9a9d-92a712b831ef None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.606654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a8c2d-b614-45a3-9a9d-92a712b831ef None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.610932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a8c2d-b614-45a3-9a9d-92a712b831ef None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.610932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a8c2d-b614-45a3-9a9d-92a712b831ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:21.611094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233666b-d424-4591-8d86-f22d2bd90ff4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:21.611171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a8c2d-b614-45a3-9a9d-92a712b831ef None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:21.619055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 461/931] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Sep 8 16:00:21 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:00:21.619055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a8c2d-b614-45a3-9a9d-92a712b831ef None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:21.654099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d2129-6575-4769-886f-e9f13e95b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:21.654743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d2129-6575-4769-886f-e9f13e95b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.655019 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d2129-6575-4769-886f-e9f13e95b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.655287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d2129-6575-4769-886f-e9f13e95b8d3 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.656054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d2129-6575-4769-886f-e9f13e95b8d3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:21.656477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d2129-6575-4769-886f-e9f13e95b8d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:21.657748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d2129-6575-4769-886f-e9f13e95b8d3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:21.668114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 471/932] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Sep 8 16:00:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:21.669268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d2129-6575-4769-886f-e9f13e95b8d3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:21.747576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a8c2d-b614-45a3-9a9d-92a712b831ef None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:21.788702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03e0d0-a045-4b94-a893-982f4cba1cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:21.789352 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03e0d0-a045-4b94-a893-982f4cba1cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.789652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03e0d0-a045-4b94-a893-982f4cba1cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.789932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03e0d0-a045-4b94-a893-982f4cba1cc9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.799567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d2129-6575-4769-886f-e9f13e95b8d3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:21.803377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03e0d0-a045-4b94-a893-982f4cba1cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-cc03e0d0-a045-4b94-a893-982f4cba1cc9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:21.809144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:21.810101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:21.811008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 462/933] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Sep 8 16:00:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:21.816229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03e0d0-a045-4b94-a893-982f4cba1cc9 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:21.848906 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef036827-1c9b-4a07-9d3f-c22daeae0f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:21.849514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef036827-1c9b-4a07-9d3f-c22daeae0f71 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.849789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef036827-1c9b-4a07-9d3f-c22daeae0f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.850055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef036827-1c9b-4a07-9d3f-c22daeae0f71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.850737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef036827-1c9b-4a07-9d3f-c22daeae0f71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:21.852102 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef036827-1c9b-4a07-9d3f-c22daeae0f71 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:21.876368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:21.928205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03e0d0-a045-4b94-a893-982f4cba1cc9 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:21.938042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:21.945902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 472/934] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:00:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:00:21.984445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df4f4-9da1-452c-84bd-61aea0609fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:21.985128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df4f4-9da1-452c-84bd-61aea0609fbd None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:21.985408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df4f4-9da1-452c-84bd-61aea0609fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:21.985723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df4f4-9da1-452c-84bd-61aea0609fbd None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:21.986411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06df4f4-9da1-452c-84bd-61aea0609fbd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:21.986782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06df4f4-9da1-452c-84bd-61aea0609fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:21.988199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06df4f4-9da1-452c-84bd-61aea0609fbd None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:21.999356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 463/935] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 8 16:00:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:22.005543 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef036827-1c9b-4a07-9d3f-c22daeae0f71 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:22.121517 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef036827-1c9b-4a07-9d3f-c22daeae0f71 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:22.158112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f652fdb-067c-4276-9753-cb8991f3fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:22.159488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f652fdb-067c-4276-9753-cb8991f3fa34 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:22.159488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f652fdb-067c-4276-9753-cb8991f3fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:22.159488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f652fdb-067c-4276-9753-cb8991f3fa34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:22.171509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f652fdb-067c-4276-9753-cb8991f3fa34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:22.173072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f652fdb-067c-4276-9753-cb8991f3fa34 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6f652fdb-067c-4276-9753-cb8991f3fa34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:22.188428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:22.189442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:22.190379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:22.190379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:22.190379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:22.190379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 473/936] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:22.195905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df4f4-9da1-452c-84bd-61aea0609fbd None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:22.301650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df4f4-9da1-452c-84bd-61aea0609fbd None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:22.311043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:22.336646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec4c8e-992e-4f9b-a41a-b4b7c45b1ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:22.337921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec4c8e-992e-4f9b-a41a-b4b7c45b1ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:22.338204 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec4c8e-992e-4f9b-a41a-b4b7c45b1ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:22.338476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec4c8e-992e-4f9b-a41a-b4b7c45b1ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:22.339143 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec4c8e-992e-4f9b-a41a-b4b7c45b1ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:22.339442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec4c8e-992e-4f9b-a41a-b4b7c45b1ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:22.340813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec4c8e-992e-4f9b-a41a-b4b7c45b1ab7 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:22.358869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 464/937] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:22.362743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f652fdb-067c-4276-9753-cb8991f3fa34 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:22.417459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:22.478197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f652fdb-067c-4276-9753-cb8991f3fa34 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:22.515771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1baf36f-a41d-4d5c-a602-acf7406e5fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:22.517046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baf36f-a41d-4d5c-a602-acf7406e5fca None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:22.517527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baf36f-a41d-4d5c-a602-acf7406e5fca None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:22.517972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1baf36f-a41d-4d5c-a602-acf7406e5fca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:22.525970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1baf36f-a41d-4d5c-a602-acf7406e5fca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:22.527652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1baf36f-a41d-4d5c-a602-acf7406e5fca None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d1baf36f-a41d-4d5c-a602-acf7406e5fca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:22.543355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:22.544345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:22.545300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:22.545300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:22.545300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:22.545300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:22.545300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:22.545300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:22.545300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:22.545300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:22.545300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 16:00:22.545300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:22.547497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 474/938] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Sep 8 16:00:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:22.558782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec4c8e-992e-4f9b-a41a-b4b7c45b1ab7 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:22.582366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc6afa-29d3-46a9-9901-ceaa78d84af2 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:22.582639 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc6afa-29d3-46a9-9901-ceaa78d84af2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:22.582938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc6afa-29d3-46a9-9901-ceaa78d84af2 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:22.584510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 475/939] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:00:22.591979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751bc17-5f6f-4063-bc31-e1e3fd084c69 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:22.592261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751bc17-5f6f-4063-bc31-e1e3fd084c69 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:22.592533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751bc17-5f6f-4063-bc31-e1e3fd084c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:22.610890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a751bc17-5f6f-4063-bc31-e1e3fd084c69 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:22.612089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a751bc17-5f6f-4063-bc31-e1e3fd084c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:22.682536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec4c8e-992e-4f9b-a41a-b4b7c45b1ab7 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:22.694656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 476/940] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:22.722679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8c562-b1e7-47e9-aff9-3221ddcde059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:22.723342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8c562-b1e7-47e9-aff9-3221ddcde059 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:22.723615 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8c562-b1e7-47e9-aff9-3221ddcde059 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:22.723884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8c562-b1e7-47e9-aff9-3221ddcde059 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:22.724656 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8c562-b1e7-47e9-aff9-3221ddcde059 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:22.725020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8c562-b1e7-47e9-aff9-3221ddcde059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:22.726480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8c562-b1e7-47e9-aff9-3221ddcde059 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:22.745236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 465/941] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Sep 8 16:00:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:22.750966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751bc17-5f6f-4063-bc31-e1e3fd084c69 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:22.794191 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:22.856066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751bc17-5f6f-4063-bc31-e1e3fd084c69 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:22.892159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3872a-8cf2-4cd1-b3aa-20f13dd911f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:22.892787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3872a-8cf2-4cd1-b3aa-20f13dd911f6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:22.893064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3872a-8cf2-4cd1-b3aa-20f13dd911f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:22.893331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3872a-8cf2-4cd1-b3aa-20f13dd911f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:22.903610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3872a-8cf2-4cd1-b3aa-20f13dd911f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:22.905056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3872a-8cf2-4cd1-b3aa-20f13dd911f6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-03a3872a-8cf2-4cd1-b3aa-20f13dd911f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:22.920304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:22.921258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:22.922156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:22.922156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:22.922156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:22.922156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 477/942] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:22.927011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8c562-b1e7-47e9-aff9-3221ddcde059 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:22.959047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:22.994964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3872a-8cf2-4cd1-b3aa-20f13dd911f6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:23.039081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8c562-b1e7-47e9-aff9-3221ddcde059 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:23.075721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9529c-6eb9-45b8-a52d-e5c40e861113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:23.076628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9529c-6eb9-45b8-a52d-e5c40e861113 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:23.076904 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9529c-6eb9-45b8-a52d-e5c40e861113 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:23.077627 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9529c-6eb9-45b8-a52d-e5c40e861113 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:23.078593 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9529c-6eb9-45b8-a52d-e5c40e861113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:23.078924 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9529c-6eb9-45b8-a52d-e5c40e861113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:23.080291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9529c-6eb9-45b8-a52d-e5c40e861113 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:23.098862 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 466/943] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:23.100948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9529c-6eb9-45b8-a52d-e5c40e861113 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:23.120870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:23.131173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3872a-8cf2-4cd1-b3aa-20f13dd911f6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:23.174092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd82367-678c-48f0-a51a-e17977033527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:23.174741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd82367-678c-48f0-a51a-e17977033527 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:23.175021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd82367-678c-48f0-a51a-e17977033527 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:23.175294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd82367-678c-48f0-a51a-e17977033527 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:23.176042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd82367-678c-48f0-a51a-e17977033527 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:23.177986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd82367-678c-48f0-a51a-e17977033527 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1fd82367-678c-48f0-a51a-e17977033527 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:23.189156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:23.190149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:23.191038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 478/944] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:23.198377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd82367-678c-48f0-a51a-e17977033527 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:23.209622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:23.224987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9529c-6eb9-45b8-a52d-e5c40e861113 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:23.261172 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03476b78-502f-4fca-a4b7-c8d9460fd5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:23.261810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03476b78-502f-4fca-a4b7-c8d9460fd5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:23.262089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03476b78-502f-4fca-a4b7-c8d9460fd5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:23.262360 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03476b78-502f-4fca-a4b7-c8d9460fd5e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:23.270024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03476b78-502f-4fca-a4b7-c8d9460fd5e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:23.271502 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03476b78-502f-4fca-a4b7-c8d9460fd5e5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-03476b78-502f-4fca-a4b7-c8d9460fd5e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:23.284795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:23.285734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:23.286624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:23.286624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:23.286624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:23.286624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:23.286624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:23.286624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:23.286624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:23.286624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:23.291001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 467/945] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:23.292656 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03476b78-502f-4fca-a4b7-c8d9460fd5e5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:23.312011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd82367-678c-48f0-a51a-e17977033527 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:23.348978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119b384-1fb5-4779-8bd9-048878c3ba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:23.349935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b384-1fb5-4779-8bd9-048878c3ba34 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:23.350352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b384-1fb5-4779-8bd9-048878c3ba34 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:23.350816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b384-1fb5-4779-8bd9-048878c3ba34 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:23.351601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119b384-1fb5-4779-8bd9-048878c3ba34 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:23.352046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119b384-1fb5-4779-8bd9-048878c3ba34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:23.354316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119b384-1fb5-4779-8bd9-048878c3ba34 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:23.364360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 479/946] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 16:00:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:23.365488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119b384-1fb5-4779-8bd9-048878c3ba34 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:23.388198 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:23.402036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03476b78-502f-4fca-a4b7-c8d9460fd5e5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:23.439380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef564ff-8190-469a-a976-c21d871e05e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:23.440000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef564ff-8190-469a-a976-c21d871e05e4 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:23.440278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef564ff-8190-469a-a976-c21d871e05e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:23.440549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef564ff-8190-469a-a976-c21d871e05e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:23.441234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef564ff-8190-469a-a976-c21d871e05e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:23.441588 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef564ff-8190-469a-a976-c21d871e05e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:23.443261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef564ff-8190-469a-a976-c21d871e05e4 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:23.461768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 468/947] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:23.463701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef564ff-8190-469a-a976-c21d871e05e4 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:23.473595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:23.476882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119b384-1fb5-4779-8bd9-048878c3ba34 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:23.512289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c44f8-0ac9-4009-b715-761d8f2e1e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:23.513207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c44f8-0ac9-4009-b715-761d8f2e1e40 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:23.513624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c44f8-0ac9-4009-b715-761d8f2e1e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:23.514032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c44f8-0ac9-4009-b715-761d8f2e1e40 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:23.515768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c44f8-0ac9-4009-b715-761d8f2e1e40 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:23.516283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c44f8-0ac9-4009-b715-761d8f2e1e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:23.518046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c44f8-0ac9-4009-b715-761d8f2e1e40 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:23.530986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 480/948] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 16:00:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:23.577452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef564ff-8190-469a-a976-c21d871e05e4 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:23.616364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a77c35-3d9b-4adb-bc9f-c6626173b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:23.617048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a77c35-3d9b-4adb-bc9f-c6626173b7db None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:23.617329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a77c35-3d9b-4adb-bc9f-c6626173b7db None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:23.617606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a77c35-3d9b-4adb-bc9f-c6626173b7db None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/ce22dab95b864b84812335cc050ca2c7/roles/cd03bc5d3f3f4da982ce0092790c9b47` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:23.620039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a77c35-3d9b-4adb-bc9f-c6626173b7db None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=ce22dab95b864b84812335cc050ca2c7, role_id=cd03bc5d3f3f4da982ce0092790c9b47)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:23.621526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a77c35-3d9b-4adb-bc9f-c6626173b7db None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:23.710861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 469/949] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 16:00:23 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/ce22dab95b864b84812335cc050ca2c7/roles/cd03bc5d3f3f4da982ce0092790c9b47 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:00:23.908903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552c0c-495a-4f6a-a381-7df0acfd319c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:23.909542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552c0c-495a-4f6a-a381-7df0acfd319c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:23.910010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad552c0c-495a-4f6a-a381-7df0acfd319c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:23.911582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 481/950] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:23.917545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1176-8fef-486f-baa1-5a9d90d1e73e None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:23.917827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1176-8fef-486f-baa1-5a9d90d1e73e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:23.918101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1176-8fef-486f-baa1-5a9d90d1e73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:23.937079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-77ff1176-8fef-486f-baa1-5a9d90d1e73e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:23.938274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-77ff1176-8fef-486f-baa1-5a9d90d1e73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:23.998175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:24.005892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 470/951] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:24.272086 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51ec96-460a-4577-95f5-1cf954804277 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:24.272601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51ec96-460a-4577-95f5-1cf954804277 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:24.272601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51ec96-460a-4577-95f5-1cf954804277 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:24.274224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 482/952] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:24.277266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff1176-8fef-486f-baa1-5a9d90d1e73e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:24.279990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117ed7-fdb0-4628-adbe-0ef3586a1060 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:24.280275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117ed7-fdb0-4628-adbe-0ef3586a1060 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:24.280545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117ed7-fdb0-4628-adbe-0ef3586a1060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:24.299259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-dc117ed7-fdb0-4628-adbe-0ef3586a1060 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:24.300475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dc117ed7-fdb0-4628-adbe-0ef3586a1060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:24.376851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 483/953] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:24.385585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff1176-8fef-486f-baa1-5a9d90d1e73e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:24.434692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89725858-f117-4d2b-802c-8785a65cc678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:24.436044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725858-f117-4d2b-802c-8785a65cc678 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:24.436549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725858-f117-4d2b-802c-8785a65cc678 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:24.437015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725858-f117-4d2b-802c-8785a65cc678 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:24.437800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89725858-f117-4d2b-802c-8785a65cc678 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:24.439403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89725858-f117-4d2b-802c-8785a65cc678 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-89725858-f117-4d2b-802c-8785a65cc678 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:24.448995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:24.449990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:24.450857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:24.453630 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 471/954] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Sep 8 16:00:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:24.460022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc117ed7-fdb0-4628-adbe-0ef3586a1060 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:24.483768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:24.561981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc117ed7-fdb0-4628-adbe-0ef3586a1060 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:24.595661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fdf35-c8b5-424f-b28b-986270e2c370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:24.596259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fdf35-c8b5-424f-b28b-986270e2c370 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:24.596529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fdf35-c8b5-424f-b28b-986270e2c370 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:24.596794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fdf35-c8b5-424f-b28b-986270e2c370 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:24.597419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fdf35-c8b5-424f-b28b-986270e2c370 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:24.597714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fdf35-c8b5-424f-b28b-986270e2c370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:24.599096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fdf35-c8b5-424f-b28b-986270e2c370 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:24.604544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 484/955] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Sep 8 16:00:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:24.610171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89725858-f117-4d2b-802c-8785a65cc678 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:24.660463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fdf35-c8b5-424f-b28b-986270e2c370 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:24.674199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:24.719117 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89725858-f117-4d2b-802c-8785a65cc678 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:24.745244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:24.756158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696f87d-727b-4c42-81c4-16a87b946a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:24.756906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696f87d-727b-4c42-81c4-16a87b946a23 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:24.757231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696f87d-727b-4c42-81c4-16a87b946a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:24.757577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696f87d-727b-4c42-81c4-16a87b946a23 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:24.758460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696f87d-727b-4c42-81c4-16a87b946a23 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:24.758916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696f87d-727b-4c42-81c4-16a87b946a23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:24.760367 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e696f87d-727b-4c42-81c4-16a87b946a23 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:24.766700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 472/956] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Sep 8 16:00:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:24.771538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696f87d-727b-4c42-81c4-16a87b946a23 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:24.774427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fdf35-c8b5-424f-b28b-986270e2c370 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:24.816217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd7cb3-a942-4691-a297-23e4f6a28712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:24.817135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd7cb3-a942-4691-a297-23e4f6a28712 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:24.817606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd7cb3-a942-4691-a297-23e4f6a28712 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:24.818049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd7cb3-a942-4691-a297-23e4f6a28712 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:24.819095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd7cb3-a942-4691-a297-23e4f6a28712 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:24.820814 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd7cb3-a942-4691-a297-23e4f6a28712 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:24.824325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: WARNING keystone.server.flask.common [None req-95fd7cb3-a942-4691-a297-23e4f6a28712 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 08 16:00:24.879928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.sql.core [None req-95fd7cb3-a942-4691-a297-23e4f6a28712 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 16:00:24.879928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 16:00:24.879928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [parameters: {'id': '37c194e542e542f0911e31b6bb30ea81', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 16:00:24.879928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81695) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 16:00:24.881999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696f87d-727b-4c42-81c4-16a87b946a23 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-95fd7cb3-a942-4691-a297-23e4f6a28712 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37c194e542e542f0911e31b6bb30ea81.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37c194e542e542f0911e31b6bb30ea81. Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application conn.query(q) Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 16:00:24.901887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result.read() Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 08 16:00:24.902839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application next(self.gen) Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application yield resource Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application next(self.gen) Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise self.value Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application session.commit() Sep 08 16:00:24.903860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.session.flush() Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application compat.raise_( Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 16:00:24.904772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 16:00:24.905780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application conn.query(q) Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result.read() Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 16:00:24.906629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [parameters: {'id': '37c194e542e542f0911e31b6bb30ea81', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:24.909871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:24.917337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:24.923003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:24.923003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 08 16:00:24.923003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 08 16:00:24.923003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:24.923003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:24.923003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 08 16:00:24.923003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 08 16:00:24.923003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37c194e542e542f0911e31b6bb30ea81. Sep 08 16:00:24.923003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:24.923003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 485/957] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Sep 8 16:00:24 2022] POST /identity/v3/projects => generated 262 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:24.924413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:24.924567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd7cb3-a942-4691-a297-23e4f6a28712 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:24.924714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421520e-d198-49ec-9e0e-b26c452a7cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:24.924714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421520e-d198-49ec-9e0e-b26c452a7cd8 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:24.924714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421520e-d198-49ec-9e0e-b26c452a7cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:24.924714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421520e-d198-49ec-9e0e-b26c452a7cd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:24.925363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421520e-d198-49ec-9e0e-b26c452a7cd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:24.925363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421520e-d198-49ec-9e0e-b26c452a7cd8 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:25.003187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 473/958] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:00:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:00:25.039900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd7cb3-a942-4691-a297-23e4f6a28712 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:25.083296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:25.091001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca54b8a-484b-44ac-99e6-f1fdccf6dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:25.091739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca54b8a-484b-44ac-99e6-f1fdccf6dfbe None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:25.092017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca54b8a-484b-44ac-99e6-f1fdccf6dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:25.092285 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca54b8a-484b-44ac-99e6-f1fdccf6dfbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:25.100238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca54b8a-484b-44ac-99e6-f1fdccf6dfbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:25.101933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca54b8a-484b-44ac-99e6-f1fdccf6dfbe None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1ca54b8a-484b-44ac-99e6-f1fdccf6dfbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:25.114168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:25.115283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:25.116249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:25.116249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:25.116249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:25.116249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:25.116249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:25.116249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:25.116249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:25.116249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:25.116249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 486/959] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:25.123567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421520e-d198-49ec-9e0e-b26c452a7cd8 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:25.247289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421520e-d198-49ec-9e0e-b26c452a7cd8 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:25.288860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575572be-3e51-4dd3-be99-80dd9984ae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:25.289930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575572be-3e51-4dd3-be99-80dd9984ae42 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:25.290477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575572be-3e51-4dd3-be99-80dd9984ae42 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:25.291046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575572be-3e51-4dd3-be99-80dd9984ae42 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:25.291980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575572be-3e51-4dd3-be99-80dd9984ae42 None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:25.292487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575572be-3e51-4dd3-be99-80dd9984ae42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:25.294248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575572be-3e51-4dd3-be99-80dd9984ae42 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:25.317184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 474/960] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 16:00:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:25.897033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c5ab-4bd9-43ca-b307-53021fa5b365 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:25.897553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c5ab-4bd9-43ca-b307-53021fa5b365 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:25.897553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3c5ab-4bd9-43ca-b307-53021fa5b365 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:25.899769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 487/961] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:25.904836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b667-ceea-4eb5-8aa5-8404cd234810 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:25.905265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b667-ceea-4eb5-8aa5-8404cd234810 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:25.905411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b667-ceea-4eb5-8aa5-8404cd234810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:25.925501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-9359b667-ceea-4eb5-8aa5-8404cd234810 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:25.926755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9359b667-ceea-4eb5-8aa5-8404cd234810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:25.955292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b46ac-5ab5-421b-9d1d-1e544ee93922 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:25.955600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b46ac-5ab5-421b-9d1d-1e544ee93922 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:25.956658 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b46ac-5ab5-421b-9d1d-1e544ee93922 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:25.957624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 488/962] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:25.963160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614ba47-5ddf-4e3a-a3e7-45d30aa67a5f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:25.963442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614ba47-5ddf-4e3a-a3e7-45d30aa67a5f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:25.963720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614ba47-5ddf-4e3a-a3e7-45d30aa67a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:25.968224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:25.982398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d614ba47-5ddf-4e3a-a3e7-45d30aa67a5f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:25.983967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d614ba47-5ddf-4e3a-a3e7-45d30aa67a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:26.010572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 475/963] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:26.066790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 489/964] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:26.280402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359b667-ceea-4eb5-8aa5-8404cd234810 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:26.330618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614ba47-5ddf-4e3a-a3e7-45d30aa67a5f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:26.402219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359b667-ceea-4eb5-8aa5-8404cd234810 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:26.450325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f312b9-ec18-40f6-8402-112cd4ccc4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:26.451038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f312b9-ec18-40f6-8402-112cd4ccc4a8 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:26.451568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f312b9-ec18-40f6-8402-112cd4ccc4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:26.451845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f312b9-ec18-40f6-8402-112cd4ccc4a8 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:26.452914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f312b9-ec18-40f6-8402-112cd4ccc4a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:26.454603 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f312b9-ec18-40f6-8402-112cd4ccc4a8 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:26.455256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614ba47-5ddf-4e3a-a3e7-45d30aa67a5f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:26.476945 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:26.490431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f02803-4250-4722-9a8d-1ea74c6a2705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:26.491131 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f02803-4250-4722-9a8d-1ea74c6a2705 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:26.491412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f02803-4250-4722-9a8d-1ea74c6a2705 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:26.491684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f02803-4250-4722-9a8d-1ea74c6a2705 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:26.501462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f02803-4250-4722-9a8d-1ea74c6a2705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-46f02803-4250-4722-9a8d-1ea74c6a2705 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:26.508456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:26.509948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:26.515294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 490/965] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Sep 8 16:00:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:26.516784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f02803-4250-4722-9a8d-1ea74c6a2705 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:26.534905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 476/966] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 16:00:26 2022] POST /identity/v3/services => generated 242 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:00:26.640016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f02803-4250-4722-9a8d-1ea74c6a2705 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:26.688173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2008b6-fdc7-4239-9306-48d4813c42fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:26.688799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2008b6-fdc7-4239-9306-48d4813c42fd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:26.689072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2008b6-fdc7-4239-9306-48d4813c42fd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:26.689338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2008b6-fdc7-4239-9306-48d4813c42fd None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:26.690012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2008b6-fdc7-4239-9306-48d4813c42fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:26.690309 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2008b6-fdc7-4239-9306-48d4813c42fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:26.691726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2008b6-fdc7-4239-9306-48d4813c42fd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:26.706969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 491/967] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 8 16:00:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:26.708091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f312b9-ec18-40f6-8402-112cd4ccc4a8 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:26.740954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:26.815171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f312b9-ec18-40f6-8402-112cd4ccc4a8 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:26.850351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0eb023-dade-441b-b70d-2afaf0eb5992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:26.851023 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eb023-dade-441b-b70d-2afaf0eb5992 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:26.851300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eb023-dade-441b-b70d-2afaf0eb5992 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:26.851571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eb023-dade-441b-b70d-2afaf0eb5992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:26.861882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0eb023-dade-441b-b70d-2afaf0eb5992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:26.863383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0eb023-dade-441b-b70d-2afaf0eb5992 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-fe0eb023-dade-441b-b70d-2afaf0eb5992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:26.878995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:26.879996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:26.880921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:26.880921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:26.880921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:26.885357 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 477/968] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:26.886740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2008b6-fdc7-4239-9306-48d4813c42fd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:26.928400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:26.992793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2008b6-fdc7-4239-9306-48d4813c42fd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:27.028101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d3311-26fe-497d-87f7-c8642b52bca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:27.028716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d3311-26fe-497d-87f7-c8642b52bca2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:27.028990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d3311-26fe-497d-87f7-c8642b52bca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:27.029262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d3311-26fe-497d-87f7-c8642b52bca2 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:27.029907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d3311-26fe-497d-87f7-c8642b52bca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:27.030207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d3311-26fe-497d-87f7-c8642b52bca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:27.031601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d3311-26fe-497d-87f7-c8642b52bca2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:27.049005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 492/969] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:27.050364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0eb023-dade-441b-b70d-2afaf0eb5992 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:27.143196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:27.164763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0eb023-dade-441b-b70d-2afaf0eb5992 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:27.201154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087ac1c-2220-4330-95d4-96859850572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:27.201784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087ac1c-2220-4330-95d4-96859850572a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:27.202062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087ac1c-2220-4330-95d4-96859850572a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:27.202334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087ac1c-2220-4330-95d4-96859850572a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:27.209748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087ac1c-2220-4330-95d4-96859850572a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:27.211229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087ac1c-2220-4330-95d4-96859850572a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-2087ac1c-2220-4330-95d4-96859850572a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:27.222815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:27.223792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:27.224734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:27.224734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:27.224734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:27.224734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:27.224734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:27.224734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:27.224734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:27.224734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:27.224734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 16:00:27.224734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:27.229360 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 478/970] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Sep 8 16:00:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:27.230879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d3311-26fe-497d-87f7-c8642b52bca2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:27.259211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656204-863e-4e0c-8c87-9a5a888123a0 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:27.259529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656204-863e-4e0c-8c87-9a5a888123a0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:27.259750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656204-863e-4e0c-8c87-9a5a888123a0 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:27.261315 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 479/971] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:00:27.266103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14032d7-5460-41bd-bdb1-cc6baa553b4a None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:27.266646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14032d7-5460-41bd-bdb1-cc6baa553b4a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:27.266955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14032d7-5460-41bd-bdb1-cc6baa553b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:27.285644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c14032d7-5460-41bd-bdb1-cc6baa553b4a None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:27.286870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c14032d7-5460-41bd-bdb1-cc6baa553b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:27.336641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:27.340478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d3311-26fe-497d-87f7-c8642b52bca2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:27.365216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 480/972] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:27.382331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63955cf-13a3-4d1b-8d3d-9cdae062a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:27.383077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63955cf-13a3-4d1b-8d3d-9cdae062a591 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:27.383404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63955cf-13a3-4d1b-8d3d-9cdae062a591 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:27.383759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63955cf-13a3-4d1b-8d3d-9cdae062a591 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:27.384539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63955cf-13a3-4d1b-8d3d-9cdae062a591 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:27.384840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63955cf-13a3-4d1b-8d3d-9cdae062a591 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:27.386327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63955cf-13a3-4d1b-8d3d-9cdae062a591 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:27.411505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 493/973] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Sep 8 16:00:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:27.411695 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14032d7-5460-41bd-bdb1-cc6baa553b4a None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:27.492248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:27.528145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14032d7-5460-41bd-bdb1-cc6baa553b4a None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:27.565837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af49816-1c35-45bc-9a2d-11c28f618fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:27.566857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af49816-1c35-45bc-9a2d-11c28f618fde None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:27.567344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af49816-1c35-45bc-9a2d-11c28f618fde None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:27.567818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af49816-1c35-45bc-9a2d-11c28f618fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:27.619870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2159a4-338b-49dc-86f0-b28ba1431c39 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:27.620195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2159a4-338b-49dc-86f0-b28ba1431c39 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:27.620422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2159a4-338b-49dc-86f0-b28ba1431c39 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:27.622035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 494/974] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:00:27.627044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02bf58-bb26-4ded-ab35-95ce10b5204a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:27.627330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02bf58-bb26-4ded-ab35-95ce10b5204a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:27.627606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02bf58-bb26-4ded-ab35-95ce10b5204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:27.644366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af49816-1c35-45bc-9a2d-11c28f618fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:27.645657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ff02bf58-bb26-4ded-ab35-95ce10b5204a None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:27.645834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af49816-1c35-45bc-9a2d-11c28f618fde None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:27.646876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ff02bf58-bb26-4ded-ab35-95ce10b5204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:27.719181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:27.726726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 495/975] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:27.726726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02bf58-bb26-4ded-ab35-95ce10b5204a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:27.751157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 481/976] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:00:27 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:27.756516 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af49816-1c35-45bc-9a2d-11c28f618fde None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:27.827864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:27.847215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02bf58-bb26-4ded-ab35-95ce10b5204a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:27.886244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99bf40-0f31-43e2-ac3e-72cd9684a4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:27.886933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99bf40-0f31-43e2-ac3e-72cd9684a4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:27.887205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99bf40-0f31-43e2-ac3e-72cd9684a4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:27.887477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99bf40-0f31-43e2-ac3e-72cd9684a4d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:27.888063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99bf40-0f31-43e2-ac3e-72cd9684a4d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:27.889424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99bf40-0f31-43e2-ac3e-72cd9684a4d4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:27.894648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af49816-1c35-45bc-9a2d-11c28f618fde None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5b99bf40-0f31-43e2-ac3e-72cd9684a4d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:27.900134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:27.906795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:27.907656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 496/977] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Sep 8 16:00:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:27.908476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99bf40-0f31-43e2-ac3e-72cd9684a4d4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:27.945966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87baef-8f71-4ff8-9986-c8a3e86e3d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:27.947194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87baef-8f71-4ff8-9986-c8a3e86e3d63 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:27.947468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87baef-8f71-4ff8-9986-c8a3e86e3d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:27.947985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87baef-8f71-4ff8-9986-c8a3e86e3d63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:27.960833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87baef-8f71-4ff8-9986-c8a3e86e3d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:27.963397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87baef-8f71-4ff8-9986-c8a3e86e3d63 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-2a87baef-8f71-4ff8-9986-c8a3e86e3d63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:27.985558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:27.986562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:27.987532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:27.987532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:27.987532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:27.990747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 482/978] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:27.993285 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87baef-8f71-4ff8-9986-c8a3e86e3d63 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:28.029380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:28.041880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99bf40-0f31-43e2-ac3e-72cd9684a4d4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:28.088182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111d470-99bc-4ab4-9513-4a490bdd59ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:28.089060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111d470-99bc-4ab4-9513-4a490bdd59ae None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.089391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111d470-99bc-4ab4-9513-4a490bdd59ae None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.089660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111d470-99bc-4ab4-9513-4a490bdd59ae None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.090441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111d470-99bc-4ab4-9513-4a490bdd59ae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:28.090770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111d470-99bc-4ab4-9513-4a490bdd59ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:28.092627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111d470-99bc-4ab4-9513-4a490bdd59ae None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:28.103839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 497/979] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Sep 8 16:00:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:28.103839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111d470-99bc-4ab4-9513-4a490bdd59ae None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:28.119652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87baef-8f71-4ff8-9986-c8a3e86e3d63 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:28.120483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:28.157359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e112bd8-728b-4860-99fd-ee21fe452ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:28.158268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e112bd8-728b-4860-99fd-ee21fe452ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.158556 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e112bd8-728b-4860-99fd-ee21fe452ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.158862 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e112bd8-728b-4860-99fd-ee21fe452ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.159512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e112bd8-728b-4860-99fd-ee21fe452ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:28.159824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e112bd8-728b-4860-99fd-ee21fe452ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:28.161646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e112bd8-728b-4860-99fd-ee21fe452ec5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:28.175800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 483/980] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:28.176475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e112bd8-728b-4860-99fd-ee21fe452ec5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:28.218923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111d470-99bc-4ab4-9513-4a490bdd59ae None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:28.258700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74665b12-294b-428c-acce-29984e33a223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:28.259356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74665b12-294b-428c-acce-29984e33a223 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.259628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74665b12-294b-428c-acce-29984e33a223 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.260104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74665b12-294b-428c-acce-29984e33a223 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.260858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74665b12-294b-428c-acce-29984e33a223 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:28.262374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74665b12-294b-428c-acce-29984e33a223 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:28.267583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:28.285489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e112bd8-728b-4860-99fd-ee21fe452ec5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:28.314219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.sql.core [None req-74665b12-294b-428c-acce-29984e33a223 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 16:00:28.314219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 16:00:28.314219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [parameters: {'user_id': 'bd2f0e7d0f654f6ea53f6bd39484210a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 16:00:28.314219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81695) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-74665b12-294b-428c-acce-29984e33a223 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application conn.query(q) Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result.read() Sep 08 16:00:28.322036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 16:00:28.322978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application next(self.gen) Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application yield resource Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application next(self.gen) Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise self.value Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application session.commit() Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 16:00:28.323938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.session.flush() Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application compat.raise_( Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 16:00:28.325186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 16:00:28.326054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application conn.query(q) Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result.read() Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 16:00:28.327021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bd2f0e7d0f654f6ea53f6bd39484210a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:28.327868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 08 16:00:28.330041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 08 16:00:28.332378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 08 16:00:28.332378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 08 16:00:28.332378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 16:00:28.332378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 16:00:28.332378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 16:00:28.332378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:28.332378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 498/981] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Sep 8 16:00:28 2022] POST /identity/v3/users => generated 160 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:28.332378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74665b12-294b-428c-acce-29984e33a223 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:28.333399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ae93d-b6ce-4f20-94b9-59925ab471f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:28.333399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ae93d-b6ce-4f20-94b9-59925ab471f2 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.333399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ae93d-b6ce-4f20-94b9-59925ab471f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.333399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ae93d-b6ce-4f20-94b9-59925ab471f2 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.334274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ae93d-b6ce-4f20-94b9-59925ab471f2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:28.334274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ae93d-b6ce-4f20-94b9-59925ab471f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:28.335688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ae93d-b6ce-4f20-94b9-59925ab471f2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:28.346657 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 484/982] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Sep 8 16:00:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:28.348660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ae93d-b6ce-4f20-94b9-59925ab471f2 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:28.423659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:28.452637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74665b12-294b-428c-acce-29984e33a223 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:28.465914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ae93d-b6ce-4f20-94b9-59925ab471f2 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:28.492542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed8868-19e4-4275-8178-1d355fb96be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:28.493228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed8868-19e4-4275-8178-1d355fb96be0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.493508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed8868-19e4-4275-8178-1d355fb96be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.493775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed8868-19e4-4275-8178-1d355fb96be0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.501293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed8868-19e4-4275-8178-1d355fb96be0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:28.502378 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb48a1-828f-4d2f-b8b5-9292ca3ca897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:28.503051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb48a1-828f-4d2f-b8b5-9292ca3ca897 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.503344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb48a1-828f-4d2f-b8b5-9292ca3ca897 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.503606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb48a1-828f-4d2f-b8b5-9292ca3ca897 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.503766 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed8868-19e4-4275-8178-1d355fb96be0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:28.511364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb48a1-828f-4d2f-b8b5-9292ca3ca897 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:28.512854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb48a1-828f-4d2f-b8b5-9292ca3ca897 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8fed8868-19e4-4275-8178-1d355fb96be0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:28.517059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:28.518116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:28.519294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:28.519294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:28.519294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:28.519294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:28.519294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:28.519294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:28.519294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:28.519294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:28.519995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 499/983] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:28.520839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed8868-19e4-4275-8178-1d355fb96be0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-b3cb48a1-828f-4d2f-b8b5-9292ca3ca897 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:28.531972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:28.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:28.534404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:28.534404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:28.534404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:28.534404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:28.534404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:28.534404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:28.534404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:28.534404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:28.534404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 16:00:28.534404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:28.535055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 485/984] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:00:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:28.535713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb48a1-828f-4d2f-b8b5-9292ca3ca897 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:28.548478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:28.644249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed8868-19e4-4275-8178-1d355fb96be0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:28.652975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb48a1-828f-4d2f-b8b5-9292ca3ca897 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:28.684826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663232fe-9400-4c86-9d7d-fa5111ed347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:28.685554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663232fe-9400-4c86-9d7d-fa5111ed347b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.685829 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663232fe-9400-4c86-9d7d-fa5111ed347b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.686153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663232fe-9400-4c86-9d7d-fa5111ed347b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.686827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663232fe-9400-4c86-9d7d-fa5111ed347b None admin] RBAC: Adding query filter params (interface=admin, service_id=d78fcace97084e8b9b928336054c6134, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:28.687134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663232fe-9400-4c86-9d7d-fa5111ed347b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:28.687380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e08dc-05d4-4fc4-bf0d-242685509626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:28.687990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e08dc-05d4-4fc4-bf0d-242685509626 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.688269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e08dc-05d4-4fc4-bf0d-242685509626 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.688490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663232fe-9400-4c86-9d7d-fa5111ed347b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:28.688595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e08dc-05d4-4fc4-bf0d-242685509626 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.689222 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e08dc-05d4-4fc4-bf0d-242685509626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:28.689617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e08dc-05d4-4fc4-bf0d-242685509626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:28.690987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:28.691161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e08dc-05d4-4fc4-bf0d-242685509626 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:28.698287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 500/985] 10.222.0.23 () {56 vars in 1249 bytes} [Thu Sep 8 16:00:28 2022] GET /identity/v3/endpoints?service_id=d78fcace97084e8b9b928336054c6134&interface=admin®ion_id=RegionOne => generated 193 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:28.698929 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663232fe-9400-4c86-9d7d-fa5111ed347b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:28.705513 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 486/986] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:28.706711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e08dc-05d4-4fc4-bf0d-242685509626 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:28.780219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:28.815581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663232fe-9400-4c86-9d7d-fa5111ed347b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:28.815950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e08dc-05d4-4fc4-bf0d-242685509626 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:28.851193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba145aa2-7214-4b71-95e6-4e573484ad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:28.851803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba145aa2-7214-4b71-95e6-4e573484ad07 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.852076 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba145aa2-7214-4b71-95e6-4e573484ad07 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.852366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba145aa2-7214-4b71-95e6-4e573484ad07 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.853553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba145aa2-7214-4b71-95e6-4e573484ad07 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:28.853879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba145aa2-7214-4b71-95e6-4e573484ad07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:28.854391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7817d2-ecee-4ba4-88c0-16f2282b7f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:28.855200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7817d2-ecee-4ba4-88c0-16f2282b7f9b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.855323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba145aa2-7214-4b71-95e6-4e573484ad07 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:28.855499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7817d2-ecee-4ba4-88c0-16f2282b7f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.855745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7817d2-ecee-4ba4-88c0-16f2282b7f9b None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.856353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7817d2-ecee-4ba4-88c0-16f2282b7f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:28.857709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7817d2-ecee-4ba4-88c0-16f2282b7f9b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:28.875913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 487/987] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Sep 8 16:00:28 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:00:28.875913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7817d2-ecee-4ba4-88c0-16f2282b7f9b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:28.903710 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 501/988] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Sep 8 16:00:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:28.905104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afd71e-77d6-4a20-a0a1-29f7db945458 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.905384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afd71e-77d6-4a20-a0a1-29f7db945458 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.905650 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afd71e-77d6-4a20-a0a1-29f7db945458 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.907001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 502/989] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:28.912932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261875b-45cf-4a6a-9ce1-c30e693fe39c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:28.913288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261875b-45cf-4a6a-9ce1-c30e693fe39c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:28.913703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261875b-45cf-4a6a-9ce1-c30e693fe39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:28.938003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7261875b-45cf-4a6a-9ce1-c30e693fe39c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:28.939693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7261875b-45cf-4a6a-9ce1-c30e693fe39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:29.020688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:29.023223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7817d2-ecee-4ba4-88c0-16f2282b7f9b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:29.052489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 503/990] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:29.067792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:29.074213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741dad1-2bde-4d7b-be69-32a7abac968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:29.075297 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741dad1-2bde-4d7b-be69-32a7abac968b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:29.075733 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741dad1-2bde-4d7b-be69-32a7abac968b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:29.076156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741dad1-2bde-4d7b-be69-32a7abac968b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:29.079389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741dad1-2bde-4d7b-be69-32a7abac968b None admin] RBAC: Adding query filter params (role.id=cd03bc5d3f3f4da982ce0092790c9b47, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=ce22dab95b864b84812335cc050ca2c7) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:29.079389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741dad1-2bde-4d7b-be69-32a7abac968b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:29.079389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741dad1-2bde-4d7b-be69-32a7abac968b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:29.085991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 488/991] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:00:28 2022] GET /identity/v3/role_assignments?user.id=ce22dab95b864b84812335cc050ca2c7&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=cd03bc5d3f3f4da982ce0092790c9b47 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:29.320520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261875b-45cf-4a6a-9ce1-c30e693fe39c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:29.430800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261875b-45cf-4a6a-9ce1-c30e693fe39c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:29.465823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e8765-5d97-4fed-8d1d-06f3f66ecce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:29.466459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e8765-5d97-4fed-8d1d-06f3f66ecce4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:29.466762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e8765-5d97-4fed-8d1d-06f3f66ecce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:29.467034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e8765-5d97-4fed-8d1d-06f3f66ecce4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:29.467611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e8765-5d97-4fed-8d1d-06f3f66ecce4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:29.469052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e8765-5d97-4fed-8d1d-06f3f66ecce4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9b8e8765-5d97-4fed-8d1d-06f3f66ecce4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:29.477961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:29.479253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:29.480117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 504/992] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:29.486870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741dad1-2bde-4d7b-be69-32a7abac968b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:29.591573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741dad1-2bde-4d7b-be69-32a7abac968b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:29.628362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6a8e5-a77f-463c-8a48-35509426d70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:29.628970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a8e5-a77f-463c-8a48-35509426d70c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:29.629244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a8e5-a77f-463c-8a48-35509426d70c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:29.629512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6a8e5-a77f-463c-8a48-35509426d70c None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:29.630137 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6a8e5-a77f-463c-8a48-35509426d70c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:29.630438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6a8e5-a77f-463c-8a48-35509426d70c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:29.631854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6a8e5-a77f-463c-8a48-35509426d70c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:29.637722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 489/993] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 16:00:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:29.643437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e8765-5d97-4fed-8d1d-06f3f66ecce4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:29.698992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:29.746178 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e8765-5d97-4fed-8d1d-06f3f66ecce4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:29.780032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ef142-a5c1-4b2c-ad7b-dff2cd329553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:29.780681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ef142-a5c1-4b2c-ad7b-dff2cd329553 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:29.780960 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ef142-a5c1-4b2c-ad7b-dff2cd329553 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:29.781228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ef142-a5c1-4b2c-ad7b-dff2cd329553 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:29.781845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ef142-a5c1-4b2c-ad7b-dff2cd329553 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:29.782142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ef142-a5c1-4b2c-ad7b-dff2cd329553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:29.783544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ef142-a5c1-4b2c-ad7b-dff2cd329553 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:29.788435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 505/994] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 16:00:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:29.794108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6a8e5-a77f-463c-8a48-35509426d70c None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:29.855368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:29.896725 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6a8e5-a77f-463c-8a48-35509426d70c None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:29.949724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876874c3-07c8-4c6b-aa6e-d1ce734c3e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:29.950497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876874c3-07c8-4c6b-aa6e-d1ce734c3e89 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:29.950907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876874c3-07c8-4c6b-aa6e-d1ce734c3e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:29.951284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876874c3-07c8-4c6b-aa6e-d1ce734c3e89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:29.952077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876874c3-07c8-4c6b-aa6e-d1ce734c3e89 None admin] RBAC: Adding query filter params (interface=public, service_id=8497d062e95c4b45b83ee57947af51a8, region_id=RegionOne) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:29.952511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876874c3-07c8-4c6b-aa6e-d1ce734c3e89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:29.955441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876874c3-07c8-4c6b-aa6e-d1ce734c3e89 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:29.965767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 490/995] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Sep 8 16:00:29 2022] GET /identity/v3/endpoints?service_id=8497d062e95c4b45b83ee57947af51a8&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:29.967764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ef142-a5c1-4b2c-ad7b-dff2cd329553 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:30.068898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ef142-a5c1-4b2c-ad7b-dff2cd329553 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:30.085174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:30.102634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042d20d-32cd-4bbb-bd22-d30448c8437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:30.103239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042d20d-32cd-4bbb-bd22-d30448c8437d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:30.103510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042d20d-32cd-4bbb-bd22-d30448c8437d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:30.103777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042d20d-32cd-4bbb-bd22-d30448c8437d None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:30.104370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042d20d-32cd-4bbb-bd22-d30448c8437d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:30.105763 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042d20d-32cd-4bbb-bd22-d30448c8437d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:30.111931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 506/996] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Sep 8 16:00:29 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:00:31.109415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96958460-9db6-4a38-a2e8-7fd4bb4e099e None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:31.109931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96958460-9db6-4a38-a2e8-7fd4bb4e099e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:31.109931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96958460-9db6-4a38-a2e8-7fd4bb4e099e None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:31.111346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 491/997] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:31.116550 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e29d-326e-4649-ae84-f5e00482c0f2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:31.116918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e29d-326e-4649-ae84-f5e00482c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:31.117101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e29d-326e-4649-ae84-f5e00482c0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:31.135655 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ca04e29d-326e-4649-ae84-f5e00482c0f2 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:31.136834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ca04e29d-326e-4649-ae84-f5e00482c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:31.206501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 507/998] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:31.308084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7abf1-afb8-4714-985c-b5604e744ef1 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:31.308394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7abf1-afb8-4714-985c-b5604e744ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:31.308640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7abf1-afb8-4714-985c-b5604e744ef1 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:31.310096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 492/999] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:31.315162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b2f96-74b6-43b1-af54-dbbf6ef464bb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:31.315445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b2f96-74b6-43b1-af54-dbbf6ef464bb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:31.315714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b2f96-74b6-43b1-af54-dbbf6ef464bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:31.335097 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1c0b2f96-74b6-43b1-af54-dbbf6ef464bb None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:31.336289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1c0b2f96-74b6-43b1-af54-dbbf6ef464bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:31.402474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 508/1000] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:31.472252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7abf1-afb8-4714-985c-b5604e744ef1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:31.571953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7abf1-afb8-4714-985c-b5604e744ef1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:31.595841 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:31.607167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b42c8f-806b-4857-9297-3cc31945cce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:31.607790 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42c8f-806b-4857-9297-3cc31945cce9 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:31.608065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42c8f-806b-4857-9297-3cc31945cce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:31.608334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42c8f-806b-4857-9297-3cc31945cce9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:31.608908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b42c8f-806b-4857-9297-3cc31945cce9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:31.613771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b42c8f-806b-4857-9297-3cc31945cce9 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-25b42c8f-806b-4857-9297-3cc31945cce9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:31.619386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:31.620371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 16:00:31.621220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:31.623029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 493/1001] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Sep 8 16:00:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:31.626451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b2f96-74b6-43b1-af54-dbbf6ef464bb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:31.668848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:31.671559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b42c8f-806b-4857-9297-3cc31945cce9 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:31.729658 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b2f96-74b6-43b1-af54-dbbf6ef464bb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:31.764721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524bf22-c755-4c54-8d47-b3c8d210ed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:31.765651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524bf22-c755-4c54-8d47-b3c8d210ed70 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:31.766107 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524bf22-c755-4c54-8d47-b3c8d210ed70 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:31.766832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524bf22-c755-4c54-8d47-b3c8d210ed70 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:31.767647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524bf22-c755-4c54-8d47-b3c8d210ed70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:31.768124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524bf22-c755-4c54-8d47-b3c8d210ed70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:31.769698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524bf22-c755-4c54-8d47-b3c8d210ed70 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:31.775281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 509/1002] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Sep 8 16:00:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:31.775749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b42c8f-806b-4857-9297-3cc31945cce9 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:31.780905 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524bf22-c755-4c54-8d47-b3c8d210ed70 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:31.815589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc254a31-7311-4a63-a52b-e1255894a66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:31.816220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc254a31-7311-4a63-a52b-e1255894a66f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:31.816498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc254a31-7311-4a63-a52b-e1255894a66f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:31.816824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc254a31-7311-4a63-a52b-e1255894a66f None admin] PATH_INFO: `/v3/services/image` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:31.817353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc254a31-7311-4a63-a52b-e1255894a66f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:31.818747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc254a31-7311-4a63-a52b-e1255894a66f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-fc254a31-7311-4a63-a52b-e1255894a66f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:31.828166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:31.829203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:31.830044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 494/1003] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Sep 8 16:00:31 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:31.835074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc254a31-7311-4a63-a52b-e1255894a66f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:31.892618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524bf22-c755-4c54-8d47-b3c8d210ed70 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:31.895846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:31.897750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:31.929313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b3f1b-3470-4e10-9838-dfaea05e1a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:31.929996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b3f1b-3470-4e10-9838-dfaea05e1a92 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:31.930310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b3f1b-3470-4e10-9838-dfaea05e1a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:31.930487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b3f1b-3470-4e10-9838-dfaea05e1a92 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:31.931156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b3f1b-3470-4e10-9838-dfaea05e1a92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:31.931786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b3f1b-3470-4e10-9838-dfaea05e1a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:31.935907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b3f1b-3470-4e10-9838-dfaea05e1a92 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:31.938971 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 510/1004] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Sep 8 16:00:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:31.944521 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b3f1b-3470-4e10-9838-dfaea05e1a92 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:31.952533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc254a31-7311-4a63-a52b-e1255894a66f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:31.989454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3b28c-c863-438c-81a4-7b7a7f4863c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:31.990064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3b28c-c863-438c-81a4-7b7a7f4863c4 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:31.990349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3b28c-c863-438c-81a4-7b7a7f4863c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:31.990609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3b28c-c863-438c-81a4-7b7a7f4863c4 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:31.991277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3b28c-c863-438c-81a4-7b7a7f4863c4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:31.991583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3b28c-c863-438c-81a4-7b7a7f4863c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:31.992957 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3b28c-c863-438c-81a4-7b7a7f4863c4 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:32.002856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 495/1005] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:32.003774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3b28c-c863-438c-81a4-7b7a7f4863c4 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:32.049578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b3f1b-3470-4e10-9838-dfaea05e1a92 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:32.085414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f23bc-723d-4e0c-ae15-8c80523e3ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:32.086019 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f23bc-723d-4e0c-ae15-8c80523e3ee3 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:32.086304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f23bc-723d-4e0c-ae15-8c80523e3ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:32.086598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f23bc-723d-4e0c-ae15-8c80523e3ee3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:32.087362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f23bc-723d-4e0c-ae15-8c80523e3ee3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:32.088749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f23bc-723d-4e0c-ae15-8c80523e3ee3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:32.120474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3b28c-c863-438c-81a4-7b7a7f4863c4 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:32.137590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:32.155414 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcd19c-a8ea-48dc-a079-e3fb0412fb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:32.156049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd19c-a8ea-48dc-a079-e3fb0412fb6e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:32.156324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd19c-a8ea-48dc-a079-e3fb0412fb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:32.156593 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcd19c-a8ea-48dc-a079-e3fb0412fb6e None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:32.157240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcd19c-a8ea-48dc-a079-e3fb0412fb6e None admin] RBAC: Adding query filter params (type=image) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:32.157541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcd19c-a8ea-48dc-a079-e3fb0412fb6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:32.163177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcd19c-a8ea-48dc-a079-e3fb0412fb6e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:32.163389 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 511/1006] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:00:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:00:32.168187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 496/1007] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:32.290273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7675e1-4fe3-4531-b952-e2d56c7475bb None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:32.290631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7675e1-4fe3-4531-b952-e2d56c7475bb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:32.290862 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7675e1-4fe3-4531-b952-e2d56c7475bb None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:32.292435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 512/1008] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:32.298698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0e943-d118-4a1e-94e6-c37f25efe96f None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:32.299111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0e943-d118-4a1e-94e6-c37f25efe96f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:32.299699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0e943-d118-4a1e-94e6-c37f25efe96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:32.324410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-86c0e943-d118-4a1e-94e6-c37f25efe96f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:32.325649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-86c0e943-d118-4a1e-94e6-c37f25efe96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:32.415976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 497/1009] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:32 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:32.692215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7675e1-4fe3-4531-b952-e2d56c7475bb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:32.722091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:32.800698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7675e1-4fe3-4531-b952-e2d56c7475bb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:32.833777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63808b5e-0eaf-4d4e-9488-0306ff521c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:32.834412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63808b5e-0eaf-4d4e-9488-0306ff521c33 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:32.834713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63808b5e-0eaf-4d4e-9488-0306ff521c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:32.834991 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63808b5e-0eaf-4d4e-9488-0306ff521c33 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:32.835573 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63808b5e-0eaf-4d4e-9488-0306ff521c33 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:32.837585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63808b5e-0eaf-4d4e-9488-0306ff521c33 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-63808b5e-0eaf-4d4e-9488-0306ff521c33 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:32.846545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:32.847582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 16:00:32.848449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:32.851027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 513/1010] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:32.854134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0e943-d118-4a1e-94e6-c37f25efe96f None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:32.956453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0e943-d118-4a1e-94e6-c37f25efe96f None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:32.964271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:32.991668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a07ac-b630-4265-9d84-3cc9ad5df479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:32.992339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a07ac-b630-4265-9d84-3cc9ad5df479 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:32.992688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a07ac-b630-4265-9d84-3cc9ad5df479 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:32.993091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a07ac-b630-4265-9d84-3cc9ad5df479 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:32.993727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a07ac-b630-4265-9d84-3cc9ad5df479 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:32.994033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a07ac-b630-4265-9d84-3cc9ad5df479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:32.995486 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a07ac-b630-4265-9d84-3cc9ad5df479 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:33.005823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 498/1011] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 16:00:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:33.007066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63808b5e-0eaf-4d4e-9488-0306ff521c33 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:33.111032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:33.119880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63808b5e-0eaf-4d4e-9488-0306ff521c33 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:33.153827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8134-af6d-475a-9fe4-40c8d8d53284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:33.154490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8134-af6d-475a-9fe4-40c8d8d53284 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:33.154799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8134-af6d-475a-9fe4-40c8d8d53284 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:33.155073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8134-af6d-475a-9fe4-40c8d8d53284 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:33.155694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8134-af6d-475a-9fe4-40c8d8d53284 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:33.155996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8134-af6d-475a-9fe4-40c8d8d53284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:33.157350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8134-af6d-475a-9fe4-40c8d8d53284 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:33.162234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 514/1012] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Sep 8 16:00:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:33.168560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a07ac-b630-4265-9d84-3cc9ad5df479 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:33.267223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a07ac-b630-4265-9d84-3cc9ad5df479 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:33.300334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202022f-60ff-4350-9914-a752c2575da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:33.300931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202022f-60ff-4350-9914-a752c2575da7 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:33.301211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202022f-60ff-4350-9914-a752c2575da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:33.301484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202022f-60ff-4350-9914-a752c2575da7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:33.302158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202022f-60ff-4350-9914-a752c2575da7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:33.303563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202022f-60ff-4350-9914-a752c2575da7 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:33.381238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 499/1013] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:00:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:00:34.351885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad2c4-2b55-4515-910b-b234e446039b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:34.352957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad2c4-2b55-4515-910b-b234e446039b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:34.353037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad2c4-2b55-4515-910b-b234e446039b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:34.354350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 515/1014] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:34.357915 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230088a8-146d-48da-b2a1-84776bfbaeb3 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:34.358693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230088a8-146d-48da-b2a1-84776bfbaeb3 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:34.358968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230088a8-146d-48da-b2a1-84776bfbaeb3 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:34.359177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1071e6-8831-4010-acce-c94f9f10b9d7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:34.359454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1071e6-8831-4010-acce-c94f9f10b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:34.359723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1071e6-8831-4010-acce-c94f9f10b9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:34.360285 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 500/1015] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:34.365595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a56f0-f6de-4845-922c-ceace2e94354 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:34.365876 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a56f0-f6de-4845-922c-ceace2e94354 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:34.366316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a56f0-f6de-4845-922c-ceace2e94354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:34.379203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1a1071e6-8831-4010-acce-c94f9f10b9d7 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:34.380439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1a1071e6-8831-4010-acce-c94f9f10b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:34.385329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-886a56f0-f6de-4845-922c-ceace2e94354 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:34.386521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-886a56f0-f6de-4845-922c-ceace2e94354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:34.411403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:34.464066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 516/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:34 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:34.469351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 501/1017] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:34 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:34.731944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a56f0-f6de-4845-922c-ceace2e94354 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:34.732144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1071e6-8831-4010-acce-c94f9f10b9d7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:34.818395 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:34.837467 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1071e6-8831-4010-acce-c94f9f10b9d7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:34.838193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a56f0-f6de-4845-922c-ceace2e94354 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:34.872353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b2954-5c09-498b-9688-fb5d66a74d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:34.873244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2954-5c09-498b-9688-fb5d66a74d65 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:34.873666 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2954-5c09-498b-9688-fb5d66a74d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:34.874079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2954-5c09-498b-9688-fb5d66a74d65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:34.875284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b2954-5c09-498b-9688-fb5d66a74d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:34.875415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73f699-54a3-4cd8-86e3-f8e7dcfd1149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:34.876022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f699-54a3-4cd8-86e3-f8e7dcfd1149 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:34.876298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f699-54a3-4cd8-86e3-f8e7dcfd1149 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:34.876573 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f699-54a3-4cd8-86e3-f8e7dcfd1149 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:34.877229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73f699-54a3-4cd8-86e3-f8e7dcfd1149 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:34.877578 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b2954-5c09-498b-9688-fb5d66a74d65 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:34.878572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e73f699-54a3-4cd8-86e3-f8e7dcfd1149 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:34.884548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 502/1018] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:34.885752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b2954-5c09-498b-9688-fb5d66a74d65 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:34.911474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:34.944231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 517/1019] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 16:00:34 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:00:34.991041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b2954-5c09-498b-9688-fb5d66a74d65 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:35.036801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400a8da-8fdc-4eed-896b-80863a00e6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:35.037744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a8da-8fdc-4eed-896b-80863a00e6c1 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:35.038216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a8da-8fdc-4eed-896b-80863a00e6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:35.038844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a8da-8fdc-4eed-896b-80863a00e6c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:35.039762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400a8da-8fdc-4eed-896b-80863a00e6c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:35.041484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400a8da-8fdc-4eed-896b-80863a00e6c1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:35.155992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 503/1020] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 16:00:34 2022] POST /identity/v3/projects => generated 311 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:00:35.650189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96883d7e-68e3-4d35-8a24-47cce6394e65 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:35.650798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96883d7e-68e3-4d35-8a24-47cce6394e65 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:35.650798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96883d7e-68e3-4d35-8a24-47cce6394e65 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:35.652131 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 518/1021] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:35.657537 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71106e-e710-44bc-9ab5-3a698e45c054 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:35.657963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71106e-e710-44bc-9ab5-3a698e45c054 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:35.658087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71106e-e710-44bc-9ab5-3a698e45c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:35.677394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-ec71106e-e710-44bc-9ab5-3a698e45c054 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:35.678514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ec71106e-e710-44bc-9ab5-3a698e45c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:35.746453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 504/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:36.012581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96883d7e-68e3-4d35-8a24-47cce6394e65 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:36.116239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96883d7e-68e3-4d35-8a24-47cce6394e65 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:36.149573 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe4ec8-c0ae-4ed1-b70f-ce28fa565333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:36.150193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe4ec8-c0ae-4ed1-b70f-ce28fa565333 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:36.150464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe4ec8-c0ae-4ed1-b70f-ce28fa565333 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:36.150756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe4ec8-c0ae-4ed1-b70f-ce28fa565333 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:36.160558 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe4ec8-c0ae-4ed1-b70f-ce28fa565333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-43fe4ec8-c0ae-4ed1-b70f-ce28fa565333 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:36.166293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:36.167406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:36.168298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 519/1023] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Sep 8 16:00:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:36.173341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71106e-e710-44bc-9ab5-3a698e45c054 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:36.175630 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:36.272607 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71106e-e710-44bc-9ab5-3a698e45c054 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:36.306164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff0c64-8b47-4d93-9011-20137dbe5b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:36.306795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff0c64-8b47-4d93-9011-20137dbe5b71 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:36.307074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff0c64-8b47-4d93-9011-20137dbe5b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:36.307342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff0c64-8b47-4d93-9011-20137dbe5b71 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:36.307991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff0c64-8b47-4d93-9011-20137dbe5b71 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:36.308287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff0c64-8b47-4d93-9011-20137dbe5b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:36.309659 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff0c64-8b47-4d93-9011-20137dbe5b71 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:36.322705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 505/1024] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 8 16:00:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:36.325130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe4ec8-c0ae-4ed1-b70f-ce28fa565333 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:36.328679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:36.433860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe4ec8-c0ae-4ed1-b70f-ce28fa565333 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:36.469324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75759d59-a257-4162-a1ca-bd03538b5106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:36.469948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75759d59-a257-4162-a1ca-bd03538b5106 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:36.470222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75759d59-a257-4162-a1ca-bd03538b5106 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:36.470490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75759d59-a257-4162-a1ca-bd03538b5106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:36.480553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75759d59-a257-4162-a1ca-bd03538b5106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:36.481981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75759d59-a257-4162-a1ca-bd03538b5106 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-75759d59-a257-4162-a1ca-bd03538b5106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:36.496454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:36.497378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:36.498284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:36.498284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:36.498284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:36.498284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 520/1025] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:36.506699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff0c64-8b47-4d93-9011-20137dbe5b71 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:36.572039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:36.609591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff0c64-8b47-4d93-9011-20137dbe5b71 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:36.644033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a293-6212-4158-85e2-651b9c49d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:36.644635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a293-6212-4158-85e2-651b9c49d49e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:36.644911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a293-6212-4158-85e2-651b9c49d49e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:36.645181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a293-6212-4158-85e2-651b9c49d49e None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:36.645819 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763a293-6212-4158-85e2-651b9c49d49e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:36.646120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763a293-6212-4158-85e2-651b9c49d49e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:36.647554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763a293-6212-4158-85e2-651b9c49d49e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:36.659489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 506/1026] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:36.664904 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75759d59-a257-4162-a1ca-bd03538b5106 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:36.720744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:36.768492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75759d59-a257-4162-a1ca-bd03538b5106 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:36.803256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044b592-722d-4dac-8189-dab796a2f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:36.804229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044b592-722d-4dac-8189-dab796a2f4bd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:36.804703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044b592-722d-4dac-8189-dab796a2f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:36.805690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044b592-722d-4dac-8189-dab796a2f4bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:36.813484 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044b592-722d-4dac-8189-dab796a2f4bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:36.815164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044b592-722d-4dac-8189-dab796a2f4bd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c044b592-722d-4dac-8189-dab796a2f4bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:36.827260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:36.828227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:36.829156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:36.829156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:36.829156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:36.829156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:36.829156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:36.829156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:36.829156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:36.829156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:36.829156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 16:00:36.829156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:36.830653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 521/1027] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Sep 8 16:00:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:36.836189 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a293-6212-4158-85e2-651b9c49d49e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:36.938416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a293-6212-4158-85e2-651b9c49d49e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:36.961622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:36.972477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e28d89-bf31-4fee-888a-2d793a20c7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:36.973086 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28d89-bf31-4fee-888a-2d793a20c7be None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:36.973365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28d89-bf31-4fee-888a-2d793a20c7be None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:36.973637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e28d89-bf31-4fee-888a-2d793a20c7be None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:36.974374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e28d89-bf31-4fee-888a-2d793a20c7be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:36.974695 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e28d89-bf31-4fee-888a-2d793a20c7be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:36.976175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e28d89-bf31-4fee-888a-2d793a20c7be None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:36.995117 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 507/1028] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 8 16:00:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:37.000551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044b592-722d-4dac-8189-dab796a2f4bd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:37.104906 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044b592-722d-4dac-8189-dab796a2f4bd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:37.118860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:37.138512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf7e7c-9138-48f6-970f-60b28f7899b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:37.139174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7e7c-9138-48f6-970f-60b28f7899b2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.139448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7e7c-9138-48f6-970f-60b28f7899b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.139718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf7e7c-9138-48f6-970f-60b28f7899b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.167785 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2affa-c163-40e9-aa5b-b11be59778b4 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.168123 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2affa-c163-40e9-aa5b-b11be59778b4 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.168355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2affa-c163-40e9-aa5b-b11be59778b4 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.169675 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 508/1029] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:37.174680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc01a3-b38f-400f-ba3e-cc26e3b26f7a None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.174983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc01a3-b38f-400f-ba3e-cc26e3b26f7a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.175261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc01a3-b38f-400f-ba3e-cc26e3b26f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.194000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-71dc01a3-b38f-400f-ba3e-cc26e3b26f7a None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:37.195237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-71dc01a3-b38f-400f-ba3e-cc26e3b26f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:37.209106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf7e7c-9138-48f6-970f-60b28f7899b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:37.210552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf7e7c-9138-48f6-970f-60b28f7899b2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:37.269754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 509/1030] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:37.328088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 522/1031] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:00:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:37.329614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc01a3-b38f-400f-ba3e-cc26e3b26f7a None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:37.356962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc044d5-906f-4670-af05-8255ee6b9477 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.357142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc044d5-906f-4670-af05-8255ee6b9477 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.357427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc044d5-906f-4670-af05-8255ee6b9477 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.358895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 523/1032] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:37.364072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba3215-c3ea-4504-83db-1979e0a52adb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.364350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba3215-c3ea-4504-83db-1979e0a52adb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.364626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba3215-c3ea-4504-83db-1979e0a52adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.382911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-78ba3215-c3ea-4504-83db-1979e0a52adb None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:37.384269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-78ba3215-c3ea-4504-83db-1979e0a52adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:37.394307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:37.449025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc01a3-b38f-400f-ba3e-cc26e3b26f7a None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:37.460796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 524/1033] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:37.463517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:37.484244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7dae9-78b8-48c5-98e7-e2c530876cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:37.485293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7dae9-78b8-48c5-98e7-e2c530876cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.486013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7dae9-78b8-48c5-98e7-e2c530876cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.486777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7dae9-78b8-48c5-98e7-e2c530876cb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.496860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7dae9-78b8-48c5-98e7-e2c530876cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:37.498295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7dae9-78b8-48c5-98e7-e2c530876cb0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-69c7dae9-78b8-48c5-98e7-e2c530876cb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:37.512676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:37.513625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:37.519546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:37.519546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:37.519546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:37.519546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 510/1034] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:37.519833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba3215-c3ea-4504-83db-1979e0a52adb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:37.534696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7dae9-78b8-48c5-98e7-e2c530876cb0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:37.627531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba3215-c3ea-4504-83db-1979e0a52adb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:37.638241 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7dae9-78b8-48c5-98e7-e2c530876cb0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:37.665186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35689eb9-3aa9-4b4b-abb9-e93692a02196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:37.665790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689eb9-3aa9-4b4b-abb9-e93692a02196 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.666060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689eb9-3aa9-4b4b-abb9-e93692a02196 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.666326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689eb9-3aa9-4b4b-abb9-e93692a02196 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.666986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35689eb9-3aa9-4b4b-abb9-e93692a02196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:37.667278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35689eb9-3aa9-4b4b-abb9-e93692a02196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:37.668626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35689eb9-3aa9-4b4b-abb9-e93692a02196 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:37.674269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14e70-2947-446d-8073-13899326b20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:37.675437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14e70-2947-446d-8073-13899326b20a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.675889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14e70-2947-446d-8073-13899326b20a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.676330 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14e70-2947-446d-8073-13899326b20a None admin] PATH_INFO: `/v3/services/image` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.677089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a14e70-2947-446d-8073-13899326b20a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:37.678440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a14e70-2947-446d-8073-13899326b20a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:37.684844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 525/1035] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:37.685784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35689eb9-3aa9-4b4b-abb9-e93692a02196 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:37.689999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-61a14e70-2947-446d-8073-13899326b20a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:37.692036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:37.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:37.693867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 511/1036] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Sep 8 16:00:37 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:37.701418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14e70-2947-446d-8073-13899326b20a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:37.730609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:37.792377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35689eb9-3aa9-4b4b-abb9-e93692a02196 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:37.799339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14e70-2947-446d-8073-13899326b20a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:37.825007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef0748-950f-4438-acd9-b9da6469ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:37.825634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef0748-950f-4438-acd9-b9da6469ade1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.825911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef0748-950f-4438-acd9-b9da6469ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.826180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef0748-950f-4438-acd9-b9da6469ade1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.831829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a891-8177-4a3a-87b3-5b52c6e17151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:37.832424 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a891-8177-4a3a-87b3-5b52c6e17151 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.832696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a891-8177-4a3a-87b3-5b52c6e17151 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.832870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef0748-950f-4438-acd9-b9da6469ade1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:37.832972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a891-8177-4a3a-87b3-5b52c6e17151 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.833574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94a891-8177-4a3a-87b3-5b52c6e17151 None admin] RBAC: Adding query filter params (name=image) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:37.833872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94a891-8177-4a3a-87b3-5b52c6e17151 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:37.834299 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef0748-950f-4438-acd9-b9da6469ade1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:37.835248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94a891-8177-4a3a-87b3-5b52c6e17151 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:37.840471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 512/1037] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:37.841231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a891-8177-4a3a-87b3-5b52c6e17151 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5aef0748-950f-4438-acd9-b9da6469ade1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:37.846458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:37.847369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:37.848279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:37.848279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:37.848279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:37.848279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:37.848279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:37.848279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:37.848279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:37.848279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:37.848279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 526/1038] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:37.848776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef0748-950f-4438-acd9-b9da6469ade1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:37.910182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:37.934213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:37.943108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a891-8177-4a3a-87b3-5b52c6e17151 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:37.947129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef0748-950f-4438-acd9-b9da6469ade1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:37.977281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ae38-af71-4a2a-bf09-982f15e34dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:37.977904 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ae38-af71-4a2a-bf09-982f15e34dee None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.978217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ae38-af71-4a2a-bf09-982f15e34dee None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.978442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998ae38-af71-4a2a-bf09-982f15e34dee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.979561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998ae38-af71-4a2a-bf09-982f15e34dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:37.979752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12370ba2-eae6-41c0-9b11-c37c38b12c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:37.980346 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370ba2-eae6-41c0-9b11-c37c38b12c52 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:37.980620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370ba2-eae6-41c0-9b11-c37c38b12c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:37.980889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370ba2-eae6-41c0-9b11-c37c38b12c52 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:37.980989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998ae38-af71-4a2a-bf09-982f15e34dee None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:37.981505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12370ba2-eae6-41c0-9b11-c37c38b12c52 None admin] RBAC: Adding query filter params (type=image) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:37.981800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12370ba2-eae6-41c0-9b11-c37c38b12c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:37.982526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 513/1039] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:37.983191 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12370ba2-eae6-41c0-9b11-c37c38b12c52 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:37.983303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ae38-af71-4a2a-bf09-982f15e34dee None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:37.992816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 527/1040] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:37.992816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12370ba2-eae6-41c0-9b11-c37c38b12c52 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:38.085258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998ae38-af71-4a2a-bf09-982f15e34dee None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:38.086719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12370ba2-eae6-41c0-9b11-c37c38b12c52 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:38.111678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:38.118382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299a35f-b0a1-4171-85ba-1d62b89e0974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:38.119001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299a35f-b0a1-4171-85ba-1d62b89e0974 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:38.119176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676154f-0b2b-4792-8dd3-c25b8283338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:38.119306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299a35f-b0a1-4171-85ba-1d62b89e0974 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:38.119572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299a35f-b0a1-4171-85ba-1d62b89e0974 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:38.119765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676154f-0b2b-4792-8dd3-c25b8283338e None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:38.120036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676154f-0b2b-4792-8dd3-c25b8283338e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:38.120245 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299a35f-b0a1-4171-85ba-1d62b89e0974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:38.120333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676154f-0b2b-4792-8dd3-c25b8283338e None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:38.120548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299a35f-b0a1-4171-85ba-1d62b89e0974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:38.120953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676154f-0b2b-4792-8dd3-c25b8283338e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:38.121975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299a35f-b0a1-4171-85ba-1d62b89e0974 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:38.122344 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676154f-0b2b-4792-8dd3-c25b8283338e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:38.133192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 514/1041] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:38.133980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299a35f-b0a1-4171-85ba-1d62b89e0974 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:38.156215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:38.214708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 528/1042] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 16:00:37 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:00:38.214708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676154f-0b2b-4792-8dd3-c25b8283338e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:38.236928 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299a35f-b0a1-4171-85ba-1d62b89e0974 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:38.282061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631b17-b33d-4ca9-87cb-3180f11fa6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:38.282830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631b17-b33d-4ca9-87cb-3180f11fa6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:38.283155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631b17-b33d-4ca9-87cb-3180f11fa6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:38.283478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3631b17-b33d-4ca9-87cb-3180f11fa6d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:38.284197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3631b17-b33d-4ca9-87cb-3180f11fa6d8 None admin] RBAC: Adding query filter params (interface=public, service_id=43d726ef2d0945ff8d856c819038c95f, region_id=RegionOne) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:38.284623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3631b17-b33d-4ca9-87cb-3180f11fa6d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:38.286193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3631b17-b33d-4ca9-87cb-3180f11fa6d8 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:38.293261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 515/1043] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Sep 8 16:00:38 2022] GET /identity/v3/endpoints?service_id=43d726ef2d0945ff8d856c819038c95f&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:38.298932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631b17-b33d-4ca9-87cb-3180f11fa6d8 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:38.323950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676154f-0b2b-4792-8dd3-c25b8283338e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:38.368398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2bc5f-4e6e-4650-82c9-1858dc43a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:38.369162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2bc5f-4e6e-4650-82c9-1858dc43a2dd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:38.369434 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2bc5f-4e6e-4650-82c9-1858dc43a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:38.369696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2bc5f-4e6e-4650-82c9-1858dc43a2dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:38.370418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2bc5f-4e6e-4650-82c9-1858dc43a2dd None admin] RBAC: Adding query filter params (role.id=cd03bc5d3f3f4da982ce0092790c9b47, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=41f7a6292d004a648c3c92526d1304ec) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:38.370748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2bc5f-4e6e-4650-82c9-1858dc43a2dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:38.372181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2bc5f-4e6e-4650-82c9-1858dc43a2dd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:38.379399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 529/1044] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:00:38 2022] GET /identity/v3/role_assignments?user.id=41f7a6292d004a648c3c92526d1304ec&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=cd03bc5d3f3f4da982ce0092790c9b47 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:38.393317 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:38.416590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3631b17-b33d-4ca9-87cb-3180f11fa6d8 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:38.458604 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73f4c8-4ab9-4834-a89d-3534b79f8a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:38.459383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f4c8-4ab9-4834-a89d-3534b79f8a9b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:38.459716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f4c8-4ab9-4834-a89d-3534b79f8a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:38.459995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73f4c8-4ab9-4834-a89d-3534b79f8a9b None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:38.460612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73f4c8-4ab9-4834-a89d-3534b79f8a9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:38.462580 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73f4c8-4ab9-4834-a89d-3534b79f8a9b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:38.470906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 516/1045] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Sep 8 16:00:38 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:00:40.422804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7742b-9828-42d5-971c-a877ab1be96b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:40.423357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7742b-9828-42d5-971c-a877ab1be96b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:40.423357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7742b-9828-42d5-971c-a877ab1be96b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:40.424979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 530/1046] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:40.431157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6fda-29d7-4810-ab7a-f1207fc8bde7 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:40.431656 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6fda-29d7-4810-ab7a-f1207fc8bde7 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:40.431741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd6fda-29d7-4810-ab7a-f1207fc8bde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:40.451162 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-68cd6fda-29d7-4810-ab7a-f1207fc8bde7 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:40.452354 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-68cd6fda-29d7-4810-ab7a-f1207fc8bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:40.521096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf2824-c372-4d2a-9549-8d7abb693da0 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:40.521365 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf2824-c372-4d2a-9549-8d7abb693da0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:40.521632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf2824-c372-4d2a-9549-8d7abb693da0 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:40.523211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 531/1047] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:00:40.525004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 517/1048] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:40.528711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672d748-385e-4fcc-bb1b-f71590f1b0df None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:40.528997 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672d748-385e-4fcc-bb1b-f71590f1b0df None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:40.529267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672d748-385e-4fcc-bb1b-f71590f1b0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:40.548492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4672d748-385e-4fcc-bb1b-f71590f1b0df None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:40.549696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4672d748-385e-4fcc-bb1b-f71590f1b0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:40.594641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:40.618809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 532/1049] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:40.636954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943a9de-c53b-4b36-870c-953ca27d7bd3 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:40.637499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943a9de-c53b-4b36-870c-953ca27d7bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:40.637900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943a9de-c53b-4b36-870c-953ca27d7bd3 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:40.639430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 518/1050] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:40.644831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e075-1019-4c32-961e-6d1153ce1eb0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:40.645223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e075-1019-4c32-961e-6d1153ce1eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:40.645450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e075-1019-4c32-961e-6d1153ce1eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:40.662979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9a23e075-1019-4c32-961e-6d1153ce1eb0 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:40.664696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9a23e075-1019-4c32-961e-6d1153ce1eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:40.734835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 533/1051] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:40.799521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943a9de-c53b-4b36-870c-953ca27d7bd3 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:40.880853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:40.893444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23e075-1019-4c32-961e-6d1153ce1eb0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:40.903561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943a9de-c53b-4b36-870c-953ca27d7bd3 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:40.940082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6363f6c-096b-490c-965d-d74691963f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:40.940767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6363f6c-096b-490c-965d-d74691963f08 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:40.940984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6363f6c-096b-490c-965d-d74691963f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:40.941252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6363f6c-096b-490c-965d-d74691963f08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:40.951357 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6363f6c-096b-490c-965d-d74691963f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-f6363f6c-096b-490c-965d-d74691963f08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:40.956081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:40.957225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:40.958179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 519/1052] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:40.962982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6363f6c-096b-490c-965d-d74691963f08 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:41.001972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23e075-1019-4c32-961e-6d1153ce1eb0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.011546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:41.037336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9051a5-d103-49bd-b5af-7127ae9f07dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:41.038265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9051a5-d103-49bd-b5af-7127ae9f07dc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:41.038789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9051a5-d103-49bd-b5af-7127ae9f07dc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:41.039793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9051a5-d103-49bd-b5af-7127ae9f07dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:41.050719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9051a5-d103-49bd-b5af-7127ae9f07dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-dd9051a5-d103-49bd-b5af-7127ae9f07dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:41.055702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:41.057577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 534/1053] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Sep 8 16:00:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:41.058445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9051a5-d103-49bd-b5af-7127ae9f07dc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:41.071709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6363f6c-096b-490c-965d-d74691963f08 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.107319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a8b8-fe45-4d86-8fa9-a042efa2ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:41.108334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a8b8-fe45-4d86-8fa9-a042efa2ef37 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:41.108770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a8b8-fe45-4d86-8fa9-a042efa2ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:41.109053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320a8b8-fe45-4d86-8fa9-a042efa2ef37 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:41.109954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a8b8-fe45-4d86-8fa9-a042efa2ef37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:41.110422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a8b8-fe45-4d86-8fa9-a042efa2ef37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:41.112136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320a8b8-fe45-4d86-8fa9-a042efa2ef37 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:41.117949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:41.121234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 520/1054] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:41.122018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a8b8-fe45-4d86-8fa9-a042efa2ef37 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:41.159435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9051a5-d103-49bd-b5af-7127ae9f07dc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.193803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1555f4-b620-4e6d-bd34-bec8cc807295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:41.194425 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1555f4-b620-4e6d-bd34-bec8cc807295 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:41.194736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1555f4-b620-4e6d-bd34-bec8cc807295 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:41.195004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1555f4-b620-4e6d-bd34-bec8cc807295 None admin] PATH_INFO: `/v3/services/image` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:41.195604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1555f4-b620-4e6d-bd34-bec8cc807295 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:41.196967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1555f4-b620-4e6d-bd34-bec8cc807295 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ed1555f4-b620-4e6d-bd34-bec8cc807295 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:41.205772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:41.206816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:41.207788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 535/1055] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Sep 8 16:00:41 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:41.208591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1555f4-b620-4e6d-bd34-bec8cc807295 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:41.227328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320a8b8-fe45-4d86-8fa9-a042efa2ef37 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.258382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:41.259433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fc5c4-757b-427f-8edb-34e0e3d58d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:41.260035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fc5c4-757b-427f-8edb-34e0e3d58d46 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:41.260310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fc5c4-757b-427f-8edb-34e0e3d58d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:41.260700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fc5c4-757b-427f-8edb-34e0e3d58d46 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:41.261228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fc5c4-757b-427f-8edb-34e0e3d58d46 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:41.261527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fc5c4-757b-427f-8edb-34e0e3d58d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:41.262922 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fc5c4-757b-427f-8edb-34e0e3d58d46 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:41.270879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 521/1056] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 8 16:00:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:41.271666 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fc5c4-757b-427f-8edb-34e0e3d58d46 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:41.330656 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:41.345942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1555f4-b620-4e6d-bd34-bec8cc807295 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.369127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fc5c4-757b-427f-8edb-34e0e3d58d46 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.380600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76fed4-c21d-4199-b469-1d5584cb164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:41.381228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76fed4-c21d-4199-b469-1d5584cb164e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:41.381506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76fed4-c21d-4199-b469-1d5584cb164e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:41.381775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76fed4-c21d-4199-b469-1d5584cb164e None admin] PATH_INFO: `/v3/users/e58ead21f78a48cb86f2417d74ce3934` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:41.402104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76fed4-c21d-4199-b469-1d5584cb164e None admin] RBAC: Authorizing `identity:get_user(user_id=e58ead21f78a48cb86f2417d74ce3934)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:41.403603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76fed4-c21d-4199-b469-1d5584cb164e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:41.405067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b324acd-7d4d-4dd5-8809-12ce0701f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:41.405341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 536/1057] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:00:41 2022] GET /identity/v3/users/e58ead21f78a48cb86f2417d74ce3934 => generated 285 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:41.405681 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b324acd-7d4d-4dd5-8809-12ce0701f7dd None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:41.405961 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b324acd-7d4d-4dd5-8809-12ce0701f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:41.406111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76fed4-c21d-4199-b469-1d5584cb164e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:41.406206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b324acd-7d4d-4dd5-8809-12ce0701f7dd None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:41.406870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b324acd-7d4d-4dd5-8809-12ce0701f7dd None admin] RBAC: Adding query filter params (name=image) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:41.407169 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b324acd-7d4d-4dd5-8809-12ce0701f7dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:41.408518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b324acd-7d4d-4dd5-8809-12ce0701f7dd None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:41.418961 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 522/1058] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:41.418961 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b324acd-7d4d-4dd5-8809-12ce0701f7dd None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:41.499400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:41.509278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76fed4-c21d-4199-b469-1d5584cb164e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.516834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b324acd-7d4d-4dd5-8809-12ce0701f7dd None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.542215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:41.544237 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4106f4-9254-4df5-9a86-fe6986da047c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:41.544863 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4106f4-9254-4df5-9a86-fe6986da047c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:41.545137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4106f4-9254-4df5-9a86-fe6986da047c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:41.545406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4106f4-9254-4df5-9a86-fe6986da047c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:41.550968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78064ebd-08fb-4422-8840-dce009634694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:41.551569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78064ebd-08fb-4422-8840-dce009634694 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:41.557718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78064ebd-08fb-4422-8840-dce009634694 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:41.557718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78064ebd-08fb-4422-8840-dce009634694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:41.557935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4106f4-9254-4df5-9a86-fe6986da047c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:41.557935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4106f4-9254-4df5-9a86-fe6986da047c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-7c4106f4-9254-4df5-9a86-fe6986da047c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:41.572266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:41.573336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:41.574260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:41.574260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:41.574260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:41.574260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 537/1059] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:41.574488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4106f4-9254-4df5-9a86-fe6986da047c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:41.622283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78064ebd-08fb-4422-8840-dce009634694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:41.623770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78064ebd-08fb-4422-8840-dce009634694 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:41.674742 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4106f4-9254-4df5-9a86-fe6986da047c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.708152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10dfe-1494-4794-be06-e1e668472920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:41.708753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10dfe-1494-4794-be06-e1e668472920 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:41.709036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10dfe-1494-4794-be06-e1e668472920 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:41.709305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10dfe-1494-4794-be06-e1e668472920 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:41.709925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10dfe-1494-4794-be06-e1e668472920 None admin] RBAC: Adding query filter params (type=image) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:41.710223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10dfe-1494-4794-be06-e1e668472920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:41.712157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10dfe-1494-4794-be06-e1e668472920 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:41.716934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 538/1060] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:41.717700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10dfe-1494-4794-be06-e1e668472920 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:41.723710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 523/1061] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:00:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:41.723710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78064ebd-08fb-4422-8840-dce009634694 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:41.730466 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:41.749418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:41.820964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10dfe-1494-4794-be06-e1e668472920 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.821159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78064ebd-08fb-4422-8840-dce009634694 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.853012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d558b-8530-4391-bae7-d24228379785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:41.853170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e5fdb-5f7f-45ce-b720-162fb072bcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:41.853615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d558b-8530-4391-bae7-d24228379785 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:41.853731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5fdb-5f7f-45ce-b720-162fb072bcd1 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:41.853893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d558b-8530-4391-bae7-d24228379785 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:41.853986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5fdb-5f7f-45ce-b720-162fb072bcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:41.854165 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d558b-8530-4391-bae7-d24228379785 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:41.854255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5fdb-5f7f-45ce-b720-162fb072bcd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:41.854828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d558b-8530-4391-bae7-d24228379785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:41.854924 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e5fdb-5f7f-45ce-b720-162fb072bcd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:41.855133 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d558b-8530-4391-bae7-d24228379785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:41.856282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e5fdb-5f7f-45ce-b720-162fb072bcd1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:41.856471 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d558b-8530-4391-bae7-d24228379785 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:41.868852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 539/1062] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:41.869483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d558b-8530-4391-bae7-d24228379785 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:41.931787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:41.964169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d558b-8530-4391-bae7-d24228379785 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:41.971340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 524/1063] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:00:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:00:41.972170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e5fdb-5f7f-45ce-b720-162fb072bcd1 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:42.014529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919b7d1-4dd7-4963-b460-dbc0712ccf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:42.015402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919b7d1-4dd7-4963-b460-dbc0712ccf86 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:42.015860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919b7d1-4dd7-4963-b460-dbc0712ccf86 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:42.016407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919b7d1-4dd7-4963-b460-dbc0712ccf86 None admin] PATH_INFO: `/v3/projects/6bfe3a8664fe4b538887931416925651` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:42.017568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919b7d1-4dd7-4963-b460-dbc0712ccf86 None admin] RBAC: Authorizing `identity:get_project(project_id=6bfe3a8664fe4b538887931416925651)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:42.019228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919b7d1-4dd7-4963-b460-dbc0712ccf86 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:42.020953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 540/1064] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:00:41 2022] GET /identity/v3/projects/6bfe3a8664fe4b538887931416925651 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:42.027669 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919b7d1-4dd7-4963-b460-dbc0712ccf86 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:42.076808 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:42.097353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e5fdb-5f7f-45ce-b720-162fb072bcd1 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:42.139644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc3276-38e3-439a-bdfb-98e4594ba010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:42.140414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919b7d1-4dd7-4963-b460-dbc0712ccf86 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:42.140533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc3276-38e3-439a-bdfb-98e4594ba010 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:42.140694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc3276-38e3-439a-bdfb-98e4594ba010 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:42.140982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc3276-38e3-439a-bdfb-98e4594ba010 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:42.150952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc3276-38e3-439a-bdfb-98e4594ba010 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:42.152517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc3276-38e3-439a-bdfb-98e4594ba010 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-79dc3276-38e3-439a-bdfb-98e4594ba010 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:42.165671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:42.166884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:42.167926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:42.167926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:42.167926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:42.167926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:42.167926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:42.167926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:42.167926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:42.167926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:42.167926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 16:00:42.167926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:42.167926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 525/1065] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Sep 8 16:00:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:42.172558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc3276-38e3-439a-bdfb-98e4594ba010 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:42.176787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:42.184177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50f7f3-b6f6-4f27-a2da-2376aa381192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:42.185350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50f7f3-b6f6-4f27-a2da-2376aa381192 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:42.185808 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50f7f3-b6f6-4f27-a2da-2376aa381192 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:42.186553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50f7f3-b6f6-4f27-a2da-2376aa381192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:42.191062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50f7f3-b6f6-4f27-a2da-2376aa381192 None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=6bfe3a8664fe4b538887931416925651, user.id=e58ead21f78a48cb86f2417d74ce3934) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:42.191062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50f7f3-b6f6-4f27-a2da-2376aa381192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:42.191062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50f7f3-b6f6-4f27-a2da-2376aa381192 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:42.196201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 541/1066] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:00:42 2022] GET /identity/v3/role_assignments?user.id=e58ead21f78a48cb86f2417d74ce3934&scope.project.id=6bfe3a8664fe4b538887931416925651&role.id=519b356d36364663a59265dc7eeff0b8 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:42.285256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc3276-38e3-439a-bdfb-98e4594ba010 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:42.322521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b02cc-4ea4-4cf3-a272-11f5a9696974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:42.323436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b02cc-4ea4-4cf3-a272-11f5a9696974 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:42.323864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b02cc-4ea4-4cf3-a272-11f5a9696974 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:42.324312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b02cc-4ea4-4cf3-a272-11f5a9696974 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:42.325232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b02cc-4ea4-4cf3-a272-11f5a9696974 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:42.325694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b02cc-4ea4-4cf3-a272-11f5a9696974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:42.327392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b02cc-4ea4-4cf3-a272-11f5a9696974 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:42.344359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:42.354170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 526/1067] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 8 16:00:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:42.355611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50f7f3-b6f6-4f27-a2da-2376aa381192 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:42.467415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50f7f3-b6f6-4f27-a2da-2376aa381192 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:42.504163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be70a5e-d4cc-44ad-80df-f401f34e3c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:42.504823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be70a5e-d4cc-44ad-80df-f401f34e3c12 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:42.505055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be70a5e-d4cc-44ad-80df-f401f34e3c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:42.505323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be70a5e-d4cc-44ad-80df-f401f34e3c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:42.516612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be70a5e-d4cc-44ad-80df-f401f34e3c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:42.518046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be70a5e-d4cc-44ad-80df-f401f34e3c12 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1be70a5e-d4cc-44ad-80df-f401f34e3c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:42.532668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:42.533840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:42.534894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:42.534894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:42.534894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:42.534894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 542/1068] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:42.540067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b02cc-4ea4-4cf3-a272-11f5a9696974 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:42.638408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b02cc-4ea4-4cf3-a272-11f5a9696974 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:42.674801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b375c9c-d4a5-4b7f-9048-e6dd9dfc17d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:42.675511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b375c9c-d4a5-4b7f-9048-e6dd9dfc17d1 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:42.675793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b375c9c-d4a5-4b7f-9048-e6dd9dfc17d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:42.676062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b375c9c-d4a5-4b7f-9048-e6dd9dfc17d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:42.676699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b375c9c-d4a5-4b7f-9048-e6dd9dfc17d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:42.676999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b375c9c-d4a5-4b7f-9048-e6dd9dfc17d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:42.678360 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b375c9c-d4a5-4b7f-9048-e6dd9dfc17d1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:42.690832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 527/1069] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:42.695607 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be70a5e-d4cc-44ad-80df-f401f34e3c12 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:42.745446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:42.808483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be70a5e-d4cc-44ad-80df-f401f34e3c12 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:42.843330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0153745-bf19-46e0-9efc-b53300720f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:42.843959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0153745-bf19-46e0-9efc-b53300720f18 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:42.844235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0153745-bf19-46e0-9efc-b53300720f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:42.844503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0153745-bf19-46e0-9efc-b53300720f18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:42.851241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0153745-bf19-46e0-9efc-b53300720f18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:42.853324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0153745-bf19-46e0-9efc-b53300720f18 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c0153745-bf19-46e0-9efc-b53300720f18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:42.864574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:42.865463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:42.866387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:42.866387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:42.866387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:42.866387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:42.866387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:42.866387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:42.866387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:42.866387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:42.866387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 543/1070] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:42.872784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b375c9c-d4a5-4b7f-9048-e6dd9dfc17d1 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:42.937381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:42.979968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b375c9c-d4a5-4b7f-9048-e6dd9dfc17d1 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:43.013433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ba035-0f54-488e-bea7-335218e43171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:43.014041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ba035-0f54-488e-bea7-335218e43171 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:43.014321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ba035-0f54-488e-bea7-335218e43171 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:43.014597 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ba035-0f54-488e-bea7-335218e43171 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:43.015312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ba035-0f54-488e-bea7-335218e43171 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:43.015621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ba035-0f54-488e-bea7-335218e43171 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:43.017311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ba035-0f54-488e-bea7-335218e43171 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:43.034615 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 528/1071] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:43.035858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0153745-bf19-46e0-9efc-b53300720f18 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:43.144738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0153745-bf19-46e0-9efc-b53300720f18 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:43.152330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:43.178790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5193173-d136-4b9b-bfdf-2ce670bdab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:43.179469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193173-d136-4b9b-bfdf-2ce670bdab33 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:43.179753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193173-d136-4b9b-bfdf-2ce670bdab33 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:43.180027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193173-d136-4b9b-bfdf-2ce670bdab33 None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/41f7a6292d004a648c3c92526d1304ec/roles/cd03bc5d3f3f4da982ce0092790c9b47` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:43.182564 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5193173-d136-4b9b-bfdf-2ce670bdab33 None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=41f7a6292d004a648c3c92526d1304ec, role_id=cd03bc5d3f3f4da982ce0092790c9b47)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:43.184192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5193173-d136-4b9b-bfdf-2ce670bdab33 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:43.244764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 544/1072] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 16:00:43 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/41f7a6292d004a648c3c92526d1304ec/roles/cd03bc5d3f3f4da982ce0092790c9b47 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:00:44.210563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0cc2-399e-472b-ad8e-a5d0d3f3f281 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:44.211631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0cc2-399e-472b-ad8e-a5d0d3f3f281 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:44.211743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0cc2-399e-472b-ad8e-a5d0d3f3f281 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:44.213035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 529/1073] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:44.218302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68198ee-e73a-41f3-a26b-ac2c83956ab9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:44.218788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68198ee-e73a-41f3-a26b-ac2c83956ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:44.218880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68198ee-e73a-41f3-a26b-ac2c83956ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:44.237813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f68198ee-e73a-41f3-a26b-ac2c83956ab9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:44.239084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f68198ee-e73a-41f3-a26b-ac2c83956ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:44.310276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 545/1074] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:44.362564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ca1e7-39c4-4d16-8afa-7ea2827f7f22 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:44.362889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ca1e7-39c4-4d16-8afa-7ea2827f7f22 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:44.363139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ca1e7-39c4-4d16-8afa-7ea2827f7f22 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:44.364591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 530/1075] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:44.369604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7fbf-af70-4a4f-9506-cf7e323c990b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:44.369897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7fbf-af70-4a4f-9506-cf7e323c990b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:44.370175 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7fbf-af70-4a4f-9506-cf7e323c990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:44.388360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cfde7fbf-af70-4a4f-9506-cf7e323c990b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:44.389560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cfde7fbf-af70-4a4f-9506-cf7e323c990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:44.470005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 546/1076] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:44.586852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ca1e7-39c4-4d16-8afa-7ea2827f7f22 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:44.689013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ca1e7-39c4-4d16-8afa-7ea2827f7f22 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:44.708968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:44.724585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bd966-46e7-42ba-b035-69a79d5f01b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:44.725121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bd966-46e7-42ba-b035-69a79d5f01b0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:44.725401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bd966-46e7-42ba-b035-69a79d5f01b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:44.725673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bd966-46e7-42ba-b035-69a79d5f01b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:44.740904 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde7fbf-af70-4a4f-9506-cf7e323c990b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:44.768043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:44.802800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bd966-46e7-42ba-b035-69a79d5f01b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:44.804284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bd966-46e7-42ba-b035-69a79d5f01b0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:44.851208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde7fbf-af70-4a4f-9506-cf7e323c990b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:44.887635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acae3d-a3af-4633-9e65-012048831c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:44.888268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acae3d-a3af-4633-9e65-012048831c34 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:44.888544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acae3d-a3af-4633-9e65-012048831c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:44.888816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acae3d-a3af-4633-9e65-012048831c34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:44.900066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acae3d-a3af-4633-9e65-012048831c34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-18acae3d-a3af-4633-9e65-012048831c34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:44.904825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:44.905775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:44.906822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 547/1077] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:00:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:44.911869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acae3d-a3af-4633-9e65-012048831c34 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:44.922698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 531/1078] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:00:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:44.925220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bd966-46e7-42ba-b035-69a79d5f01b0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:44.950231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:45.010652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:45.025331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acae3d-a3af-4633-9e65-012048831c34 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:45.033113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bd966-46e7-42ba-b035-69a79d5f01b0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:45.064862 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcd39f-3f85-4b4e-94ba-649607b3b348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:45.065582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd39f-3f85-4b4e-94ba-649607b3b348 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:45.065864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd39f-3f85-4b4e-94ba-649607b3b348 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:45.066352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcd39f-3f85-4b4e-94ba-649607b3b348 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:45.066832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcd39f-3f85-4b4e-94ba-649607b3b348 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:45.067238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcd39f-3f85-4b4e-94ba-649607b3b348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:45.068497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcd39f-3f85-4b4e-94ba-649607b3b348 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:45.072617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebff88-bf81-4fbb-ba3f-f47c9d960c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:45.073727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebff88-bf81-4fbb-ba3f-f47c9d960c2a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:45.074238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebff88-bf81-4fbb-ba3f-f47c9d960c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:45.075383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebff88-bf81-4fbb-ba3f-f47c9d960c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:45.079124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 548/1079] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:00:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:45.084879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcd39f-3f85-4b4e-94ba-649607b3b348 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:45.092965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebff88-bf81-4fbb-ba3f-f47c9d960c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:45.094504 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebff88-bf81-4fbb-ba3f-f47c9d960c2a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-acebff88-bf81-4fbb-ba3f-f47c9d960c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:45.109296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:45.110263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:45.111198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:45.111198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:45.111198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:45.111198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 532/1080] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:45.116191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebff88-bf81-4fbb-ba3f-f47c9d960c2a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:45.190563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:45.195500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcd39f-3f85-4b4e-94ba-649607b3b348 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:45.221846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebff88-bf81-4fbb-ba3f-f47c9d960c2a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:45.230478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bba77-31fb-41eb-9eaf-8335cf3a8e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:45.231154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bba77-31fb-41eb-9eaf-8335cf3a8e68 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:45.231431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bba77-31fb-41eb-9eaf-8335cf3a8e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:45.231699 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bba77-31fb-41eb-9eaf-8335cf3a8e68 None admin] PATH_INFO: `/v3/users/e58ead21f78a48cb86f2417d74ce3934` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:45.234004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bba77-31fb-41eb-9eaf-8335cf3a8e68 None admin] RBAC: Authorizing `identity:get_user(user_id=e58ead21f78a48cb86f2417d74ce3934)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:45.235470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bba77-31fb-41eb-9eaf-8335cf3a8e68 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:45.237382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 549/1081] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:00:45 2022] GET /identity/v3/users/e58ead21f78a48cb86f2417d74ce3934 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:45.243434 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bba77-31fb-41eb-9eaf-8335cf3a8e68 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:45.260554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283035-f283-438b-9d0c-1d9318117cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:45.261233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283035-f283-438b-9d0c-1d9318117cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:45.261432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283035-f283-438b-9d0c-1d9318117cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:45.261699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283035-f283-438b-9d0c-1d9318117cc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:45.262379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f283035-f283-438b-9d0c-1d9318117cc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:45.262630 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f283035-f283-438b-9d0c-1d9318117cc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:45.263846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:45.264046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f283035-f283-438b-9d0c-1d9318117cc8 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:45.283892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 533/1082] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:45.356632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bba77-31fb-41eb-9eaf-8335cf3a8e68 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:45.404313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fed3b0-cd88-49fa-93fa-2d39c034784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:45.404973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed3b0-cd88-49fa-93fa-2d39c034784b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:45.405248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed3b0-cd88-49fa-93fa-2d39c034784b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:45.405515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed3b0-cd88-49fa-93fa-2d39c034784b None admin] PATH_INFO: `/v3/projects/6bfe3a8664fe4b538887931416925651` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:45.406708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fed3b0-cd88-49fa-93fa-2d39c034784b None admin] RBAC: Authorizing `identity:get_project(project_id=6bfe3a8664fe4b538887931416925651)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:45.408204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fed3b0-cd88-49fa-93fa-2d39c034784b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:45.415998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 550/1083] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:00:45 2022] GET /identity/v3/projects/6bfe3a8664fe4b538887931416925651 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:45.424383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283035-f283-438b-9d0c-1d9318117cc8 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:45.438354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103132b6-52ee-408c-9f80-280222b736ad None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:45.438711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103132b6-52ee-408c-9f80-280222b736ad None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:45.438934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103132b6-52ee-408c-9f80-280222b736ad None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:45.440490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 551/1084] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:00:45.445924 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27775bb-c700-4269-9e0a-b2f34666111e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:45.446201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27775bb-c700-4269-9e0a-b2f34666111e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:45.446480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27775bb-c700-4269-9e0a-b2f34666111e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:45.468039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c27775bb-c700-4269-9e0a-b2f34666111e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:45.469236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c27775bb-c700-4269-9e0a-b2f34666111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:45.543224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283035-f283-438b-9d0c-1d9318117cc8 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:45.551547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 552/1085] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:45.578317 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:45.586198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466de26-f431-4b64-a336-9de899fc2bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:45.586901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466de26-f431-4b64-a336-9de899fc2bc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:45.587185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466de26-f431-4b64-a336-9de899fc2bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:45.587457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466de26-f431-4b64-a336-9de899fc2bc7 None admin] PATH_INFO: `/v3/projects/6bfe3a8664fe4b538887931416925651/users/e58ead21f78a48cb86f2417d74ce3934/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:45.589669 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466de26-f431-4b64-a336-9de899fc2bc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bfe3a8664fe4b538887931416925651, user_id=e58ead21f78a48cb86f2417d74ce3934, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:45.590920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466de26-f431-4b64-a336-9de899fc2bc7 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:45.667999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 534/1086] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 16:00:45 2022] PUT /identity/v3/projects/6bfe3a8664fe4b538887931416925651/users/e58ead21f78a48cb86f2417d74ce3934/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:00:45.819785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27775bb-c700-4269-9e0a-b2f34666111e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:45.836141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:45.919870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27775bb-c700-4269-9e0a-b2f34666111e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:45.953255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed091e7-f189-4e5a-bb73-052cf983b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:45.953885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed091e7-f189-4e5a-bb73-052cf983b364 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:45.954162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed091e7-f189-4e5a-bb73-052cf983b364 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:45.954434 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed091e7-f189-4e5a-bb73-052cf983b364 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:45.965100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed091e7-f189-4e5a-bb73-052cf983b364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4ed091e7-f189-4e5a-bb73-052cf983b364 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:45.969918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:45.970944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:45.971813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 553/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Sep 8 16:00:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:45.977002 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466de26-f431-4b64-a336-9de899fc2bc7 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:46.074149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466de26-f431-4b64-a336-9de899fc2bc7 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:46.107233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ca3c-bf5a-40f2-9616-9073f6ba758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:46.107843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ca3c-bf5a-40f2-9616-9073f6ba758d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:46.108116 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ca3c-bf5a-40f2-9616-9073f6ba758d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:46.108385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ca3c-bf5a-40f2-9616-9073f6ba758d None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:46.109038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605ca3c-bf5a-40f2-9616-9073f6ba758d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:46.109336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605ca3c-bf5a-40f2-9616-9073f6ba758d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:46.110716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605ca3c-bf5a-40f2-9616-9073f6ba758d None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:46.118980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 535/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 8 16:00:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:46.124720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed091e7-f189-4e5a-bb73-052cf983b364 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:46.197726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:46.221348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed091e7-f189-4e5a-bb73-052cf983b364 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:46.255768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3b8b3-cc9a-46e4-a6b2-5fe01ec93919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:46.256380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3b8b3-cc9a-46e4-a6b2-5fe01ec93919 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:46.256656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3b8b3-cc9a-46e4-a6b2-5fe01ec93919 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:46.256926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3b8b3-cc9a-46e4-a6b2-5fe01ec93919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:46.266893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3b8b3-cc9a-46e4-a6b2-5fe01ec93919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:46.268332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3b8b3-cc9a-46e4-a6b2-5fe01ec93919 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6ff3b8b3-cc9a-46e4-a6b2-5fe01ec93919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:46.283135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:46.284130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:46.285045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:46.285045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:46.285045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:46.285045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 554/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:46.291387 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ca3c-bf5a-40f2-9616-9073f6ba758d None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:46.345113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:46.389194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ca3c-bf5a-40f2-9616-9073f6ba758d None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:46.425226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca295b-8695-40c5-82fc-6085fa88a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:46.425839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca295b-8695-40c5-82fc-6085fa88a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:46.426117 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca295b-8695-40c5-82fc-6085fa88a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:46.426388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca295b-8695-40c5-82fc-6085fa88a4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:46.427055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca295b-8695-40c5-82fc-6085fa88a4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:46.427361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca295b-8695-40c5-82fc-6085fa88a4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:46.428727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca295b-8695-40c5-82fc-6085fa88a4b4 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:46.440844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 536/1090] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:46.446309 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3b8b3-cc9a-46e4-a6b2-5fe01ec93919 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:46.544972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3b8b3-cc9a-46e4-a6b2-5fe01ec93919 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:46.569414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:46.577745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771212d4-da35-492b-a774-e7ef300144da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:46.578364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771212d4-da35-492b-a774-e7ef300144da None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:46.578637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771212d4-da35-492b-a774-e7ef300144da None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:46.578933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771212d4-da35-492b-a774-e7ef300144da None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:46.586536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771212d4-da35-492b-a774-e7ef300144da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:46.587985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771212d4-da35-492b-a774-e7ef300144da None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-771212d4-da35-492b-a774-e7ef300144da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:00:46.598850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:46.605195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:46.606386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:46.606386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:46.606386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:00:46.606386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:00:46.606386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:00:46.606386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:00:46.606386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:00:46.606386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:00:46.606386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 16:00:46.606386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:00:46.606386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 555/1091] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Sep 8 16:00:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:46.607536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca295b-8695-40c5-82fc-6085fa88a4b4 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:46.704319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca295b-8695-40c5-82fc-6085fa88a4b4 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:46.718256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:46.737202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58555f-962e-4164-96ee-505e8c66aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:46.739830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58555f-962e-4164-96ee-505e8c66aebd None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:46.739830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58555f-962e-4164-96ee-505e8c66aebd None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:46.739830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58555f-962e-4164-96ee-505e8c66aebd None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:46.739830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58555f-962e-4164-96ee-505e8c66aebd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:46.739830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58555f-962e-4164-96ee-505e8c66aebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:46.740882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58555f-962e-4164-96ee-505e8c66aebd None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:46.758198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 537/1092] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Sep 8 16:00:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:46.763630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771212d4-da35-492b-a774-e7ef300144da None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:46.861601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771212d4-da35-492b-a774-e7ef300144da None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:46.894307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdced26-251d-481b-937e-06a78dc906de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:46.894942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdced26-251d-481b-937e-06a78dc906de None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:46.897102 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdced26-251d-481b-937e-06a78dc906de None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:46.897102 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdced26-251d-481b-937e-06a78dc906de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:46.948542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:46.962051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdced26-251d-481b-937e-06a78dc906de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:46.963627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdced26-251d-481b-937e-06a78dc906de None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:47.057803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 556/1093] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:00:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:47.063527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58555f-962e-4164-96ee-505e8c66aebd None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:47.158715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58555f-962e-4164-96ee-505e8c66aebd None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:47.192542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e92a2-937b-476b-903d-fc8bf65412d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:47.193162 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e92a2-937b-476b-903d-fc8bf65412d1 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:47.193460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e92a2-937b-476b-903d-fc8bf65412d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:47.193732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e92a2-937b-476b-903d-fc8bf65412d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:47.204042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e92a2-937b-476b-903d-fc8bf65412d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:47.205485 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e92a2-937b-476b-903d-fc8bf65412d1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-273e92a2-937b-476b-903d-fc8bf65412d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:00:47.219614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:47.220534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:00:47.221467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:00:47.221467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:00:47.221467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:47.221467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 538/1094] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:47.226341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdced26-251d-481b-937e-06a78dc906de None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:47.307935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:47.322740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdced26-251d-481b-937e-06a78dc906de None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:47.355501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f903ffd-4a7b-4bad-aa42-cb075b6c9ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:47.356103 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903ffd-4a7b-4bad-aa42-cb075b6c9ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:47.356376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903ffd-4a7b-4bad-aa42-cb075b6c9ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:47.356644 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f903ffd-4a7b-4bad-aa42-cb075b6c9ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:47.357274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f903ffd-4a7b-4bad-aa42-cb075b6c9ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:47.357572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f903ffd-4a7b-4bad-aa42-cb075b6c9ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:47.358948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f903ffd-4a7b-4bad-aa42-cb075b6c9ec5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:47.370571 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 557/1095] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:47.376065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e92a2-937b-476b-903d-fc8bf65412d1 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:47.402157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:47.477800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e92a2-937b-476b-903d-fc8bf65412d1 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:47.511072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69edd2-6143-443c-8498-e6787f9bdeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:47.511694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69edd2-6143-443c-8498-e6787f9bdeee None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:47.511968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69edd2-6143-443c-8498-e6787f9bdeee None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:47.512234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69edd2-6143-443c-8498-e6787f9bdeee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:47.518923 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69edd2-6143-443c-8498-e6787f9bdeee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:47.520355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69edd2-6143-443c-8498-e6787f9bdeee None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-fa69edd2-6143-443c-8498-e6787f9bdeee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:00:47.531232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:47.532271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:47.533217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:00:47.533217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:00:47.533217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:00:47.533217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:00:47.533217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:00:47.533217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:00:47.533217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:00:47.533217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:47.533217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 539/1096] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:00:47.538221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f903ffd-4a7b-4bad-aa42-cb075b6c9ec5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:47.633934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f903ffd-4a7b-4bad-aa42-cb075b6c9ec5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:47.666192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4b039-ba9b-4f9a-922c-2bb5ffe81183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:47.666896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4b039-ba9b-4f9a-922c-2bb5ffe81183 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:47.667173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4b039-ba9b-4f9a-922c-2bb5ffe81183 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:47.667436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4b039-ba9b-4f9a-922c-2bb5ffe81183 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:47.668124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4b039-ba9b-4f9a-922c-2bb5ffe81183 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:47.668424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4b039-ba9b-4f9a-922c-2bb5ffe81183 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:47.669861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4b039-ba9b-4f9a-922c-2bb5ffe81183 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:47.683865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 558/1097] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:47.690053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69edd2-6143-443c-8498-e6787f9bdeee None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:47.773912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:47.794089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69edd2-6143-443c-8498-e6787f9bdeee None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:47.795197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b354fe2-ec72-4678-87a1-fe6284f96d1a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:47.795483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b354fe2-ec72-4678-87a1-fe6284f96d1a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:47.795752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b354fe2-ec72-4678-87a1-fe6284f96d1a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:47.797084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 559/1098] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:00:47.802119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a3ca1-3ec7-4448-987a-cb31ca875b42 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:47.802395 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a3ca1-3ec7-4448-987a-cb31ca875b42 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:47.802760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a3ca1-3ec7-4448-987a-cb31ca875b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:47.814579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:47.820592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-481a3ca1-3ec7-4448-987a-cb31ca875b42 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:47.821886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-481a3ca1-3ec7-4448-987a-cb31ca875b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:47.829338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b085-626e-47eb-a967-c21d6d04bb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:47.829932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b085-626e-47eb-a967-c21d6d04bb43 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:47.830206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b085-626e-47eb-a967-c21d6d04bb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:47.830473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b085-626e-47eb-a967-c21d6d04bb43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:47.831220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b085-626e-47eb-a967-c21d6d04bb43 None admin] RBAC: Adding query filter params (role.id=cd03bc5d3f3f4da982ce0092790c9b47, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=41f7a6292d004a648c3c92526d1304ec) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:47.831523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b085-626e-47eb-a967-c21d6d04bb43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:47.832994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b085-626e-47eb-a967-c21d6d04bb43 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:47.839453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 540/1099] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:00:47 2022] GET /identity/v3/role_assignments?user.id=41f7a6292d004a648c3c92526d1304ec&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=cd03bc5d3f3f4da982ce0092790c9b47 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:47.893161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 560/1100] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:00:48.162484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b085-626e-47eb-a967-c21d6d04bb43 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:48.268127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b085-626e-47eb-a967-c21d6d04bb43 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:48.306846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f342f11-bd67-4b35-9353-b72d3e593d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:48.307491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f342f11-bd67-4b35-9353-b72d3e593d69 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:48.307768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f342f11-bd67-4b35-9353-b72d3e593d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:48.308039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f342f11-bd67-4b35-9353-b72d3e593d69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:48.318001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f342f11-bd67-4b35-9353-b72d3e593d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-6f342f11-bd67-4b35-9353-b72d3e593d69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:00:48.323530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:00:48.324652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:00:48.326032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 541/1101] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:00:48.330697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a3ca1-3ec7-4448-987a-cb31ca875b42 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:48.434378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a3ca1-3ec7-4448-987a-cb31ca875b42 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:48.473854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabcf30-2e9c-421d-aba6-587fc45d57be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:48.474475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabcf30-2e9c-421d-aba6-587fc45d57be None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:48.474770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabcf30-2e9c-421d-aba6-587fc45d57be None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:48.475045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabcf30-2e9c-421d-aba6-587fc45d57be None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:48.475702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabcf30-2e9c-421d-aba6-587fc45d57be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:48.476022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabcf30-2e9c-421d-aba6-587fc45d57be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:48.477376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabcf30-2e9c-421d-aba6-587fc45d57be None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:48.479812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:48.486117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 561/1102] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:48.492453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f342f11-bd67-4b35-9353-b72d3e593d69 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:48.504263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:48.597662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f342f11-bd67-4b35-9353-b72d3e593d69 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:48.633042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90137-1806-41c9-866b-de6eba936f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:48.633673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90137-1806-41c9-866b-de6eba936f60 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:48.633951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90137-1806-41c9-866b-de6eba936f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:48.634224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90137-1806-41c9-866b-de6eba936f60 None admin] PATH_INFO: `/v3/users/e58ead21f78a48cb86f2417d74ce3934` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:48.635382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90137-1806-41c9-866b-de6eba936f60 None admin] RBAC: Authorizing `identity:get_user(user_id=e58ead21f78a48cb86f2417d74ce3934)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:48.636826 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90137-1806-41c9-866b-de6eba936f60 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:48.638415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 542/1103] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:00:48 2022] GET /identity/v3/users/e58ead21f78a48cb86f2417d74ce3934 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:48.644701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabcf30-2e9c-421d-aba6-587fc45d57be None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:48.745498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabcf30-2e9c-421d-aba6-587fc45d57be None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:48.778118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5361b4f-3fb0-4a49-964a-f5043c43e7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:48.778747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5361b4f-3fb0-4a49-964a-f5043c43e7dc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:48.779026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5361b4f-3fb0-4a49-964a-f5043c43e7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:48.779296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5361b4f-3fb0-4a49-964a-f5043c43e7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:48.840328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:48.843651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5361b4f-3fb0-4a49-964a-f5043c43e7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:48.845089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5361b4f-3fb0-4a49-964a-f5043c43e7dc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:48.940181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 562/1104] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:00:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:48.946283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90137-1806-41c9-866b-de6eba936f60 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:49.020173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:49.042006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90137-1806-41c9-866b-de6eba936f60 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:49.075201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ed376-61e0-4a30-91e5-b3742d068d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:49.075815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ed376-61e0-4a30-91e5-b3742d068d74 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:49.076093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ed376-61e0-4a30-91e5-b3742d068d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:49.076368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ed376-61e0-4a30-91e5-b3742d068d74 None admin] PATH_INFO: `/v3/projects/6bfe3a8664fe4b538887931416925651` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:49.077483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ed376-61e0-4a30-91e5-b3742d068d74 None admin] RBAC: Authorizing `identity:get_project(project_id=6bfe3a8664fe4b538887931416925651)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:49.078943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ed376-61e0-4a30-91e5-b3742d068d74 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:49.080532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 543/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:00:48 2022] GET /identity/v3/projects/6bfe3a8664fe4b538887931416925651 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:49.086752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5361b4f-3fb0-4a49-964a-f5043c43e7dc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:49.183696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:49.187437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5361b4f-3fb0-4a49-964a-f5043c43e7dc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:49.219459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bf55d-9222-458d-a30e-de3704744283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:49.220048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf55d-9222-458d-a30e-de3704744283 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:49.220319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf55d-9222-458d-a30e-de3704744283 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:49.220585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf55d-9222-458d-a30e-de3704744283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:49.221290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bf55d-9222-458d-a30e-de3704744283 None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=6bfe3a8664fe4b538887931416925651, user.id=e58ead21f78a48cb86f2417d74ce3934) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:49.221591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bf55d-9222-458d-a30e-de3704744283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:49.223016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bf55d-9222-458d-a30e-de3704744283 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:49.229012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 563/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:00:49 2022] GET /identity/v3/role_assignments?user.id=e58ead21f78a48cb86f2417d74ce3934&scope.project.id=6bfe3a8664fe4b538887931416925651&role.id=519b356d36364663a59265dc7eeff0b8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:51.366023 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756a92-e042-4274-b8c4-fbe4b5306d4f None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:51.367165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756a92-e042-4274-b8c4-fbe4b5306d4f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:51.367267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756a92-e042-4274-b8c4-fbe4b5306d4f None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:51.368560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 544/1107] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:51.373694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04d7f-d2d7-4855-8073-3c52d1793be2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:51.374080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04d7f-d2d7-4855-8073-3c52d1793be2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:51.374227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a04d7f-d2d7-4855-8073-3c52d1793be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:51.392036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-45a04d7f-d2d7-4855-8073-3c52d1793be2 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:51.393205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-45a04d7f-d2d7-4855-8073-3c52d1793be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:51.457077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 564/1108] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:51.724489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4756a92-e042-4274-b8c4-fbe4b5306d4f None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:51.826891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4756a92-e042-4274-b8c4-fbe4b5306d4f None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:51.859556 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102a345-a8de-47ce-90e2-f5d627543427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:51.860163 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102a345-a8de-47ce-90e2-f5d627543427 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:51.860434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102a345-a8de-47ce-90e2-f5d627543427 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:51.860698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102a345-a8de-47ce-90e2-f5d627543427 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:51.861778 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102a345-a8de-47ce-90e2-f5d627543427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:51.863228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102a345-a8de-47ce-90e2-f5d627543427 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:51.864756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 545/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:00:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:51.870492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a04d7f-d2d7-4855-8073-3c52d1793be2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:51.957415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:51.966123 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a04d7f-d2d7-4855-8073-3c52d1793be2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:51.997894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9af1a0-fb7c-407f-b5b1-508d295de265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:51.998433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af1a0-fb7c-407f-b5b1-508d295de265 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:51.998756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af1a0-fb7c-407f-b5b1-508d295de265 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:51.999028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9af1a0-fb7c-407f-b5b1-508d295de265 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:51.999663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9af1a0-fb7c-407f-b5b1-508d295de265 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:52.001067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9af1a0-fb7c-407f-b5b1-508d295de265 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:52.147589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 565/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 16:00:51 2022] POST /identity/v3/users => generated 286 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:00:54.306255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee255797-c8f0-483e-97c6-8f792f8e2d05 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:54.306849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee255797-c8f0-483e-97c6-8f792f8e2d05 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:54.306849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee255797-c8f0-483e-97c6-8f792f8e2d05 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:54.308151 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 546/1111] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:54.313361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d27e7-293f-45ec-a501-523d20a7793c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:54.313797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d27e7-293f-45ec-a501-523d20a7793c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:54.313897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d27e7-293f-45ec-a501-523d20a7793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:54.331509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a58d27e7-293f-45ec-a501-523d20a7793c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:54.332689 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a58d27e7-293f-45ec-a501-523d20a7793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:54.397023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 566/1112] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:54.662063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee255797-c8f0-483e-97c6-8f792f8e2d05 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:54.676462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:54.759530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee255797-c8f0-483e-97c6-8f792f8e2d05 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:54.791464 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23ce2e-dbac-428d-8e81-d03e8e2c46ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:54.792073 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23ce2e-dbac-428d-8e81-d03e8e2c46ab None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:54.792350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23ce2e-dbac-428d-8e81-d03e8e2c46ab None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:54.792619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23ce2e-dbac-428d-8e81-d03e8e2c46ab None admin] PATH_INFO: `/v3/roles/779e95b5df394f2a95fbdfa2a9fb58eb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:54.793985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23ce2e-dbac-428d-8e81-d03e8e2c46ab None admin] RBAC: Authorizing `identity:get_role(role_id=779e95b5df394f2a95fbdfa2a9fb58eb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:54.795379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23ce2e-dbac-428d-8e81-d03e8e2c46ab None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:54.796658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 547/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:00:54 2022] GET /identity/v3/roles/779e95b5df394f2a95fbdfa2a9fb58eb => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:54.802291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d27e7-293f-45ec-a501-523d20a7793c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:54.876581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:54.896943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d27e7-293f-45ec-a501-523d20a7793c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:54.930728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91746b7e-800a-45f8-a2b0-ec9a756f4aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:54.931289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91746b7e-800a-45f8-a2b0-ec9a756f4aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:54.931573 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91746b7e-800a-45f8-a2b0-ec9a756f4aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:54.931844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91746b7e-800a-45f8-a2b0-ec9a756f4aa5 None admin] PATH_INFO: `/v3/users/6259285bd3f14052a3238c903d770ed4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:54.945153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91746b7e-800a-45f8-a2b0-ec9a756f4aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=6259285bd3f14052a3238c903d770ed4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:54.946572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91746b7e-800a-45f8-a2b0-ec9a756f4aa5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:54.948181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 567/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:00:54 2022] GET /identity/v3/users/6259285bd3f14052a3238c903d770ed4 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:54.954002 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23ce2e-dbac-428d-8e81-d03e8e2c46ab None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:55.032530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:55.050483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23ce2e-dbac-428d-8e81-d03e8e2c46ab None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:55.083570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a8393-afb1-482c-ba1c-aa4d8f5df39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:55.084159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a8393-afb1-482c-ba1c-aa4d8f5df39c None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:55.084437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a8393-afb1-482c-ba1c-aa4d8f5df39c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:55.084705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a8393-afb1-482c-ba1c-aa4d8f5df39c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:55.149582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a8393-afb1-482c-ba1c-aa4d8f5df39c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:55.151057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a8393-afb1-482c-ba1c-aa4d8f5df39c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:55.225969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:55.244523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 548/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:00:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:55.250544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91746b7e-800a-45f8-a2b0-ec9a756f4aa5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:55.345213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91746b7e-800a-45f8-a2b0-ec9a756f4aa5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:55.377719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d986f-00c6-4c63-a192-874720ea2637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:55.378324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d986f-00c6-4c63-a192-874720ea2637 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:55.378594 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d986f-00c6-4c63-a192-874720ea2637 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:55.378887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d986f-00c6-4c63-a192-874720ea2637 None admin] PATH_INFO: `/v3/projects/6bfe3a8664fe4b538887931416925651` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:55.379975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d986f-00c6-4c63-a192-874720ea2637 None admin] RBAC: Authorizing `identity:get_project(project_id=6bfe3a8664fe4b538887931416925651)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:55.381387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d986f-00c6-4c63-a192-874720ea2637 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:55.383591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 568/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:00:55 2022] GET /identity/v3/projects/6bfe3a8664fe4b538887931416925651 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:55.389571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a8393-afb1-482c-ba1c-aa4d8f5df39c None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:55.484521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a8393-afb1-482c-ba1c-aa4d8f5df39c None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:55.518149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b58d5b-43ee-40a0-9017-7797dcc686d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:55.518775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b58d5b-43ee-40a0-9017-7797dcc686d2 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:55.519055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b58d5b-43ee-40a0-9017-7797dcc686d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:55.519328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b58d5b-43ee-40a0-9017-7797dcc686d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:55.520040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b58d5b-43ee-40a0-9017-7797dcc686d2 None admin] RBAC: Adding query filter params (role.id=779e95b5df394f2a95fbdfa2a9fb58eb, scope.project.id=6bfe3a8664fe4b538887931416925651, user.id=6259285bd3f14052a3238c903d770ed4) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:00:55.520346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b58d5b-43ee-40a0-9017-7797dcc686d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:55.521773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b58d5b-43ee-40a0-9017-7797dcc686d2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:55.526983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 549/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:00:55 2022] GET /identity/v3/role_assignments?user.id=6259285bd3f14052a3238c903d770ed4&scope.project.id=6bfe3a8664fe4b538887931416925651&role.id=779e95b5df394f2a95fbdfa2a9fb58eb => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:00:57.616407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cd9a6-0eee-4bc5-922a-c07c9911283d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:57.616933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cd9a6-0eee-4bc5-922a-c07c9911283d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:57.616933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cd9a6-0eee-4bc5-922a-c07c9911283d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:57.618262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 569/1118] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:00:57.623588 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05706e-c3c9-42d9-913b-7408c3935012 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:57.623998 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05706e-c3c9-42d9-913b-7408c3935012 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:57.624127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05706e-c3c9-42d9-913b-7408c3935012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:57.641992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-1a05706e-c3c9-42d9-913b-7408c3935012 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:00:57.643206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1a05706e-c3c9-42d9-913b-7408c3935012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:00:57.682128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:57.706871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 550/1119] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:00:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:00:57.971516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cd9a6-0eee-4bc5-922a-c07c9911283d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:57.975409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:58.067540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cd9a6-0eee-4bc5-922a-c07c9911283d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:58.100051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a8c48-3237-4679-8804-b7c90552169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:58.100690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8c48-3237-4679-8804-b7c90552169c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:58.100962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8c48-3237-4679-8804-b7c90552169c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:58.101227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a8c48-3237-4679-8804-b7c90552169c None admin] PATH_INFO: `/v3/roles/779e95b5df394f2a95fbdfa2a9fb58eb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:58.102585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a8c48-3237-4679-8804-b7c90552169c None admin] RBAC: Authorizing `identity:get_role(role_id=779e95b5df394f2a95fbdfa2a9fb58eb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:58.103953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a8c48-3237-4679-8804-b7c90552169c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:58.105231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 570/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:00:57 2022] GET /identity/v3/roles/779e95b5df394f2a95fbdfa2a9fb58eb => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:58.110996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05706e-c3c9-42d9-913b-7408c3935012 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:58.224453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05706e-c3c9-42d9-913b-7408c3935012 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:58.257695 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b11c1-4c98-48fe-8424-3074ad560d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:58.258316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b11c1-4c98-48fe-8424-3074ad560d41 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:58.258594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b11c1-4c98-48fe-8424-3074ad560d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:58.258896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b11c1-4c98-48fe-8424-3074ad560d41 None admin] PATH_INFO: `/v3/users/6259285bd3f14052a3238c903d770ed4` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:58.260011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b11c1-4c98-48fe-8424-3074ad560d41 None admin] RBAC: Authorizing `identity:get_user(user_id=6259285bd3f14052a3238c903d770ed4)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:58.261446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b11c1-4c98-48fe-8424-3074ad560d41 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:58.263060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 551/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:00:58 2022] GET /identity/v3/users/6259285bd3f14052a3238c903d770ed4 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:58.269100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a8c48-3237-4679-8804-b7c90552169c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:58.336457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:58.364033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a8c48-3237-4679-8804-b7c90552169c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:58.396507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411792de-3f71-4adc-9560-e86de69d408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:58.397108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411792de-3f71-4adc-9560-e86de69d408b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:58.397889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411792de-3f71-4adc-9560-e86de69d408b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:58.398155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411792de-3f71-4adc-9560-e86de69d408b None admin] PATH_INFO: `/v3/projects/6bfe3a8664fe4b538887931416925651` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:58.399264 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411792de-3f71-4adc-9560-e86de69d408b None admin] RBAC: Authorizing `identity:get_project(project_id=6bfe3a8664fe4b538887931416925651)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:58.400667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411792de-3f71-4adc-9560-e86de69d408b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:58.402258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 571/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:00:58 2022] GET /identity/v3/projects/6bfe3a8664fe4b538887931416925651 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:00:58.408223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b11c1-4c98-48fe-8424-3074ad560d41 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:00:58.450397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:58.503680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b11c1-4c98-48fe-8424-3074ad560d41 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:00:58.536608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8583a5-a085-4b63-a960-5564031aa089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:00:58.537253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8583a5-a085-4b63-a960-5564031aa089 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:00:58.537527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8583a5-a085-4b63-a960-5564031aa089 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:00:58.538335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8583a5-a085-4b63-a960-5564031aa089 None admin] PATH_INFO: `/v3/projects/6bfe3a8664fe4b538887931416925651/users/6259285bd3f14052a3238c903d770ed4/roles/779e95b5df394f2a95fbdfa2a9fb58eb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:00:58.540462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8583a5-a085-4b63-a960-5564031aa089 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bfe3a8664fe4b538887931416925651, user_id=6259285bd3f14052a3238c903d770ed4, role_id=779e95b5df394f2a95fbdfa2a9fb58eb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:00:58.541894 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8583a5-a085-4b63-a960-5564031aa089 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:00:58.604108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 552/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 16:00:58 2022] PUT /identity/v3/projects/6bfe3a8664fe4b538887931416925651/users/6259285bd3f14052a3238c903d770ed4/roles/779e95b5df394f2a95fbdfa2a9fb58eb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:01:00.716077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3001b5-b477-4f51-a0c0-a138c1d216f9 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:00.716609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3001b5-b477-4f51-a0c0-a138c1d216f9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:00.716609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3001b5-b477-4f51-a0c0-a138c1d216f9 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:00.717943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 572/1124] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:00.723326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4ae3-068b-4730-a4a7-44249e781445 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:00.723742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4ae3-068b-4730-a4a7-44249e781445 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:00.723866 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc4ae3-068b-4730-a4a7-44249e781445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:00.742039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-2cdc4ae3-068b-4730-a4a7-44249e781445 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:00.743259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2cdc4ae3-068b-4730-a4a7-44249e781445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:00.810944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 553/1125] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:01.079821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3001b5-b477-4f51-a0c0-a138c1d216f9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:01.177372 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3001b5-b477-4f51-a0c0-a138c1d216f9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:01.213691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486c1b2-ad7d-4b80-a2ab-7e2319e62dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:01.214315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486c1b2-ad7d-4b80-a2ab-7e2319e62dfa None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:01.214593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486c1b2-ad7d-4b80-a2ab-7e2319e62dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:01.214900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486c1b2-ad7d-4b80-a2ab-7e2319e62dfa None admin] PATH_INFO: `/v3/roles/779e95b5df394f2a95fbdfa2a9fb58eb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:01.216302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486c1b2-ad7d-4b80-a2ab-7e2319e62dfa None admin] RBAC: Authorizing `identity:get_role(role_id=779e95b5df394f2a95fbdfa2a9fb58eb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:01.217663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486c1b2-ad7d-4b80-a2ab-7e2319e62dfa None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:01.219025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 573/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:01:01 2022] GET /identity/v3/roles/779e95b5df394f2a95fbdfa2a9fb58eb => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:01.224877 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc4ae3-068b-4730-a4a7-44249e781445 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:01.254836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:01.319596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc4ae3-068b-4730-a4a7-44249e781445 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:01.353542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcb1d4-b9ed-4831-8cbc-7e83fdc99fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:01.354101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcb1d4-b9ed-4831-8cbc-7e83fdc99fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:01.354376 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcb1d4-b9ed-4831-8cbc-7e83fdc99fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:01.354644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcb1d4-b9ed-4831-8cbc-7e83fdc99fd1 None admin] PATH_INFO: `/v3/users/6259285bd3f14052a3238c903d770ed4` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:01.355777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcb1d4-b9ed-4831-8cbc-7e83fdc99fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=6259285bd3f14052a3238c903d770ed4)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:01.357210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcb1d4-b9ed-4831-8cbc-7e83fdc99fd1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:01.358779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 554/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:01:01 2022] GET /identity/v3/users/6259285bd3f14052a3238c903d770ed4 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:01.364418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486c1b2-ad7d-4b80-a2ab-7e2319e62dfa None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:01.375373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:01.462419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486c1b2-ad7d-4b80-a2ab-7e2319e62dfa None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:01.497196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd6064-c6d2-4c8d-b89e-5435b351798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:01.498039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd6064-c6d2-4c8d-b89e-5435b351798e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:01.498527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd6064-c6d2-4c8d-b89e-5435b351798e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:01.499052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd6064-c6d2-4c8d-b89e-5435b351798e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:01.568665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd6064-c6d2-4c8d-b89e-5435b351798e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:01.570703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd6064-c6d2-4c8d-b89e-5435b351798e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:01.579833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:01.665340 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 574/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:01:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:01.671361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcb1d4-b9ed-4831-8cbc-7e83fdc99fd1 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:01.764249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:01.767538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcb1d4-b9ed-4831-8cbc-7e83fdc99fd1 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:01.800535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8da881-3553-444e-8916-27b39b5d365a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:01.801150 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8da881-3553-444e-8916-27b39b5d365a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:01.801431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8da881-3553-444e-8916-27b39b5d365a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:01.801709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8da881-3553-444e-8916-27b39b5d365a None admin] PATH_INFO: `/v3/projects/6bfe3a8664fe4b538887931416925651` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:01.802856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8da881-3553-444e-8916-27b39b5d365a None admin] RBAC: Authorizing `identity:get_project(project_id=6bfe3a8664fe4b538887931416925651)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:01.804932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8da881-3553-444e-8916-27b39b5d365a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:01.806536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 555/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:01:01 2022] GET /identity/v3/projects/6bfe3a8664fe4b538887931416925651 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:01.812499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd6064-c6d2-4c8d-b89e-5435b351798e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:01.906020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd6064-c6d2-4c8d-b89e-5435b351798e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:01.916092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:01.939799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e4d78-1594-448a-9444-4a2a27808418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:01.940630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e4d78-1594-448a-9444-4a2a27808418 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:01.941065 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e4d78-1594-448a-9444-4a2a27808418 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:01.941597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e4d78-1594-448a-9444-4a2a27808418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:01.942323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e4d78-1594-448a-9444-4a2a27808418 None admin] RBAC: Adding query filter params (role.id=779e95b5df394f2a95fbdfa2a9fb58eb, scope.project.id=6bfe3a8664fe4b538887931416925651, user.id=6259285bd3f14052a3238c903d770ed4) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:01.942631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e4d78-1594-448a-9444-4a2a27808418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:01.944092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e4d78-1594-448a-9444-4a2a27808418 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:01.949743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 575/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:01:01 2022] GET /identity/v3/role_assignments?user.id=6259285bd3f14052a3238c903d770ed4&scope.project.id=6bfe3a8664fe4b538887931416925651&role.id=779e95b5df394f2a95fbdfa2a9fb58eb => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:04.124102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433365-a02b-460a-bfcf-2d158d06163a None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:04.124631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433365-a02b-460a-bfcf-2d158d06163a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:04.124631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24433365-a02b-460a-bfcf-2d158d06163a None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:04.125974 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 556/1131] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:04.131244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa8d0-e441-4487-8230-0b5cfe651495 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:04.131658 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa8d0-e441-4487-8230-0b5cfe651495 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:04.131769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa8d0-e441-4487-8230-0b5cfe651495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:04.149544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fb4aa8d0-e441-4487-8230-0b5cfe651495 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:04.150726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fb4aa8d0-e441-4487-8230-0b5cfe651495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:04.215302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 576/1132] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:04.479223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433365-a02b-460a-bfcf-2d158d06163a None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:04.578369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24433365-a02b-460a-bfcf-2d158d06163a None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:04.611041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14d9b4-dd27-4c77-80e4-d73bf3c4bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:04.611656 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14d9b4-dd27-4c77-80e4-d73bf3c4bc74 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:04.611932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14d9b4-dd27-4c77-80e4-d73bf3c4bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:04.612202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14d9b4-dd27-4c77-80e4-d73bf3c4bc74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:04.613295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14d9b4-dd27-4c77-80e4-d73bf3c4bc74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:04.614752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14d9b4-dd27-4c77-80e4-d73bf3c4bc74 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:04.616296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 557/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:01:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:04.622118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aa8d0-e441-4487-8230-0b5cfe651495 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:04.718338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aa8d0-e441-4487-8230-0b5cfe651495 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:04.719848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:04.749974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4428a-6ff1-46a1-81a7-00e939bb079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:04.750561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4428a-6ff1-46a1-81a7-00e939bb079a None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:04.750867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4428a-6ff1-46a1-81a7-00e939bb079a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:04.751134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4428a-6ff1-46a1-81a7-00e939bb079a None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:04.751776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4428a-6ff1-46a1-81a7-00e939bb079a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:04.753192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4428a-6ff1-46a1-81a7-00e939bb079a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:04.816354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 577/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 16:01:04 2022] POST /identity/v3/projects => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:01:06.963719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0265bf-eb0d-4aa8-b514-4439331b57b7 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:06.964299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0265bf-eb0d-4aa8-b514-4439331b57b7 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:06.964299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0265bf-eb0d-4aa8-b514-4439331b57b7 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:06.965585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 558/1135] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:06.970691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456a4b6-ba9c-4c95-9770-8d76f7598748 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:06.971196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456a4b6-ba9c-4c95-9770-8d76f7598748 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:06.971292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456a4b6-ba9c-4c95-9770-8d76f7598748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:06.989510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b456a4b6-ba9c-4c95-9770-8d76f7598748 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:06.991338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b456a4b6-ba9c-4c95-9770-8d76f7598748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:07.055783 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 578/1136] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:07.328266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0265bf-eb0d-4aa8-b514-4439331b57b7 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:07.364227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:07.428776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0265bf-eb0d-4aa8-b514-4439331b57b7 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:07.461636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a36f7-5189-435f-9754-d21307824a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:07.462252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a36f7-5189-435f-9754-d21307824a9d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:07.462528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a36f7-5189-435f-9754-d21307824a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:07.462835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a36f7-5189-435f-9754-d21307824a9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:07.463938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a36f7-5189-435f-9754-d21307824a9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:07.465370 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a36f7-5189-435f-9754-d21307824a9d None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:07.466964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 559/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:01:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:07.472668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456a4b6-ba9c-4c95-9770-8d76f7598748 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:07.556293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:07.571275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456a4b6-ba9c-4c95-9770-8d76f7598748 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:07.605031 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc957d2-8733-491f-8824-da0e82119c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:07.605574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc957d2-8733-491f-8824-da0e82119c84 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:07.605850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc957d2-8733-491f-8824-da0e82119c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:07.606119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc957d2-8733-491f-8824-da0e82119c84 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:07.606802 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc957d2-8733-491f-8824-da0e82119c84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:07.608257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc957d2-8733-491f-8824-da0e82119c84 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:07.677543 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 579/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 16:01:07 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:01:09.841338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e042-5e13-495d-8ad0-96432744a6b8 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:09.841869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e042-5e13-495d-8ad0-96432744a6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:09.841977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e042-5e13-495d-8ad0-96432744a6b8 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:09.843281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 560/1139] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:09.848376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff205af-4b10-4540-954e-8fa6a0c376c2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:09.848772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff205af-4b10-4540-954e-8fa6a0c376c2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:09.848907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff205af-4b10-4540-954e-8fa6a0c376c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:09.866969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3ff205af-4b10-4540-954e-8fa6a0c376c2 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:09.868139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3ff205af-4b10-4540-954e-8fa6a0c376c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:09.932016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 580/1140] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 16:01:10.201394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3e042-5e13-495d-8ad0-96432744a6b8 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:10.299059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3e042-5e13-495d-8ad0-96432744a6b8 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:10.301321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:10.331403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b82a-9454-4b1f-b9e5-91cfc9e092ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:10.332020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b82a-9454-4b1f-b9e5-91cfc9e092ae None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:10.332296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b82a-9454-4b1f-b9e5-91cfc9e092ae None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:10.332566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6b82a-9454-4b1f-b9e5-91cfc9e092ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:10.343042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6b82a-9454-4b1f-b9e5-91cfc9e092ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-49a6b82a-9454-4b1f-b9e5-91cfc9e092ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:01:10.347824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:01:10.348905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:01:10.350344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 561/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:01:10.355521 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff205af-4b10-4540-954e-8fa6a0c376c2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:10.422721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:10.451183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff205af-4b10-4540-954e-8fa6a0c376c2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:10.485175 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a12fb-7a8d-4f1b-9389-d22eaf573bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:10.485710 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a12fb-7a8d-4f1b-9389-d22eaf573bff None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:10.485983 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a12fb-7a8d-4f1b-9389-d22eaf573bff None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:10.486250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a12fb-7a8d-4f1b-9389-d22eaf573bff None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:10.486923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a12fb-7a8d-4f1b-9389-d22eaf573bff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:10.487221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a12fb-7a8d-4f1b-9389-d22eaf573bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:10.488566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a12fb-7a8d-4f1b-9389-d22eaf573bff None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:10.496366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 581/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:01:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:10.502288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b82a-9454-4b1f-b9e5-91cfc9e092ae None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:10.598121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6b82a-9454-4b1f-b9e5-91cfc9e092ae None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:10.630065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c1a8d-f211-4831-9f92-a3dcbc3c71fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:10.630721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c1a8d-f211-4831-9f92-a3dcbc3c71fd None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:10.631004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c1a8d-f211-4831-9f92-a3dcbc3c71fd None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:10.631274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c1a8d-f211-4831-9f92-a3dcbc3c71fd None admin] PATH_INFO: `/v3/users/9c21edb631e04956a75cbf22c696db80` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:10.643967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c1a8d-f211-4831-9f92-a3dcbc3c71fd None admin] RBAC: Authorizing `identity:get_user(user_id=9c21edb631e04956a75cbf22c696db80)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:10.645402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c1a8d-f211-4831-9f92-a3dcbc3c71fd None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:10.647495 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 562/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:01:10 2022] GET /identity/v3/users/9c21edb631e04956a75cbf22c696db80 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:10.653058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a12fb-7a8d-4f1b-9389-d22eaf573bff None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:10.748380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a12fb-7a8d-4f1b-9389-d22eaf573bff None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:10.776376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:10.780994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95729d-ad2c-4c18-a908-e4ae28f68309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:10.781583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95729d-ad2c-4c18-a908-e4ae28f68309 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:10.781855 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95729d-ad2c-4c18-a908-e4ae28f68309 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:10.782121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95729d-ad2c-4c18-a908-e4ae28f68309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:10.845745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95729d-ad2c-4c18-a908-e4ae28f68309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:10.847204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95729d-ad2c-4c18-a908-e4ae28f68309 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:10.939397 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 582/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:01:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:10.945781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c1a8d-f211-4831-9f92-a3dcbc3c71fd None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:10.969352 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:11.040482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c1a8d-f211-4831-9f92-a3dcbc3c71fd None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:11.072888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825b903-0c50-4e94-820e-f0c8d7b26bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:11.073523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b903-0c50-4e94-820e-f0c8d7b26bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:11.073796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b903-0c50-4e94-820e-f0c8d7b26bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:11.074062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b903-0c50-4e94-820e-f0c8d7b26bf0 None admin] PATH_INFO: `/v3/projects/04afc7b90fa6449389e505dc84c6ec62` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:11.075183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825b903-0c50-4e94-820e-f0c8d7b26bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=04afc7b90fa6449389e505dc84c6ec62)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:11.076596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825b903-0c50-4e94-820e-f0c8d7b26bf0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:11.078206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 563/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:01:10 2022] GET /identity/v3/projects/04afc7b90fa6449389e505dc84c6ec62 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:11.084243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95729d-ad2c-4c18-a908-e4ae28f68309 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:11.112925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:11.178761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95729d-ad2c-4c18-a908-e4ae28f68309 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:11.211206 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50e0be-d384-4136-8f72-05cf5a5e3303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:11.211791 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50e0be-d384-4136-8f72-05cf5a5e3303 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:11.212060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50e0be-d384-4136-8f72-05cf5a5e3303 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:11.212325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50e0be-d384-4136-8f72-05cf5a5e3303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:11.213030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50e0be-d384-4136-8f72-05cf5a5e3303 None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=04afc7b90fa6449389e505dc84c6ec62, user.id=9c21edb631e04956a75cbf22c696db80) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:11.213334 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50e0be-d384-4136-8f72-05cf5a5e3303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:11.214771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50e0be-d384-4136-8f72-05cf5a5e3303 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:11.219923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 583/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:01:11 2022] GET /identity/v3/role_assignments?user.id=9c21edb631e04956a75cbf22c696db80&scope.project.id=04afc7b90fa6449389e505dc84c6ec62&role.id=519b356d36364663a59265dc7eeff0b8 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:01:13.361005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadbdf6-2078-40b0-b7b8-98f75bb560a8 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:13.361555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadbdf6-2078-40b0-b7b8-98f75bb560a8 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:13.361555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadbdf6-2078-40b0-b7b8-98f75bb560a8 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:13.362920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 564/1147] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:13.368015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d021e2-f1c9-4606-82be-04a934a49cfb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:13.368404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d021e2-f1c9-4606-82be-04a934a49cfb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:13.368563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d021e2-f1c9-4606-82be-04a934a49cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:13.386292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-77d021e2-f1c9-4606-82be-04a934a49cfb None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:13.387509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-77d021e2-f1c9-4606-82be-04a934a49cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:13.452145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 584/1148] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:13.725167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadbdf6-2078-40b0-b7b8-98f75bb560a8 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:13.812147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:13.822526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadbdf6-2078-40b0-b7b8-98f75bb560a8 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:13.855131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b73c8e-03f3-46e2-9869-5fa9f9fb9da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:13.855763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b73c8e-03f3-46e2-9869-5fa9f9fb9da8 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:13.856347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b73c8e-03f3-46e2-9869-5fa9f9fb9da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:13.856625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b73c8e-03f3-46e2-9869-5fa9f9fb9da8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:13.866435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b73c8e-03f3-46e2-9869-5fa9f9fb9da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-14b73c8e-03f3-46e2-9869-5fa9f9fb9da8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:01:13.871226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:01:13.872322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:01:13.873491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 565/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:01:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:01:13.878229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d021e2-f1c9-4606-82be-04a934a49cfb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:13.905309 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:13.974600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d021e2-f1c9-4606-82be-04a934a49cfb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:14.007802 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b06fb-5b22-499f-960f-6ecd85edfc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:14.008356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b06fb-5b22-499f-960f-6ecd85edfc24 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:14.008611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b06fb-5b22-499f-960f-6ecd85edfc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:14.008884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b06fb-5b22-499f-960f-6ecd85edfc24 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:14.009541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b06fb-5b22-499f-960f-6ecd85edfc24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:14.009842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b06fb-5b22-499f-960f-6ecd85edfc24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:14.011225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b06fb-5b22-499f-960f-6ecd85edfc24 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:14.019208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 585/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:01:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:14.025463 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b73c8e-03f3-46e2-9869-5fa9f9fb9da8 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:14.120867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b73c8e-03f3-46e2-9869-5fa9f9fb9da8 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:14.153280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50798c6e-1b3e-4fbc-a5bd-c086453da496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:14.153890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50798c6e-1b3e-4fbc-a5bd-c086453da496 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:14.154167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50798c6e-1b3e-4fbc-a5bd-c086453da496 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:14.154438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50798c6e-1b3e-4fbc-a5bd-c086453da496 None admin] PATH_INFO: `/v3/users/9c21edb631e04956a75cbf22c696db80` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:14.155577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50798c6e-1b3e-4fbc-a5bd-c086453da496 None admin] RBAC: Authorizing `identity:get_user(user_id=9c21edb631e04956a75cbf22c696db80)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:14.157001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50798c6e-1b3e-4fbc-a5bd-c086453da496 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:14.158534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 566/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:01:14 2022] GET /identity/v3/users/9c21edb631e04956a75cbf22c696db80 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:14.164169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b06fb-5b22-499f-960f-6ecd85edfc24 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:14.248729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:14.266362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b06fb-5b22-499f-960f-6ecd85edfc24 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:14.293120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb4356-c4dd-4739-9440-976bf4b31580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:14.293734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb4356-c4dd-4739-9440-976bf4b31580 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:14.294014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb4356-c4dd-4739-9440-976bf4b31580 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:14.294288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb4356-c4dd-4739-9440-976bf4b31580 None admin] PATH_INFO: `/v3/projects/04afc7b90fa6449389e505dc84c6ec62` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:14.295414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb4356-c4dd-4739-9440-976bf4b31580 None admin] RBAC: Authorizing `identity:get_project(project_id=04afc7b90fa6449389e505dc84c6ec62)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:14.296831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb4356-c4dd-4739-9440-976bf4b31580 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:14.298427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 586/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:01:14 2022] GET /identity/v3/projects/04afc7b90fa6449389e505dc84c6ec62 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:14.304649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50798c6e-1b3e-4fbc-a5bd-c086453da496 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:14.323907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:14.400312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50798c6e-1b3e-4fbc-a5bd-c086453da496 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:14.434394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e186096-6af8-4b6b-8f11-c2331eb2c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:14.435075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e186096-6af8-4b6b-8f11-c2331eb2c847 None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:14.435354 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e186096-6af8-4b6b-8f11-c2331eb2c847 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:14.435625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e186096-6af8-4b6b-8f11-c2331eb2c847 None admin] PATH_INFO: `/v3/projects/04afc7b90fa6449389e505dc84c6ec62/users/9c21edb631e04956a75cbf22c696db80/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:14.437504 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e186096-6af8-4b6b-8f11-c2331eb2c847 None admin] RBAC: Authorizing `identity:create_grant(project_id=04afc7b90fa6449389e505dc84c6ec62, user_id=9c21edb631e04956a75cbf22c696db80, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:14.439029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e186096-6af8-4b6b-8f11-c2331eb2c847 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:14.505252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 567/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 16:01:14 2022] PUT /identity/v3/projects/04afc7b90fa6449389e505dc84c6ec62/users/9c21edb631e04956a75cbf22c696db80/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:01:16.629366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429312a7-f8e6-4b2d-b09f-ae7722f82b61 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:16.629882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429312a7-f8e6-4b2d-b09f-ae7722f82b61 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:16.629882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429312a7-f8e6-4b2d-b09f-ae7722f82b61 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:16.631308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 587/1154] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:16.636560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f01ab-3689-4ba7-a5d7-47aba1fa3853 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:16.636926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f01ab-3689-4ba7-a5d7-47aba1fa3853 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:16.637098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f01ab-3689-4ba7-a5d7-47aba1fa3853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:16.655528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a21f01ab-3689-4ba7-a5d7-47aba1fa3853 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:16.656721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a21f01ab-3689-4ba7-a5d7-47aba1fa3853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:16.720422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 568/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:16.987672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429312a7-f8e6-4b2d-b09f-ae7722f82b61 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:17.086943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429312a7-f8e6-4b2d-b09f-ae7722f82b61 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:17.118948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc925fa-4b6d-44ef-894b-b424ab8786b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:17.119561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc925fa-4b6d-44ef-894b-b424ab8786b8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:17.119837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc925fa-4b6d-44ef-894b-b424ab8786b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:17.120106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc925fa-4b6d-44ef-894b-b424ab8786b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:17.130178 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc925fa-4b6d-44ef-894b-b424ab8786b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-cbc925fa-4b6d-44ef-894b-b424ab8786b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:01:17.135481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:01:17.136544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:01:17.137715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 588/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:01:17.142746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f01ab-3689-4ba7-a5d7-47aba1fa3853 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:17.152570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:17.235047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f01ab-3689-4ba7-a5d7-47aba1fa3853 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:17.270198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5c05b-2aa2-440c-bcd1-b9edc25bd448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:17.270758 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5c05b-2aa2-440c-bcd1-b9edc25bd448 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:17.271075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5c05b-2aa2-440c-bcd1-b9edc25bd448 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:17.271346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5c05b-2aa2-440c-bcd1-b9edc25bd448 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:17.271995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5c05b-2aa2-440c-bcd1-b9edc25bd448 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:17.272292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5c05b-2aa2-440c-bcd1-b9edc25bd448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:17.273651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5c05b-2aa2-440c-bcd1-b9edc25bd448 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:17.281281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 569/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:01:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:17.287252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc925fa-4b6d-44ef-894b-b424ab8786b8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:17.305730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:17.388029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc925fa-4b6d-44ef-894b-b424ab8786b8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:17.421432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aea100-70dc-4744-a929-afa2101bac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:17.422137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aea100-70dc-4744-a929-afa2101bac34 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:17.422319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aea100-70dc-4744-a929-afa2101bac34 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:17.422594 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aea100-70dc-4744-a929-afa2101bac34 None admin] PATH_INFO: `/v3/users/9c21edb631e04956a75cbf22c696db80` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:17.423743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aea100-70dc-4744-a929-afa2101bac34 None admin] RBAC: Authorizing `identity:get_user(user_id=9c21edb631e04956a75cbf22c696db80)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:17.425172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aea100-70dc-4744-a929-afa2101bac34 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:17.426767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 589/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:01:17 2022] GET /identity/v3/users/9c21edb631e04956a75cbf22c696db80 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:17.433106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5c05b-2aa2-440c-bcd1-b9edc25bd448 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:17.498818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:17.528103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5c05b-2aa2-440c-bcd1-b9edc25bd448 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:17.560401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039c56e-a859-4e1a-830d-4bb67ae43b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:17.560985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039c56e-a859-4e1a-830d-4bb67ae43b55 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:17.561258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039c56e-a859-4e1a-830d-4bb67ae43b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:17.561524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039c56e-a859-4e1a-830d-4bb67ae43b55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:17.625550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039c56e-a859-4e1a-830d-4bb67ae43b55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:17.627035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039c56e-a859-4e1a-830d-4bb67ae43b55 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:17.691197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:17.720294 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 570/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:01:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:17.726838 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aea100-70dc-4744-a929-afa2101bac34 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:17.807820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:17.822582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aea100-70dc-4744-a929-afa2101bac34 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:17.855097 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b711a-c48d-43fe-a8c7-0f63547530e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:17.855712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b711a-c48d-43fe-a8c7-0f63547530e2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:17.855992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b711a-c48d-43fe-a8c7-0f63547530e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:17.858825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b711a-c48d-43fe-a8c7-0f63547530e2 None admin] PATH_INFO: `/v3/projects/04afc7b90fa6449389e505dc84c6ec62` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:17.858825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b711a-c48d-43fe-a8c7-0f63547530e2 None admin] RBAC: Authorizing `identity:get_project(project_id=04afc7b90fa6449389e505dc84c6ec62)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:17.858825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b711a-c48d-43fe-a8c7-0f63547530e2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:17.860363 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 590/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:01:17 2022] GET /identity/v3/projects/04afc7b90fa6449389e505dc84c6ec62 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:17.866476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039c56e-a859-4e1a-830d-4bb67ae43b55 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:17.960487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039c56e-a859-4e1a-830d-4bb67ae43b55 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:17.992455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c533582-e5aa-439c-abde-c6db331d1155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:17.993040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c533582-e5aa-439c-abde-c6db331d1155 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:17.993311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c533582-e5aa-439c-abde-c6db331d1155 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:17.993575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c533582-e5aa-439c-abde-c6db331d1155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:17.994282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c533582-e5aa-439c-abde-c6db331d1155 None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=04afc7b90fa6449389e505dc84c6ec62, user.id=9c21edb631e04956a75cbf22c696db80) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:17.994584 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c533582-e5aa-439c-abde-c6db331d1155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:17.996020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c533582-e5aa-439c-abde-c6db331d1155 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:18.001484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 571/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:01:17 2022] GET /identity/v3/role_assignments?user.id=9c21edb631e04956a75cbf22c696db80&scope.project.id=04afc7b90fa6449389e505dc84c6ec62&role.id=519b356d36364663a59265dc7eeff0b8 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:20.152800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bccf23-cccc-4654-afd3-d64e9411772a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:20.153391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bccf23-cccc-4654-afd3-d64e9411772a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:20.153391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bccf23-cccc-4654-afd3-d64e9411772a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:20.154688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 591/1162] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:20.159843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255845c-c744-4b66-9ad3-bec561eada28 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:20.160238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255845c-c744-4b66-9ad3-bec561eada28 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:20.160382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255845c-c744-4b66-9ad3-bec561eada28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:20.180798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c255845c-c744-4b66-9ad3-bec561eada28 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:20.182349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c255845c-c744-4b66-9ad3-bec561eada28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:20.208470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:20.246372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 572/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:20.514151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bccf23-cccc-4654-afd3-d64e9411772a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:20.612910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bccf23-cccc-4654-afd3-d64e9411772a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:20.645140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73962ea8-4d8f-4241-a198-601b0db696ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:20.645754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73962ea8-4d8f-4241-a198-601b0db696ba None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:20.646032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73962ea8-4d8f-4241-a198-601b0db696ba None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:20.646304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73962ea8-4d8f-4241-a198-601b0db696ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:20.667593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:20.711740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73962ea8-4d8f-4241-a198-601b0db696ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:20.713169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73962ea8-4d8f-4241-a198-601b0db696ba None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:20.807068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 592/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:01:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:20.812890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255845c-c744-4b66-9ad3-bec561eada28 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:20.906795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255845c-c744-4b66-9ad3-bec561eada28 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:20.938783 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13294270-8873-4541-b951-f977cf3f895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:20.939403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13294270-8873-4541-b951-f977cf3f895f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:20.939676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13294270-8873-4541-b951-f977cf3f895f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:20.939945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13294270-8873-4541-b951-f977cf3f895f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:20.946274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13294270-8873-4541-b951-f977cf3f895f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:20.947728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13294270-8873-4541-b951-f977cf3f895f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-13294270-8873-4541-b951-f977cf3f895f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:01:20.959154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:01:20.960371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:01:20.961716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 573/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Sep 8 16:01:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:01:20.966184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73962ea8-4d8f-4241-a198-601b0db696ba None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:21.016069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:21.061145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73962ea8-4d8f-4241-a198-601b0db696ba None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:21.093620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120a40-9813-4d31-b0ad-56f715993e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:21.094215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120a40-9813-4d31-b0ad-56f715993e16 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:21.094493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120a40-9813-4d31-b0ad-56f715993e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:21.094797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120a40-9813-4d31-b0ad-56f715993e16 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:21.095431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120a40-9813-4d31-b0ad-56f715993e16 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:21.095733 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120a40-9813-4d31-b0ad-56f715993e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:21.097082 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120a40-9813-4d31-b0ad-56f715993e16 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:21.104594 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 593/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Sep 8 16:01:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:23.225065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44a30-45c0-4a40-82d0-4c64a9195849 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:23.225611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44a30-45c0-4a40-82d0-4c64a9195849 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:23.225611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44a30-45c0-4a40-82d0-4c64a9195849 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:23.226979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 574/1167] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:23.232244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5151d9-6b9d-44cd-b90d-a940694e1383 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:23.232657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5151d9-6b9d-44cd-b90d-a940694e1383 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:23.232780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5151d9-6b9d-44cd-b90d-a940694e1383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:23.250867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9a5151d9-6b9d-44cd-b90d-a940694e1383 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:23.252040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9a5151d9-6b9d-44cd-b90d-a940694e1383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:23.315125 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 594/1168] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:23.587674 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf44a30-45c0-4a40-82d0-4c64a9195849 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:23.612811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:23.688057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf44a30-45c0-4a40-82d0-4c64a9195849 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:23.719972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeefb3-f05d-4d0f-9f60-619058033c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:23.720569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeefb3-f05d-4d0f-9f60-619058033c05 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:23.720847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeefb3-f05d-4d0f-9f60-619058033c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:23.721116 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeefb3-f05d-4d0f-9f60-619058033c05 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:23.721779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeefb3-f05d-4d0f-9f60-619058033c05 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:23.723181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeefb3-f05d-4d0f-9f60-619058033c05 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:23.792690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 575/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Thu Sep 8 16:01:23 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:01:25.938220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e427b-99e1-4a90-a0dc-ec9d9f29346b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:25.938793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e427b-99e1-4a90-a0dc-ec9d9f29346b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:25.938793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e427b-99e1-4a90-a0dc-ec9d9f29346b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:25.940116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 595/1170] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:25.945862 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2c461-a868-4c22-8ca1-14efaef08098 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:25.946319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2c461-a868-4c22-8ca1-14efaef08098 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:25.946419 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2c461-a868-4c22-8ca1-14efaef08098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:25.964757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-e6c2c461-a868-4c22-8ca1-14efaef08098 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:25.965943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e6c2c461-a868-4c22-8ca1-14efaef08098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:26.029605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 576/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:26.291286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e427b-99e1-4a90-a0dc-ec9d9f29346b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:26.337107 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:26.387890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e427b-99e1-4a90-a0dc-ec9d9f29346b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:26.420578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028139c4-e343-45a8-9807-29921a09a189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:26.421206 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028139c4-e343-45a8-9807-29921a09a189 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:26.421483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028139c4-e343-45a8-9807-29921a09a189 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:26.421752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028139c4-e343-45a8-9807-29921a09a189 None admin] PATH_INFO: `/v3/domains/0f109733f60a499f986e1a7781629326` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:26.432680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028139c4-e343-45a8-9807-29921a09a189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0f109733f60a499f986e1a7781629326)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:26.434106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028139c4-e343-45a8-9807-29921a09a189 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:26.435712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 596/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Thu Sep 8 16:01:26 2022] GET /identity/v3/domains/0f109733f60a499f986e1a7781629326 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:26.441447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2c461-a868-4c22-8ca1-14efaef08098 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:26.455887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:26.536396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2c461-a868-4c22-8ca1-14efaef08098 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:26.568617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58127f4-5a78-4c11-a699-d19438a4597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:26.569136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58127f4-5a78-4c11-a699-d19438a4597e None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:26.569408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58127f4-5a78-4c11-a699-d19438a4597e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:26.569673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58127f4-5a78-4c11-a699-d19438a4597e None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:26.570377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58127f4-5a78-4c11-a699-d19438a4597e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:26.571843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58127f4-5a78-4c11-a699-d19438a4597e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:26.655190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 577/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 16:01:26 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:01:28.815216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47a14d-e119-4dea-8698-f305d884a2d7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:28.815779 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47a14d-e119-4dea-8698-f305d884a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:28.815779 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47a14d-e119-4dea-8698-f305d884a2d7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:28.817642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 597/1174] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:28.822910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84392-fd88-46a9-ad7b-e39f0fb301e0 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:28.823291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84392-fd88-46a9-ad7b-e39f0fb301e0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:28.823454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84392-fd88-46a9-ad7b-e39f0fb301e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:28.842587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-12d84392-fd88-46a9-ad7b-e39f0fb301e0 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:28.843790 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-12d84392-fd88-46a9-ad7b-e39f0fb301e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:28.901270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:28.909131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 578/1175] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:29.199973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47a14d-e119-4dea-8698-f305d884a2d7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:29.303526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47a14d-e119-4dea-8698-f305d884a2d7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:29.310539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:29.337592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e53aa-4979-42d1-92f3-44492ae42880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:29.338271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e53aa-4979-42d1-92f3-44492ae42880 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:29.338830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e53aa-4979-42d1-92f3-44492ae42880 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:29.339289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e53aa-4979-42d1-92f3-44492ae42880 None admin] PATH_INFO: `/v3/domains/0f109733f60a499f986e1a7781629326` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:29.340707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e53aa-4979-42d1-92f3-44492ae42880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0f109733f60a499f986e1a7781629326)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:29.342124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e53aa-4979-42d1-92f3-44492ae42880 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:29.343734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 598/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Thu Sep 8 16:01:29 2022] GET /identity/v3/domains/0f109733f60a499f986e1a7781629326 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:29.350989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d84392-fd88-46a9-ad7b-e39f0fb301e0 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:29.457529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d84392-fd88-46a9-ad7b-e39f0fb301e0 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:29.492509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788539c-5a17-430d-8f0d-87b324feace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:29.493109 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788539c-5a17-430d-8f0d-87b324feace1 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:29.493387 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788539c-5a17-430d-8f0d-87b324feace1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:29.493659 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788539c-5a17-430d-8f0d-87b324feace1 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:29.494304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788539c-5a17-430d-8f0d-87b324feace1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:29.495775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788539c-5a17-430d-8f0d-87b324feace1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:29.602518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 579/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 16:01:29 2022] POST /identity/v3/users => generated 311 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:01:31.809049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b8c4-3c15-48dc-b9a7-92e0a81973d5 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:31.809597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b8c4-3c15-48dc-b9a7-92e0a81973d5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:31.809597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b8c4-3c15-48dc-b9a7-92e0a81973d5 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:31.810980 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 599/1178] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:31.816115 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e88e8-316b-47ad-ae85-1161070113a1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:31.816496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e88e8-316b-47ad-ae85-1161070113a1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:31.817188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e88e8-316b-47ad-ae85-1161070113a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:31.835560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-729e88e8-316b-47ad-ae85-1161070113a1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:31.836762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-729e88e8-316b-47ad-ae85-1161070113a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:31.882798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:31.902258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 580/1179] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:32.173697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7b8c4-3c15-48dc-b9a7-92e0a81973d5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:32.272677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7b8c4-3c15-48dc-b9a7-92e0a81973d5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:32.304857 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc87e2-faa4-4d90-aee1-4659f4e8f473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:32.305468 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc87e2-faa4-4d90-aee1-4659f4e8f473 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:32.305744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc87e2-faa4-4d90-aee1-4659f4e8f473 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:32.306013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc87e2-faa4-4d90-aee1-4659f4e8f473 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:32.315701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc87e2-faa4-4d90-aee1-4659f4e8f473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-44fc87e2-faa4-4d90-aee1-4659f4e8f473 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:01:32.321041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:01:32.322155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:01:32.323420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 600/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:01:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:01:32.327924 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e88e8-316b-47ad-ae85-1161070113a1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:32.422977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e88e8-316b-47ad-ae85-1161070113a1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:32.455665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950281a6-1c14-4d8b-9075-a85c557af9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:32.456292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950281a6-1c14-4d8b-9075-a85c557af9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:32.456570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950281a6-1c14-4d8b-9075-a85c557af9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:32.456841 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950281a6-1c14-4d8b-9075-a85c557af9f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:32.457520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950281a6-1c14-4d8b-9075-a85c557af9f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:32.457823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950281a6-1c14-4d8b-9075-a85c557af9f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:32.459230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950281a6-1c14-4d8b-9075-a85c557af9f2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:32.466900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 581/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:01:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:32.472731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc87e2-faa4-4d90-aee1-4659f4e8f473 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:32.506760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:32.570072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc87e2-faa4-4d90-aee1-4659f4e8f473 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:32.602500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95783b99-2a19-4974-a630-e765c22d1cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:32.603132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95783b99-2a19-4974-a630-e765c22d1cff None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:32.603409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95783b99-2a19-4974-a630-e765c22d1cff None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:32.603679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95783b99-2a19-4974-a630-e765c22d1cff None admin] PATH_INFO: `/v3/users/bdf4e6e10808416bbe574a428f0056ef` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:32.616646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95783b99-2a19-4974-a630-e765c22d1cff None admin] RBAC: Authorizing `identity:get_user(user_id=bdf4e6e10808416bbe574a428f0056ef)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:32.618067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95783b99-2a19-4974-a630-e765c22d1cff None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:32.619667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 601/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:01:32 2022] GET /identity/v3/users/bdf4e6e10808416bbe574a428f0056ef => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:32.625403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950281a6-1c14-4d8b-9075-a85c557af9f2 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:32.669497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:32.721309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950281a6-1c14-4d8b-9075-a85c557af9f2 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:32.753698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe263f-2e67-4040-81f9-18ef476cf581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:32.754313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe263f-2e67-4040-81f9-18ef476cf581 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:32.754591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe263f-2e67-4040-81f9-18ef476cf581 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:32.754889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe263f-2e67-4040-81f9-18ef476cf581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:32.819062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe263f-2e67-4040-81f9-18ef476cf581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:32.820505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe263f-2e67-4040-81f9-18ef476cf581 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:32.862587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:32.917080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 582/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:01:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:32.922971 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95783b99-2a19-4974-a630-e765c22d1cff None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:33.009471 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:33.017880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95783b99-2a19-4974-a630-e765c22d1cff None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:33.051819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6c26e-06fc-4162-8d9d-2a820f9c9445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:33.052432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6c26e-06fc-4162-8d9d-2a820f9c9445 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:33.052707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6c26e-06fc-4162-8d9d-2a820f9c9445 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:33.052977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6c26e-06fc-4162-8d9d-2a820f9c9445 None admin] PATH_INFO: `/v3/projects/134cae23fccd44ebbcf7257bac3de774` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:33.054070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6c26e-06fc-4162-8d9d-2a820f9c9445 None admin] RBAC: Authorizing `identity:get_project(project_id=134cae23fccd44ebbcf7257bac3de774)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:33.055513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6c26e-06fc-4162-8d9d-2a820f9c9445 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:33.057122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 602/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:01:32 2022] GET /identity/v3/projects/134cae23fccd44ebbcf7257bac3de774 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:33.063034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe263f-2e67-4040-81f9-18ef476cf581 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:33.156978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe263f-2e67-4040-81f9-18ef476cf581 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:33.189358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dabc6e-ff41-4646-8f3c-fba3f399e59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:33.189947 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dabc6e-ff41-4646-8f3c-fba3f399e59d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:33.190223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dabc6e-ff41-4646-8f3c-fba3f399e59d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:33.190492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dabc6e-ff41-4646-8f3c-fba3f399e59d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:33.191231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dabc6e-ff41-4646-8f3c-fba3f399e59d None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=134cae23fccd44ebbcf7257bac3de774, user.id=bdf4e6e10808416bbe574a428f0056ef) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:33.191537 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dabc6e-ff41-4646-8f3c-fba3f399e59d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:33.193479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dabc6e-ff41-4646-8f3c-fba3f399e59d None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:33.198628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 583/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:01:33 2022] GET /identity/v3/role_assignments?user.id=bdf4e6e10808416bbe574a428f0056ef&scope.project.id=134cae23fccd44ebbcf7257bac3de774&role.id=519b356d36364663a59265dc7eeff0b8 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:35.304792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6263ac-340c-4a47-8110-299320853271 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:35.305324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6263ac-340c-4a47-8110-299320853271 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:35.305324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6263ac-340c-4a47-8110-299320853271 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:35.306684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 603/1186] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:35.311873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d235f2-d9d0-42c5-a103-855857e2cfd0 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:35.312255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d235f2-d9d0-42c5-a103-855857e2cfd0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:35.312422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d235f2-d9d0-42c5-a103-855857e2cfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:35.330165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a9d235f2-d9d0-42c5-a103-855857e2cfd0 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:35.331388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a9d235f2-d9d0-42c5-a103-855857e2cfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:35.333843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:35.396221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 584/1187] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:35.668331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6263ac-340c-4a47-8110-299320853271 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:35.769038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6263ac-340c-4a47-8110-299320853271 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:35.801779 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db10aa8-0005-441e-b4e7-1d58afc974d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:35.802382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db10aa8-0005-441e-b4e7-1d58afc974d6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:35.802653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db10aa8-0005-441e-b4e7-1d58afc974d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:35.802951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db10aa8-0005-441e-b4e7-1d58afc974d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:35.812510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db10aa8-0005-441e-b4e7-1d58afc974d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4db10aa8-0005-441e-b4e7-1d58afc974d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:01:35.817812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:01:35.818923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:01:35.819974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 604/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:01:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:01:35.825266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d235f2-d9d0-42c5-a103-855857e2cfd0 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:35.920863 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d235f2-d9d0-42c5-a103-855857e2cfd0 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:35.953836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29775e41-58d4-4d71-bc89-36534fa7be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:35.954429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29775e41-58d4-4d71-bc89-36534fa7be4d None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:35.954726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29775e41-58d4-4d71-bc89-36534fa7be4d None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:35.954997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29775e41-58d4-4d71-bc89-36534fa7be4d None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:35.955645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29775e41-58d4-4d71-bc89-36534fa7be4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:35.955945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29775e41-58d4-4d71-bc89-36534fa7be4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:35.957325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29775e41-58d4-4d71-bc89-36534fa7be4d None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:35.962038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:35.965183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 585/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:01:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:35.971012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db10aa8-0005-441e-b4e7-1d58afc974d6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:35.992936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:36.066325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db10aa8-0005-441e-b4e7-1d58afc974d6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:36.099065 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da948d77-2247-487e-a6f7-f8a8bef33586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:36.099672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da948d77-2247-487e-a6f7-f8a8bef33586 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:36.099944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da948d77-2247-487e-a6f7-f8a8bef33586 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:36.100210 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da948d77-2247-487e-a6f7-f8a8bef33586 None admin] PATH_INFO: `/v3/users/bdf4e6e10808416bbe574a428f0056ef` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:36.101306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da948d77-2247-487e-a6f7-f8a8bef33586 None admin] RBAC: Authorizing `identity:get_user(user_id=bdf4e6e10808416bbe574a428f0056ef)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:36.102737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da948d77-2247-487e-a6f7-f8a8bef33586 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:36.104274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 605/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:01:35 2022] GET /identity/v3/users/bdf4e6e10808416bbe574a428f0056ef => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:36.109935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29775e41-58d4-4d71-bc89-36534fa7be4d None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:36.205716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29775e41-58d4-4d71-bc89-36534fa7be4d None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:36.237402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa4161-4550-46e1-8c84-c1a85117d3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:36.238005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa4161-4550-46e1-8c84-c1a85117d3fa None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:36.238852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa4161-4550-46e1-8c84-c1a85117d3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:36.239134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa4161-4550-46e1-8c84-c1a85117d3fa None admin] PATH_INFO: `/v3/projects/134cae23fccd44ebbcf7257bac3de774` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:36.240231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa4161-4550-46e1-8c84-c1a85117d3fa None admin] RBAC: Authorizing `identity:get_project(project_id=134cae23fccd44ebbcf7257bac3de774)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:36.241642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa4161-4550-46e1-8c84-c1a85117d3fa None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:36.243247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 586/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:01:36 2022] GET /identity/v3/projects/134cae23fccd44ebbcf7257bac3de774 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:36.248937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da948d77-2247-487e-a6f7-f8a8bef33586 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:36.332200 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:36.343510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da948d77-2247-487e-a6f7-f8a8bef33586 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:36.376336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a26de6-a8f7-4ca0-9756-012d952f6b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:36.376969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a26de6-a8f7-4ca0-9756-012d952f6b0e None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:36.377240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a26de6-a8f7-4ca0-9756-012d952f6b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:36.377504 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a26de6-a8f7-4ca0-9756-012d952f6b0e None admin] PATH_INFO: `/v3/projects/134cae23fccd44ebbcf7257bac3de774/users/bdf4e6e10808416bbe574a428f0056ef/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:36.379535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a26de6-a8f7-4ca0-9756-012d952f6b0e None admin] RBAC: Authorizing `identity:create_grant(project_id=134cae23fccd44ebbcf7257bac3de774, user_id=bdf4e6e10808416bbe574a428f0056ef, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:36.380969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a26de6-a8f7-4ca0-9756-012d952f6b0e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:36.453463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 606/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 16:01:36 2022] PUT /identity/v3/projects/134cae23fccd44ebbcf7257bac3de774/users/bdf4e6e10808416bbe574a428f0056ef/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:01:38.571632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55171c7e-0a15-44b6-84b8-fe7a87046f62 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:38.572185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55171c7e-0a15-44b6-84b8-fe7a87046f62 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:38.572185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55171c7e-0a15-44b6-84b8-fe7a87046f62 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:38.573492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 587/1193] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:01:38.578844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208abe2-8215-4582-9c49-a97e7a152a22 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:38.579289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208abe2-8215-4582-9c49-a97e7a152a22 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:38.579391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208abe2-8215-4582-9c49-a97e7a152a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:38.597200 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e208abe2-8215-4582-9c49-a97e7a152a22 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:01:38.598931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e208abe2-8215-4582-9c49-a97e7a152a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:01:38.662629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 607/1194] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:01:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:01:38.938361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55171c7e-0a15-44b6-84b8-fe7a87046f62 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:39.003383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:39.036420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55171c7e-0a15-44b6-84b8-fe7a87046f62 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:39.069539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc2f6b-befa-4985-a569-7ffb530df6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:39.070155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc2f6b-befa-4985-a569-7ffb530df6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:39.070432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc2f6b-befa-4985-a569-7ffb530df6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:39.070727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc2f6b-befa-4985-a569-7ffb530df6b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:39.080875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc2f6b-befa-4985-a569-7ffb530df6b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-d6fc2f6b-befa-4985-a569-7ffb530df6b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:01:39.085621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:01:39.086813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:01:39.087667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 588/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:01:39.092709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208abe2-8215-4582-9c49-a97e7a152a22 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:39.167038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:39.187738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208abe2-8215-4582-9c49-a97e7a152a22 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:39.220055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8057f-a538-49d5-8559-ecfee0376e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:39.220587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8057f-a538-49d5-8559-ecfee0376e2e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:39.220861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8057f-a538-49d5-8559-ecfee0376e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:39.221128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8057f-a538-49d5-8559-ecfee0376e2e None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:39.221780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8057f-a538-49d5-8559-ecfee0376e2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:39.222078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8057f-a538-49d5-8559-ecfee0376e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:39.224005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8057f-a538-49d5-8559-ecfee0376e2e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:39.231983 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 608/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:01:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:39.237851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc2f6b-befa-4985-a569-7ffb530df6b4 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:39.335362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc2f6b-befa-4985-a569-7ffb530df6b4 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:39.360277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:39.368447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bb538-bc21-4821-aaaa-d68c24fa73d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:39.369470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bb538-bc21-4821-aaaa-d68c24fa73d0 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:39.369470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bb538-bc21-4821-aaaa-d68c24fa73d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:39.369814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bb538-bc21-4821-aaaa-d68c24fa73d0 None admin] PATH_INFO: `/v3/users/bdf4e6e10808416bbe574a428f0056ef` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:39.370697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bb538-bc21-4821-aaaa-d68c24fa73d0 None admin] RBAC: Authorizing `identity:get_user(user_id=bdf4e6e10808416bbe574a428f0056ef)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:39.372139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bb538-bc21-4821-aaaa-d68c24fa73d0 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:39.373681 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 589/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Sep 8 16:01:39 2022] GET /identity/v3/users/bdf4e6e10808416bbe574a428f0056ef => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:39.379549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8057f-a538-49d5-8559-ecfee0376e2e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:39.476963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8057f-a538-49d5-8559-ecfee0376e2e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:39.509311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d9b61-9eb1-46d7-bedf-bd19553054a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:39.509910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9b61-9eb1-46d7-bedf-bd19553054a9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:39.510186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9b61-9eb1-46d7-bedf-bd19553054a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:39.510454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9b61-9eb1-46d7-bedf-bd19553054a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:39.521133 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:39.574832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d9b61-9eb1-46d7-bedf-bd19553054a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:39.576270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d9b61-9eb1-46d7-bedf-bd19553054a9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:39.669905 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 609/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:01:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:39.675859 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bb538-bc21-4821-aaaa-d68c24fa73d0 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:39.771375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bb538-bc21-4821-aaaa-d68c24fa73d0 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:39.803640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c3608-6f82-4805-8f2c-7f4ff9dd8a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:39.804258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c3608-6f82-4805-8f2c-7f4ff9dd8a82 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:39.804536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c3608-6f82-4805-8f2c-7f4ff9dd8a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:39.804806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c3608-6f82-4805-8f2c-7f4ff9dd8a82 None admin] PATH_INFO: `/v3/projects/134cae23fccd44ebbcf7257bac3de774` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:39.805909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c3608-6f82-4805-8f2c-7f4ff9dd8a82 None admin] RBAC: Authorizing `identity:get_project(project_id=134cae23fccd44ebbcf7257bac3de774)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:39.807372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c3608-6f82-4805-8f2c-7f4ff9dd8a82 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:39.808978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 590/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Sep 8 16:01:39 2022] GET /identity/v3/projects/134cae23fccd44ebbcf7257bac3de774 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:39.815047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d9b61-9eb1-46d7-bedf-bd19553054a9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:01:39.855649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:39.910534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d9b61-9eb1-46d7-bedf-bd19553054a9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:01:39.942734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437eec9-4065-4664-b81f-2b8708e80b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:01:39.943322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437eec9-4065-4664-b81f-2b8708e80b87 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:01:39.943595 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437eec9-4065-4664-b81f-2b8708e80b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:01:39.943860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437eec9-4065-4664-b81f-2b8708e80b87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:01:39.944568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437eec9-4065-4664-b81f-2b8708e80b87 None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=134cae23fccd44ebbcf7257bac3de774, user.id=bdf4e6e10808416bbe574a428f0056ef) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:01:39.944871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437eec9-4065-4664-b81f-2b8708e80b87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:01:39.946265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437eec9-4065-4664-b81f-2b8708e80b87 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:01:39.951776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 610/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:01:39 2022] GET /identity/v3/role_assignments?user.id=bdf4e6e10808416bbe574a428f0056ef&scope.project.id=134cae23fccd44ebbcf7257bac3de774&role.id=519b356d36364663a59265dc7eeff0b8 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:01:49.799522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=68 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:49.949230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=48 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:49.984425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221f245-18e8-4e35-b122-bc9082b08a2a None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:49.985036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221f245-18e8-4e35-b122-bc9082b08a2a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:49.985036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221f245-18e8-4e35-b122-bc9082b08a2a None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:49.986358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 591/1201] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:02:49.991525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765af475-e1fd-459e-b7c8-3806790a240b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:49.991950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765af475-e1fd-459e-b7c8-3806790a240b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:49.992146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765af475-e1fd-459e-b7c8-3806790a240b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:50.010326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-765af475-e1fd-459e-b7c8-3806790a240b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:02:50.011539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-765af475-e1fd-459e-b7c8-3806790a240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:02:50.076881 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 611/1202] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:02:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:02:50.342901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221f245-18e8-4e35-b122-bc9082b08a2a None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:50.443712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221f245-18e8-4e35-b122-bc9082b08a2a None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:50.476507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddd679-dba0-455e-8c17-58c252d861ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:50.477124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd679-dba0-455e-8c17-58c252d861ea None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:50.477399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd679-dba0-455e-8c17-58c252d861ea None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:50.477730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddd679-dba0-455e-8c17-58c252d861ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:50.488176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ddd679-dba0-455e-8c17-58c252d861ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:50.489613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ddd679-dba0-455e-8c17-58c252d861ea None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-a1ddd679-dba0-455e-8c17-58c252d861ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:02:50.503873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:02:50.505083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:02:50.506355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:02:50.506355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:02:50.506355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:02:50.506355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 592/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:02:50.511272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765af475-e1fd-459e-b7c8-3806790a240b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:50.607949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765af475-e1fd-459e-b7c8-3806790a240b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:50.636068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:50.641944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafeca9-6011-4b7d-83a5-9442342353d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:50.642548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafeca9-6011-4b7d-83a5-9442342353d1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:50.642859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafeca9-6011-4b7d-83a5-9442342353d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:50.643134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafeca9-6011-4b7d-83a5-9442342353d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:50.643823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafeca9-6011-4b7d-83a5-9442342353d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:50.644118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafeca9-6011-4b7d-83a5-9442342353d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:50.645479 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafeca9-6011-4b7d-83a5-9442342353d1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:50.656900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 612/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:02:50.662643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddd679-dba0-455e-8c17-58c252d861ea None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:50.713851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:50.759501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ddd679-dba0-455e-8c17-58c252d861ea None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:50.792337 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ace75-ee77-459c-b6ee-5140b3b44de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:50.792931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ace75-ee77-459c-b6ee-5140b3b44de6 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:50.793206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ace75-ee77-459c-b6ee-5140b3b44de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:50.793482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ace75-ee77-459c-b6ee-5140b3b44de6 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:50.794114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ace75-ee77-459c-b6ee-5140b3b44de6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:50.795586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ace75-ee77-459c-b6ee-5140b3b44de6 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:50.901391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 593/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Sep 8 16:02:50 2022] POST /identity/v3/users => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:02:53.067157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414ee6d-f833-4d6e-bd52-8eb7f315bfc0 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:53.067745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414ee6d-f833-4d6e-bd52-8eb7f315bfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:53.067745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414ee6d-f833-4d6e-bd52-8eb7f315bfc0 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:53.069028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 613/1206] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:02:53.074335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae66e-a9a0-4673-ac99-ebdd920e27a8 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:53.074795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae66e-a9a0-4673-ac99-ebdd920e27a8 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:53.074896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae66e-a9a0-4673-ac99-ebdd920e27a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:53.093298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-47dae66e-a9a0-4673-ac99-ebdd920e27a8 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:02:53.098605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-47dae66e-a9a0-4673-ac99-ebdd920e27a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:02:53.167235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 594/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:02:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:02:53.438231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414ee6d-f833-4d6e-bd52-8eb7f315bfc0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:53.540649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414ee6d-f833-4d6e-bd52-8eb7f315bfc0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:53.574710 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee6380-41c6-4ba9-8b26-194b1d054694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:53.575339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee6380-41c6-4ba9-8b26-194b1d054694 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:53.575714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee6380-41c6-4ba9-8b26-194b1d054694 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:53.575985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee6380-41c6-4ba9-8b26-194b1d054694 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:53.586630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee6380-41c6-4ba9-8b26-194b1d054694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-03ee6380-41c6-4ba9-8b26-194b1d054694 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:02:53.591443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:02:53.592604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:02:53.594138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 614/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 16:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:02:53.599401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dae66e-a9a0-4673-ac99-ebdd920e27a8 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:53.638678 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:53.694571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dae66e-a9a0-4673-ac99-ebdd920e27a8 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:53.727031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a9b93-4648-4ec5-ae63-8d18fc5f63b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:53.727629 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a9b93-4648-4ec5-ae63-8d18fc5f63b2 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:53.727902 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a9b93-4648-4ec5-ae63-8d18fc5f63b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:53.728167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a9b93-4648-4ec5-ae63-8d18fc5f63b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:53.728814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a9b93-4648-4ec5-ae63-8d18fc5f63b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:53.729108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a9b93-4648-4ec5-ae63-8d18fc5f63b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:53.730509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a9b93-4648-4ec5-ae63-8d18fc5f63b2 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:53.739469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 595/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 16:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:02:53.745433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee6380-41c6-4ba9-8b26-194b1d054694 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:53.799050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:53.847860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee6380-41c6-4ba9-8b26-194b1d054694 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:53.880011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d30817-ba33-4ea0-92da-e675d25c57c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:53.880635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d30817-ba33-4ea0-92da-e675d25c57c4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:53.880914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d30817-ba33-4ea0-92da-e675d25c57c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:53.881188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d30817-ba33-4ea0-92da-e675d25c57c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:53.892232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d30817-ba33-4ea0-92da-e675d25c57c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:53.893657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d30817-ba33-4ea0-92da-e675d25c57c4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-21d30817-ba33-4ea0-92da-e675d25c57c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:02:53.908216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:02:53.909382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:02:53.910653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:02:53.910653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:02:53.910653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:02:53.910653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 615/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:02:53.915277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a9b93-4648-4ec5-ae63-8d18fc5f63b2 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:54.010857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:54.013927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a9b93-4648-4ec5-ae63-8d18fc5f63b2 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:54.047225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324dbe7-b0d8-4e65-bf20-6078a1386859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:54.047822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324dbe7-b0d8-4e65-bf20-6078a1386859 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:54.048101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324dbe7-b0d8-4e65-bf20-6078a1386859 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:54.048385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324dbe7-b0d8-4e65-bf20-6078a1386859 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:54.049013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324dbe7-b0d8-4e65-bf20-6078a1386859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:54.049313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324dbe7-b0d8-4e65-bf20-6078a1386859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:54.050692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324dbe7-b0d8-4e65-bf20-6078a1386859 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:54.061291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 596/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:02:54.067299 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d30817-ba33-4ea0-92da-e675d25c57c4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:54.170786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d30817-ba33-4ea0-92da-e675d25c57c4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:54.172306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:54.204132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd99b52-2d17-4d2b-b997-4b092930e40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:54.204750 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd99b52-2d17-4d2b-b997-4b092930e40c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:54.205024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd99b52-2d17-4d2b-b997-4b092930e40c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:54.205293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd99b52-2d17-4d2b-b997-4b092930e40c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:54.212421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd99b52-2d17-4d2b-b997-4b092930e40c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:54.213855 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd99b52-2d17-4d2b-b997-4b092930e40c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0dd99b52-2d17-4d2b-b997-4b092930e40c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:02:54.224727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:02:54.226350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:02:54.227449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:02:54.227449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:02:54.227449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:02:54.227449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:02:54.227449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:02:54.227449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:02:54.227449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:02:54.227449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:02:54.227449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:02:54.227449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:02:54.227449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 616/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:02:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:02:54.231621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324dbe7-b0d8-4e65-bf20-6078a1386859 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:54.329214 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324dbe7-b0d8-4e65-bf20-6078a1386859 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:54.360660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ba96f-60aa-41f4-9795-60f269cbd762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:54.361258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba96f-60aa-41f4-9795-60f269cbd762 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:54.361531 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba96f-60aa-41f4-9795-60f269cbd762 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:54.361797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba96f-60aa-41f4-9795-60f269cbd762 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:54.362508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ba96f-60aa-41f4-9795-60f269cbd762 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:54.362840 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ba96f-60aa-41f4-9795-60f269cbd762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:54.364258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ba96f-60aa-41f4-9795-60f269cbd762 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:54.381100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 597/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Sep 8 16:02:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:02:54.386896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd99b52-2d17-4d2b-b997-4b092930e40c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:54.484740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd99b52-2d17-4d2b-b997-4b092930e40c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:54.519297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84df34-ae2c-47d2-bcaf-f586090b4c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:54.519906 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84df34-ae2c-47d2-bcaf-f586090b4c3a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:54.520184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84df34-ae2c-47d2-bcaf-f586090b4c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:54.520455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84df34-ae2c-47d2-bcaf-f586090b4c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:54.549725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:54.585720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84df34-ae2c-47d2-bcaf-f586090b4c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:54.587120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84df34-ae2c-47d2-bcaf-f586090b4c3a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:54.681381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 617/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:02:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:02:54.688036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ba96f-60aa-41f4-9795-60f269cbd762 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:54.706455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:54.784811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ba96f-60aa-41f4-9795-60f269cbd762 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:54.818227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddeaae0-1464-4c90-befb-6d71fc985e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:54.818875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeaae0-1464-4c90-befb-6d71fc985e1a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:54.819153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeaae0-1464-4c90-befb-6d71fc985e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:54.819424 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeaae0-1464-4c90-befb-6d71fc985e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:54.829771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddeaae0-1464-4c90-befb-6d71fc985e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:54.836467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddeaae0-1464-4c90-befb-6d71fc985e1a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-7ddeaae0-1464-4c90-befb-6d71fc985e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:02:54.845457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:02:54.846561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:02:54.847673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:02:54.847673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:02:54.847673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:02:54.847673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 598/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:02:54.852431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84df34-ae2c-47d2-bcaf-f586090b4c3a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:54.911874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:54.950180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84df34-ae2c-47d2-bcaf-f586090b4c3a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:54.985132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed79ad-4d4f-4166-a7fc-c2402eb418b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:54.985735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed79ad-4d4f-4166-a7fc-c2402eb418b0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:54.986060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed79ad-4d4f-4166-a7fc-c2402eb418b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:54.986335 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed79ad-4d4f-4166-a7fc-c2402eb418b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:54.987003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed79ad-4d4f-4166-a7fc-c2402eb418b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:54.987305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed79ad-4d4f-4166-a7fc-c2402eb418b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:54.988663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed79ad-4d4f-4166-a7fc-c2402eb418b0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:54.999608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 618/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:02:55.005462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddeaae0-1464-4c90-befb-6d71fc985e1a None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:55.073882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:55.104921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddeaae0-1464-4c90-befb-6d71fc985e1a None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:55.138914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f187636-38fd-48be-bd71-9f18a301c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:55.143661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187636-38fd-48be-bd71-9f18a301c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:55.143661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187636-38fd-48be-bd71-9f18a301c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:55.143661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187636-38fd-48be-bd71-9f18a301c6f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:55.153355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f187636-38fd-48be-bd71-9f18a301c6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:55.153355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f187636-38fd-48be-bd71-9f18a301c6f1 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-7f187636-38fd-48be-bd71-9f18a301c6f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:02:55.160091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:02:55.161105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:02:55.162068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:02:55.162068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:02:55.162068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:02:55.162068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:02:55.162068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:02:55.162068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:02:55.162068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:02:55.162068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:02:55.162068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 599/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:02:55.167234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed79ad-4d4f-4166-a7fc-c2402eb418b0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:55.264083 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed79ad-4d4f-4166-a7fc-c2402eb418b0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:55.286588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:55.297760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78752ccc-d6dc-4f04-b28b-fc57ef8952c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:55.298354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78752ccc-d6dc-4f04-b28b-fc57ef8952c0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:55.298628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78752ccc-d6dc-4f04-b28b-fc57ef8952c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:55.298927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78752ccc-d6dc-4f04-b28b-fc57ef8952c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:55.299600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78752ccc-d6dc-4f04-b28b-fc57ef8952c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:55.299901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78752ccc-d6dc-4f04-b28b-fc57ef8952c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:55.301409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78752ccc-d6dc-4f04-b28b-fc57ef8952c0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:55.314233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 619/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:02:55.320368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f187636-38fd-48be-bd71-9f18a301c6f1 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:55.427596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f187636-38fd-48be-bd71-9f18a301c6f1 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:55.455560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:55.461619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c2d86-0e49-4a4e-8bd3-b5474b0e79f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:55.462223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c2d86-0e49-4a4e-8bd3-b5474b0e79f3 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:55.462501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c2d86-0e49-4a4e-8bd3-b5474b0e79f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:55.462811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c2d86-0e49-4a4e-8bd3-b5474b0e79f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:55.463658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c2d86-0e49-4a4e-8bd3-b5474b0e79f3 None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=7e6c855e2692410d83c78cc95cb4f37e) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:55.463962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c2d86-0e49-4a4e-8bd3-b5474b0e79f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:55.465498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c2d86-0e49-4a4e-8bd3-b5474b0e79f3 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:55.470612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 600/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:02:55 2022] GET /identity/v3/role_assignments?user.id=7e6c855e2692410d83c78cc95cb4f37e&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:02:57.615091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c46a9-43cd-473d-874f-d4c69c1628cc None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:57.615609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c46a9-43cd-473d-874f-d4c69c1628cc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:57.615722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c46a9-43cd-473d-874f-d4c69c1628cc None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:57.616998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 620/1220] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:02:57.622258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c93bc-1cca-41b8-b5a1-9e16f25d4dab None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:57.622727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c93bc-1cca-41b8-b5a1-9e16f25d4dab None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:57.622838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c93bc-1cca-41b8-b5a1-9e16f25d4dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:57.641759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-562c93bc-1cca-41b8-b5a1-9e16f25d4dab None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:02:57.642990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-562c93bc-1cca-41b8-b5a1-9e16f25d4dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:02:57.707690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 601/1221] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:02:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:02:57.975918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c46a9-43cd-473d-874f-d4c69c1628cc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:58.075868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c46a9-43cd-473d-874f-d4c69c1628cc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:58.110339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097356a9-2c20-44ef-8a7b-64ee015feb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:58.111033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097356a9-2c20-44ef-8a7b-64ee015feb8a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:58.111310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097356a9-2c20-44ef-8a7b-64ee015feb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:58.111574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097356a9-2c20-44ef-8a7b-64ee015feb8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:58.121828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097356a9-2c20-44ef-8a7b-64ee015feb8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-097356a9-2c20-44ef-8a7b-64ee015feb8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:02:58.126553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:02:58.128098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:02:58.129073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 621/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 16:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:02:58.133872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c93bc-1cca-41b8-b5a1-9e16f25d4dab None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:58.230177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c93bc-1cca-41b8-b5a1-9e16f25d4dab None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:58.253261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:58.263653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57016ac1-6e25-4617-96d1-f84bc18b0b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:58.264256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57016ac1-6e25-4617-96d1-f84bc18b0b44 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:58.265041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57016ac1-6e25-4617-96d1-f84bc18b0b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:58.265311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57016ac1-6e25-4617-96d1-f84bc18b0b44 None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:58.265962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57016ac1-6e25-4617-96d1-f84bc18b0b44 None admin] RBAC: Adding query filter params (name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:58.266261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57016ac1-6e25-4617-96d1-f84bc18b0b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:58.267662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57016ac1-6e25-4617-96d1-f84bc18b0b44 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:58.275246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 602/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 16:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:02:58.281656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097356a9-2c20-44ef-8a7b-64ee015feb8a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:58.324333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:58.377506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097356a9-2c20-44ef-8a7b-64ee015feb8a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:58.412138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd496c43-a09b-4d30-8f7c-3379e0b94dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:58.412765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd496c43-a09b-4d30-8f7c-3379e0b94dcd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:58.413041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd496c43-a09b-4d30-8f7c-3379e0b94dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:58.413310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd496c43-a09b-4d30-8f7c-3379e0b94dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:58.423566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd496c43-a09b-4d30-8f7c-3379e0b94dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:58.425027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd496c43-a09b-4d30-8f7c-3379e0b94dcd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-cd496c43-a09b-4d30-8f7c-3379e0b94dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:02:58.439233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:02:58.440316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:02:58.441371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:02:58.441371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:02:58.441371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:02:58.441371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 622/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 16:02:58.446213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57016ac1-6e25-4617-96d1-f84bc18b0b44 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:58.553737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57016ac1-6e25-4617-96d1-f84bc18b0b44 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:58.586365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bd9ac-8c54-4c98-b76f-3390e19d6056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:58.587178 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bd9ac-8c54-4c98-b76f-3390e19d6056 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:58.587454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bd9ac-8c54-4c98-b76f-3390e19d6056 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:58.587722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bd9ac-8c54-4c98-b76f-3390e19d6056 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:58.588348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bd9ac-8c54-4c98-b76f-3390e19d6056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:58.588645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bd9ac-8c54-4c98-b76f-3390e19d6056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:58.590030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bd9ac-8c54-4c98-b76f-3390e19d6056 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:58.601370 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 603/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:02:58.607242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd496c43-a09b-4d30-8f7c-3379e0b94dcd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:58.699157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:58.705651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd496c43-a09b-4d30-8f7c-3379e0b94dcd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:58.739109 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72496c5-c764-4aa4-93d4-107ebf4035a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:58.739730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72496c5-c764-4aa4-93d4-107ebf4035a2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:58.740009 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72496c5-c764-4aa4-93d4-107ebf4035a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:58.740281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72496c5-c764-4aa4-93d4-107ebf4035a2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:58.747427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72496c5-c764-4aa4-93d4-107ebf4035a2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:58.748839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72496c5-c764-4aa4-93d4-107ebf4035a2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a72496c5-c764-4aa4-93d4-107ebf4035a2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:02:58.759549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:02:58.760665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:02:58.761762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:02:58.761762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:02:58.761762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:02:58.761762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:02:58.761762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:02:58.761762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:02:58.761762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:02:58.761762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:02:58.761762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:02:58.761762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:02:58.761762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 623/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:02:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:02:58.766902 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bd9ac-8c54-4c98-b76f-3390e19d6056 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:58.824119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:58.877303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bd9ac-8c54-4c98-b76f-3390e19d6056 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:58.910096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e5b30-63a6-4af5-b009-8f7965db19e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:58.910709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e5b30-63a6-4af5-b009-8f7965db19e5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:58.910979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e5b30-63a6-4af5-b009-8f7965db19e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:58.911296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e5b30-63a6-4af5-b009-8f7965db19e5 None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:58.912003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e5b30-63a6-4af5-b009-8f7965db19e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:58.912301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e5b30-63a6-4af5-b009-8f7965db19e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:58.913712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e5b30-63a6-4af5-b009-8f7965db19e5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:58.932040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 604/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Sep 8 16:02:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:02:58.937807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72496c5-c764-4aa4-93d4-107ebf4035a2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:59.035047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72496c5-c764-4aa4-93d4-107ebf4035a2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:59.066824 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26ee20-8810-42f4-bc2b-acf55531c381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:59.067435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26ee20-8810-42f4-bc2b-acf55531c381 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:59.067709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26ee20-8810-42f4-bc2b-acf55531c381 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:59.067975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26ee20-8810-42f4-bc2b-acf55531c381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:59.079352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26ee20-8810-42f4-bc2b-acf55531c381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:59.080713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26ee20-8810-42f4-bc2b-acf55531c381 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5f26ee20-8810-42f4-bc2b-acf55531c381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:02:59.095040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:02:59.097208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:02:59.098112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:02:59.098112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:02:59.098112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:02:59.098112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 624/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:02:59.102078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e5b30-63a6-4af5-b009-8f7965db19e5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:59.197922 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e5b30-63a6-4af5-b009-8f7965db19e5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:59.200217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:59.231955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f68c1a-72d2-4ea9-9093-5efc95ceefd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:59.232563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f68c1a-72d2-4ea9-9093-5efc95ceefd5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:59.232837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f68c1a-72d2-4ea9-9093-5efc95ceefd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:59.233164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f68c1a-72d2-4ea9-9093-5efc95ceefd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:59.233741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f68c1a-72d2-4ea9-9093-5efc95ceefd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:59.234041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f68c1a-72d2-4ea9-9093-5efc95ceefd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:59.235432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f68c1a-72d2-4ea9-9093-5efc95ceefd5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:59.247034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 605/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:02:59.252728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26ee20-8810-42f4-bc2b-acf55531c381 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:59.261857 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:59.353269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26ee20-8810-42f4-bc2b-acf55531c381 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:59.386231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011f178-88d1-4798-92f9-71d30bdc2a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:59.386922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011f178-88d1-4798-92f9-71d30bdc2a41 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:59.387201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011f178-88d1-4798-92f9-71d30bdc2a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:59.387470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011f178-88d1-4798-92f9-71d30bdc2a41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:59.395018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011f178-88d1-4798-92f9-71d30bdc2a41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:59.396446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011f178-88d1-4798-92f9-71d30bdc2a41 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9011f178-88d1-4798-92f9-71d30bdc2a41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:02:59.407753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:02:59.408767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:02:59.409681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:02:59.409681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:02:59.409681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:02:59.409681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:02:59.409681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:02:59.409681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:02:59.409681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:02:59.409681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:02:59.409681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 625/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:02:59.415361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f68c1a-72d2-4ea9-9093-5efc95ceefd5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:59.516317 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f68c1a-72d2-4ea9-9093-5efc95ceefd5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:59.548480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6def1-e048-4f56-8810-02cab524b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:59.549077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6def1-e048-4f56-8810-02cab524b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:59.549357 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6def1-e048-4f56-8810-02cab524b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:59.549632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6def1-e048-4f56-8810-02cab524b5e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:59.550319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6def1-e048-4f56-8810-02cab524b5e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:02:59.550626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6def1-e048-4f56-8810-02cab524b5e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:59.552124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6def1-e048-4f56-8810-02cab524b5e3 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:59.565541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 606/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:02:59.571588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011f178-88d1-4798-92f9-71d30bdc2a41 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:02:59.634706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:59.669079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011f178-88d1-4798-92f9-71d30bdc2a41 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:02:59.701041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe4cb8-f22b-4946-b974-fcb5b11d07b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:02:59.701688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe4cb8-f22b-4946-b974-fcb5b11d07b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:02:59.702499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe4cb8-f22b-4946-b974-fcb5b11d07b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:02:59.702804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe4cb8-f22b-4946-b974-fcb5b11d07b9 None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/7e6c855e2692410d83c78cc95cb4f37e/roles/7323f34f91ec4c9c90fc0e4e8a705ebb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:02:59.716190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe4cb8-f22b-4946-b974-fcb5b11d07b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=7e6c855e2692410d83c78cc95cb4f37e, role_id=7323f34f91ec4c9c90fc0e4e8a705ebb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:02:59.717639 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe4cb8-f22b-4946-b974-fcb5b11d07b9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:02:59.780657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 626/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 16:02:59 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/7e6c855e2692410d83c78cc95cb4f37e/roles/7323f34f91ec4c9c90fc0e4e8a705ebb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:03:01.922246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33777f04-c0c5-469e-a72f-b51d105010d6 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:01.922818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33777f04-c0c5-469e-a72f-b51d105010d6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:01.922818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33777f04-c0c5-469e-a72f-b51d105010d6 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:01.924176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 607/1233] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:03:01.929474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf9bd9-2d2a-452d-82fa-7a5a04e7ac5e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:01.929888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf9bd9-2d2a-452d-82fa-7a5a04e7ac5e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:01.930020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf9bd9-2d2a-452d-82fa-7a5a04e7ac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:01.948525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5dcf9bd9-2d2a-452d-82fa-7a5a04e7ac5e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:03:01.949721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5dcf9bd9-2d2a-452d-82fa-7a5a04e7ac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:03:02.015958 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 627/1234] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:03:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:03:02.287945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33777f04-c0c5-469e-a72f-b51d105010d6 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:02.313646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:02.386423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33777f04-c0c5-469e-a72f-b51d105010d6 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:02.419671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec62e7-c44e-4d04-9aa4-4a373cf8b104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:02.420328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec62e7-c44e-4d04-9aa4-4a373cf8b104 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:02.421416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec62e7-c44e-4d04-9aa4-4a373cf8b104 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:02.421726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec62e7-c44e-4d04-9aa4-4a373cf8b104 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:02.432900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec62e7-c44e-4d04-9aa4-4a373cf8b104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-20ec62e7-c44e-4d04-9aa4-4a373cf8b104 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:03:02.437751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:02.444499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:02.445525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 608/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Sep 8 16:03:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:02.447495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf9bd9-2d2a-452d-82fa-7a5a04e7ac5e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:02.492877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:02.543245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf9bd9-2d2a-452d-82fa-7a5a04e7ac5e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:02.577305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac747d-7d7c-4d31-b3d5-329a5d64aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:02.577916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac747d-7d7c-4d31-b3d5-329a5d64aab3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:02.578193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac747d-7d7c-4d31-b3d5-329a5d64aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:02.578465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac747d-7d7c-4d31-b3d5-329a5d64aab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:02.579153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac747d-7d7c-4d31-b3d5-329a5d64aab3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:02.579456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac747d-7d7c-4d31-b3d5-329a5d64aab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:02.580811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac747d-7d7c-4d31-b3d5-329a5d64aab3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:02.589218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 628/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Sep 8 16:03:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:02.595828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec62e7-c44e-4d04-9aa4-4a373cf8b104 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:02.679814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:02.695809 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec62e7-c44e-4d04-9aa4-4a373cf8b104 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:02.728528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf50f72-dfa4-4f90-b03e-2428e608ea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:02.729375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50f72-dfa4-4f90-b03e-2428e608ea23 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:02.729834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50f72-dfa4-4f90-b03e-2428e608ea23 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:02.730475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf50f72-dfa4-4f90-b03e-2428e608ea23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:02.740210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf50f72-dfa4-4f90-b03e-2428e608ea23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:02.745649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf50f72-dfa4-4f90-b03e-2428e608ea23 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-5cf50f72-dfa4-4f90-b03e-2428e608ea23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:03:02.757203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:02.758416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:03:02.759382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:03:02.759382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:02.759382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:02.759382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 609/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:02.764966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac747d-7d7c-4d31-b3d5-329a5d64aab3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:02.863894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac747d-7d7c-4d31-b3d5-329a5d64aab3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:02.872371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:02.897027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acd63f-2161-417b-b82a-ccf20eb5471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:02.897628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acd63f-2161-417b-b82a-ccf20eb5471c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:02.897904 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acd63f-2161-417b-b82a-ccf20eb5471c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:02.898173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acd63f-2161-417b-b82a-ccf20eb5471c None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:02.898916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acd63f-2161-417b-b82a-ccf20eb5471c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:02.899221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acd63f-2161-417b-b82a-ccf20eb5471c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:02.900578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acd63f-2161-417b-b82a-ccf20eb5471c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:02.913194 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 629/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:03:02.919380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf50f72-dfa4-4f90-b03e-2428e608ea23 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:03.019298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf50f72-dfa4-4f90-b03e-2428e608ea23 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:03.052574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd9224-a12a-4190-abe9-d79ddfe63acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:03.053190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9224-a12a-4190-abe9-d79ddfe63acf None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:03.053467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9224-a12a-4190-abe9-d79ddfe63acf None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:03.053738 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9224-a12a-4190-abe9-d79ddfe63acf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:03.056409 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:03.061384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd9224-a12a-4190-abe9-d79ddfe63acf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:03.062859 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd9224-a12a-4190-abe9-d79ddfe63acf None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-4bfd9224-a12a-4190-abe9-d79ddfe63acf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:03:03.073788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:03.075620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:03.077416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:03.077416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:03.077416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:03:03.077416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:03:03.077416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:03:03.077416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:03:03.077416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:03:03.077416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:03:03.077416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:03:03.077416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:03.077416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 610/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:03.081450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acd63f-2161-417b-b82a-ccf20eb5471c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:03.183219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acd63f-2161-417b-b82a-ccf20eb5471c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:03.222492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03080984-c265-43cc-b4ab-5b446d67ee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:03.223125 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03080984-c265-43cc-b4ab-5b446d67ee87 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:03.223401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03080984-c265-43cc-b4ab-5b446d67ee87 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:03.223669 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03080984-c265-43cc-b4ab-5b446d67ee87 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:03.224390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03080984-c265-43cc-b4ab-5b446d67ee87 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:03.224693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03080984-c265-43cc-b4ab-5b446d67ee87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:03.226250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03080984-c265-43cc-b4ab-5b446d67ee87 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:03.243255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 630/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Sep 8 16:03:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:03.249642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd9224-a12a-4190-abe9-d79ddfe63acf None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:03.347720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd9224-a12a-4190-abe9-d79ddfe63acf None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:03.380446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18835d15-d7d2-42e9-8ef5-1a4e07224e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:03.381050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18835d15-d7d2-42e9-8ef5-1a4e07224e85 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:03.381331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18835d15-d7d2-42e9-8ef5-1a4e07224e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:03.381603 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18835d15-d7d2-42e9-8ef5-1a4e07224e85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:03.442241 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:03.448794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18835d15-d7d2-42e9-8ef5-1a4e07224e85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:03.450251 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18835d15-d7d2-42e9-8ef5-1a4e07224e85 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:03.548987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 611/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:03:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:03:03.555148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03080984-c265-43cc-b4ab-5b446d67ee87 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:03.582159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:03.651766 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03080984-c265-43cc-b4ab-5b446d67ee87 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:03.684197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b91cb-804d-47e1-9d8e-ae222a545574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:03.684807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b91cb-804d-47e1-9d8e-ae222a545574 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:03.685079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b91cb-804d-47e1-9d8e-ae222a545574 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:03.685345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b91cb-804d-47e1-9d8e-ae222a545574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:03.695015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b91cb-804d-47e1-9d8e-ae222a545574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:03.696408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b91cb-804d-47e1-9d8e-ae222a545574 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c05b91cb-804d-47e1-9d8e-ae222a545574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:03:03.710901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:03.716379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:03:03.718174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:03:03.718174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:03.718174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:03.718174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 631/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:03.718464 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18835d15-d7d2-42e9-8ef5-1a4e07224e85 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:03.810257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:03.825495 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18835d15-d7d2-42e9-8ef5-1a4e07224e85 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:03.862888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067e553-f6e0-4898-bc3d-9cb401821663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:03.863481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067e553-f6e0-4898-bc3d-9cb401821663 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:03.863754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067e553-f6e0-4898-bc3d-9cb401821663 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:03.864019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067e553-f6e0-4898-bc3d-9cb401821663 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:03.864653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067e553-f6e0-4898-bc3d-9cb401821663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:03.865007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067e553-f6e0-4898-bc3d-9cb401821663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:03.866365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067e553-f6e0-4898-bc3d-9cb401821663 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:03.878377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 612/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:03.884357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b91cb-804d-47e1-9d8e-ae222a545574 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:03.963273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:03.984227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b91cb-804d-47e1-9d8e-ae222a545574 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:04.018158 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc774e-ea82-4f83-b0ad-24ba4096793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:04.018869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc774e-ea82-4f83-b0ad-24ba4096793c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:04.019144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc774e-ea82-4f83-b0ad-24ba4096793c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:04.019410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc774e-ea82-4f83-b0ad-24ba4096793c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:04.026427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc774e-ea82-4f83-b0ad-24ba4096793c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:04.027878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc774e-ea82-4f83-b0ad-24ba4096793c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e1fc774e-ea82-4f83-b0ad-24ba4096793c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:03:04.038773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:04.040495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:04.041555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:03:04.041555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:03:04.041555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:03:04.041555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:03:04.041555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:03:04.041555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:03:04.041555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:03:04.041555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:04.041555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 632/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:04.045824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067e553-f6e0-4898-bc3d-9cb401821663 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:04.147394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067e553-f6e0-4898-bc3d-9cb401821663 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:04.185572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb20868-0256-4b4b-b784-da72014687b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:04.186874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb20868-0256-4b4b-b784-da72014687b3 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:04.190820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb20868-0256-4b4b-b784-da72014687b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:04.190820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb20868-0256-4b4b-b784-da72014687b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:04.190820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb20868-0256-4b4b-b784-da72014687b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:04.190820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb20868-0256-4b4b-b784-da72014687b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:04.190820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb20868-0256-4b4b-b784-da72014687b3 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:04.202826 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 613/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:04.208946 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc774e-ea82-4f83-b0ad-24ba4096793c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:04.307741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc774e-ea82-4f83-b0ad-24ba4096793c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:04.340230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7558fa-dd7e-462d-8b01-226fe65be774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:04.340821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7558fa-dd7e-462d-8b01-226fe65be774 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:04.341091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7558fa-dd7e-462d-8b01-226fe65be774 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:04.341356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7558fa-dd7e-462d-8b01-226fe65be774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:04.342056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7558fa-dd7e-462d-8b01-226fe65be774 None admin] RBAC: Adding query filter params (role.id=7323f34f91ec4c9c90fc0e4e8a705ebb, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=7e6c855e2692410d83c78cc95cb4f37e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:04.342375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7558fa-dd7e-462d-8b01-226fe65be774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:04.343796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7558fa-dd7e-462d-8b01-226fe65be774 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:04.349468 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 633/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:03:04 2022] GET /identity/v3/role_assignments?user.id=7e6c855e2692410d83c78cc95cb4f37e&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=7323f34f91ec4c9c90fc0e4e8a705ebb => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:06.551638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b870a-4901-482a-b696-c507840d6585 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:06.552183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b870a-4901-482a-b696-c507840d6585 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:06.552183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b870a-4901-482a-b696-c507840d6585 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:06.553530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 614/1247] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:03:06.558996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931be4c0-0d13-4535-bdea-fb959f09122e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:06.559635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931be4c0-0d13-4535-bdea-fb959f09122e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:06.559635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931be4c0-0d13-4535-bdea-fb959f09122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:06.565900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:06.578337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-931be4c0-0d13-4535-bdea-fb959f09122e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:03:06.579557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-931be4c0-0d13-4535-bdea-fb959f09122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:03:06.644811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 634/1248] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:03:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:03:06.932111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b870a-4901-482a-b696-c507840d6585 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:06.950592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:07.033268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b870a-4901-482a-b696-c507840d6585 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:07.066283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c7ca1-6ae3-4ce0-8a6e-8c2c463b8ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:07.066935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7ca1-6ae3-4ce0-8a6e-8c2c463b8ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:07.067213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7ca1-6ae3-4ce0-8a6e-8c2c463b8ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:07.067483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7ca1-6ae3-4ce0-8a6e-8c2c463b8ae6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:07.078041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c7ca1-6ae3-4ce0-8a6e-8c2c463b8ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-777c7ca1-6ae3-4ce0-8a6e-8c2c463b8ae6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:03:07.083248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:07.084472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:03:07.085519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:07.086820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 615/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:03:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:07.090610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931be4c0-0d13-4535-bdea-fb959f09122e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:07.190342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931be4c0-0d13-4535-bdea-fb959f09122e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:07.219118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:07.223857 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b77bb-ab92-46aa-9c8c-a7b831122c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:07.224454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b77bb-ab92-46aa-9c8c-a7b831122c04 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:07.224725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b77bb-ab92-46aa-9c8c-a7b831122c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:07.224993 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b77bb-ab92-46aa-9c8c-a7b831122c04 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:07.225638 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b77bb-ab92-46aa-9c8c-a7b831122c04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:07.225931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b77bb-ab92-46aa-9c8c-a7b831122c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:07.227310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b77bb-ab92-46aa-9c8c-a7b831122c04 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:07.235094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 635/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:03:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:07.240991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c7ca1-6ae3-4ce0-8a6e-8c2c463b8ae6 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:07.318445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:07.341033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c7ca1-6ae3-4ce0-8a6e-8c2c463b8ae6 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:07.374875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afac7a2-f74f-4148-b765-b59def61d06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:07.375490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afac7a2-f74f-4148-b765-b59def61d06e None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:07.375761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afac7a2-f74f-4148-b765-b59def61d06e None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:07.376028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afac7a2-f74f-4148-b765-b59def61d06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:07.386952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afac7a2-f74f-4148-b765-b59def61d06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:07.388683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afac7a2-f74f-4148-b765-b59def61d06e None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-1afac7a2-f74f-4148-b765-b59def61d06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:03:07.403164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:07.407845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:03:07.409040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:03:07.409040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:07.409040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:07.409040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 616/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:07.410197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b77bb-ab92-46aa-9c8c-a7b831122c04 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:07.508649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b77bb-ab92-46aa-9c8c-a7b831122c04 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:07.541067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f51900-adc6-4167-8553-f6375c08cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:07.541707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f51900-adc6-4167-8553-f6375c08cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:07.541979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f51900-adc6-4167-8553-f6375c08cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:07.542245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f51900-adc6-4167-8553-f6375c08cdd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:07.542898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f51900-adc6-4167-8553-f6375c08cdd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:07.543261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f51900-adc6-4167-8553-f6375c08cdd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:07.544617 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f51900-adc6-4167-8553-f6375c08cdd2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:07.556515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 636/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:07.562796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afac7a2-f74f-4148-b765-b59def61d06e None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:07.663969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afac7a2-f74f-4148-b765-b59def61d06e None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:07.690249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:07.697586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c1687-78ab-4a84-aec1-ce206c8f794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:07.698208 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c1687-78ab-4a84-aec1-ce206c8f794b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:07.698482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c1687-78ab-4a84-aec1-ce206c8f794b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:07.698780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c1687-78ab-4a84-aec1-ce206c8f794b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:07.706481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c1687-78ab-4a84-aec1-ce206c8f794b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:07.707944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c1687-78ab-4a84-aec1-ce206c8f794b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-202c1687-78ab-4a84-aec1-ce206c8f794b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:03:07.718617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:07.719768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:07.720952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:07.720952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:07.720952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:03:07.720952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:03:07.720952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:03:07.720952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:03:07.720952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:03:07.720952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:03:07.720952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:03:07.720952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:07.720952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 617/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:07.725574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f51900-adc6-4167-8553-f6375c08cdd2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:07.780186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:07.823014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f51900-adc6-4167-8553-f6375c08cdd2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:07.855802 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9758e-3afd-4175-9866-49f883f38025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:07.856403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9758e-3afd-4175-9866-49f883f38025 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:07.856681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9758e-3afd-4175-9866-49f883f38025 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:07.856949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9758e-3afd-4175-9866-49f883f38025 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:07.857661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9758e-3afd-4175-9866-49f883f38025 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:07.857962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9758e-3afd-4175-9866-49f883f38025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:07.859553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9758e-3afd-4175-9866-49f883f38025 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:07.880203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 637/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Sep 8 16:03:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:07.886083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c1687-78ab-4a84-aec1-ce206c8f794b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:07.985412 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c1687-78ab-4a84-aec1-ce206c8f794b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:08.018674 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0f192-94f2-46ee-b6f9-30498b7103b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:08.019386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0f192-94f2-46ee-b6f9-30498b7103b6 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:08.019728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0f192-94f2-46ee-b6f9-30498b7103b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:08.019931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0f192-94f2-46ee-b6f9-30498b7103b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:08.077921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:08.089626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0f192-94f2-46ee-b6f9-30498b7103b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:08.091157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0f192-94f2-46ee-b6f9-30498b7103b6 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:08.188051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 618/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:03:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 16:03:08.194050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9758e-3afd-4175-9866-49f883f38025 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:08.292110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9758e-3afd-4175-9866-49f883f38025 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:08.307939 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:08.329152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecd4e7-0d22-4a64-9b97-3f43a4cdf34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:08.329715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd4e7-0d22-4a64-9b97-3f43a4cdf34d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:08.329987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd4e7-0d22-4a64-9b97-3f43a4cdf34d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:08.330254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecd4e7-0d22-4a64-9b97-3f43a4cdf34d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:08.340031 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecd4e7-0d22-4a64-9b97-3f43a4cdf34d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:08.341455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecd4e7-0d22-4a64-9b97-3f43a4cdf34d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1aecd4e7-0d22-4a64-9b97-3f43a4cdf34d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:03:08.355460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:08.356406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:03:08.357407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:03:08.357407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:08.357407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:08.357407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 638/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:08.363053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0f192-94f2-46ee-b6f9-30498b7103b6 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:08.450261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:08.462004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0f192-94f2-46ee-b6f9-30498b7103b6 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:08.496594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db459b2a-472c-4945-94f0-4b6f7d8f2588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:08.497198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db459b2a-472c-4945-94f0-4b6f7d8f2588 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:08.497476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db459b2a-472c-4945-94f0-4b6f7d8f2588 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:08.497748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db459b2a-472c-4945-94f0-4b6f7d8f2588 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:08.498406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db459b2a-472c-4945-94f0-4b6f7d8f2588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:08.498724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db459b2a-472c-4945-94f0-4b6f7d8f2588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:08.500142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db459b2a-472c-4945-94f0-4b6f7d8f2588 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:08.511548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 619/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:08.517545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecd4e7-0d22-4a64-9b97-3f43a4cdf34d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:08.615918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecd4e7-0d22-4a64-9b97-3f43a4cdf34d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:08.648532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663393a5-2b93-4112-b514-87f5febe5635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:08.649178 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663393a5-2b93-4112-b514-87f5febe5635 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:08.649449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663393a5-2b93-4112-b514-87f5febe5635 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:08.649715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663393a5-2b93-4112-b514-87f5febe5635 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:08.656833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663393a5-2b93-4112-b514-87f5febe5635 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:08.658257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663393a5-2b93-4112-b514-87f5febe5635 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-663393a5-2b93-4112-b514-87f5febe5635 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:03:08.669245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:08.673626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:08.674574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:03:08.674574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:03:08.674574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:03:08.674574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:03:08.674574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:03:08.674574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:03:08.674574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:03:08.674574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:08.674574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 639/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:08.676849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db459b2a-472c-4945-94f0-4b6f7d8f2588 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:08.775210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db459b2a-472c-4945-94f0-4b6f7d8f2588 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:08.808382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98be361-2e0a-45b7-8369-9cdcf7fe16cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:08.808970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98be361-2e0a-45b7-8369-9cdcf7fe16cd None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:08.809244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98be361-2e0a-45b7-8369-9cdcf7fe16cd None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:08.809514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98be361-2e0a-45b7-8369-9cdcf7fe16cd None admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:08.810192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98be361-2e0a-45b7-8369-9cdcf7fe16cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:08.810496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98be361-2e0a-45b7-8369-9cdcf7fe16cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:08.811982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98be361-2e0a-45b7-8369-9cdcf7fe16cd None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:08.823471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 620/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:08.830108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663393a5-2b93-4112-b514-87f5febe5635 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:08.855719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:08.929202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663393a5-2b93-4112-b514-87f5febe5635 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:08.962362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea696-b398-470e-8f89-8ec3155e3d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:08.962988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea696-b398-470e-8f89-8ec3155e3d8d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:08.963263 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea696-b398-470e-8f89-8ec3155e3d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:08.963531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea696-b398-470e-8f89-8ec3155e3d8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:08.964243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea696-b398-470e-8f89-8ec3155e3d8d None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=7e6c855e2692410d83c78cc95cb4f37e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:08.964549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea696-b398-470e-8f89-8ec3155e3d8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:08.965965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea696-b398-470e-8f89-8ec3155e3d8d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:08.971943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 640/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:03:08 2022] GET /identity/v3/role_assignments?user.id=7e6c855e2692410d83c78cc95cb4f37e&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=519b356d36364663a59265dc7eeff0b8 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:03:11.078983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26c98e-5f5f-4e41-865f-9eb4ea6e5039 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:11.079532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26c98e-5f5f-4e41-865f-9eb4ea6e5039 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:11.079532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26c98e-5f5f-4e41-865f-9eb4ea6e5039 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:11.080850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 621/1261] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:03:11.085825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305863b-fe50-47c4-a139-7ab50b37f5a6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:11.086216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305863b-fe50-47c4-a139-7ab50b37f5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:11.086419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305863b-fe50-47c4-a139-7ab50b37f5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:11.104110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7305863b-fe50-47c4-a139-7ab50b37f5a6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:03:11.105284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7305863b-fe50-47c4-a139-7ab50b37f5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:03:11.171412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 641/1262] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:03:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:03:11.440641 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26c98e-5f5f-4e41-865f-9eb4ea6e5039 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:11.451750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:11.539333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26c98e-5f5f-4e41-865f-9eb4ea6e5039 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:11.571694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0be01-ac61-47d7-998a-f1ff4f82db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:11.572323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0be01-ac61-47d7-998a-f1ff4f82db27 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:11.572579 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0be01-ac61-47d7-998a-f1ff4f82db27 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:11.572847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0be01-ac61-47d7-998a-f1ff4f82db27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:11.582477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0be01-ac61-47d7-998a-f1ff4f82db27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-9db0be01-ac61-47d7-998a-f1ff4f82db27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:03:11.587213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:11.588205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:11.589093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 622/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:03:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:11.594876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305863b-fe50-47c4-a139-7ab50b37f5a6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:11.613270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:11.689767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305863b-fe50-47c4-a139-7ab50b37f5a6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:11.722826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ce743-946b-4b79-a8a8-c709926dc0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:11.723422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce743-946b-4b79-a8a8-c709926dc0ce None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:11.723699 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce743-946b-4b79-a8a8-c709926dc0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:11.723966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ce743-946b-4b79-a8a8-c709926dc0ce None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:11.724610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ce743-946b-4b79-a8a8-c709926dc0ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:11.724906 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ce743-946b-4b79-a8a8-c709926dc0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:11.726257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ce743-946b-4b79-a8a8-c709926dc0ce None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:11.734722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 642/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:03:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:11.740381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0be01-ac61-47d7-998a-f1ff4f82db27 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:11.806980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:11.838907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0be01-ac61-47d7-998a-f1ff4f82db27 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:11.871359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff378c8-bec5-4df2-8748-9de2522d76f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:11.871989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff378c8-bec5-4df2-8748-9de2522d76f4 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:11.872263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff378c8-bec5-4df2-8748-9de2522d76f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:11.872530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff378c8-bec5-4df2-8748-9de2522d76f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:11.882507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff378c8-bec5-4df2-8748-9de2522d76f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:11.884057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff378c8-bec5-4df2-8748-9de2522d76f4 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-aff378c8-bec5-4df2-8748-9de2522d76f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:03:11.899868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:11.900921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:03:11.901831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:03:11.901831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:11.901831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:11.901831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 623/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:11.907516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ce743-946b-4b79-a8a8-c709926dc0ce None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:11.987284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:12.006388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ce743-946b-4b79-a8a8-c709926dc0ce None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:12.038789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742a2b-891a-4697-b151-3fa78eeb4d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:12.039379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742a2b-891a-4697-b151-3fa78eeb4d37 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:12.039648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742a2b-891a-4697-b151-3fa78eeb4d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:12.039912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742a2b-891a-4697-b151-3fa78eeb4d37 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:12.040533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03742a2b-891a-4697-b151-3fa78eeb4d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:12.040827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03742a2b-891a-4697-b151-3fa78eeb4d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:12.042268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03742a2b-891a-4697-b151-3fa78eeb4d37 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:12.053995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 643/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:12.059789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff378c8-bec5-4df2-8748-9de2522d76f4 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:12.157790 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff378c8-bec5-4df2-8748-9de2522d76f4 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:12.179407 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:12.193882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852db787-a77e-49f5-be16-851164981d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:12.194513 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db787-a77e-49f5-be16-851164981d00 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:12.194835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db787-a77e-49f5-be16-851164981d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:12.195110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db787-a77e-49f5-be16-851164981d00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:12.203130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852db787-a77e-49f5-be16-851164981d00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:12.204571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852db787-a77e-49f5-be16-851164981d00 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-852db787-a77e-49f5-be16-851164981d00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:03:12.215433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:12.216534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:12.217661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:12.217661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:12.217661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:03:12.217661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:03:12.217661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:03:12.217661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:03:12.217661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:03:12.217661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:03:12.217661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:03:12.217661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:12.217661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 624/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:12.222361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742a2b-891a-4697-b151-3fa78eeb4d37 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:12.319219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742a2b-891a-4697-b151-3fa78eeb4d37 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:12.352410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2cbde-ff51-457d-adcb-9cba0b2a2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:12.353002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2cbde-ff51-457d-adcb-9cba0b2a2df8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:12.353272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2cbde-ff51-457d-adcb-9cba0b2a2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:12.353534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2cbde-ff51-457d-adcb-9cba0b2a2df8 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:12.354239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2cbde-ff51-457d-adcb-9cba0b2a2df8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:12.354538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2cbde-ff51-457d-adcb-9cba0b2a2df8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:12.355972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2cbde-ff51-457d-adcb-9cba0b2a2df8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:12.364331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:12.372275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 644/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Sep 8 16:03:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:12.378690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852db787-a77e-49f5-be16-851164981d00 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:12.480852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852db787-a77e-49f5-be16-851164981d00 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:12.514493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552e268-f0d8-455b-86b2-68d072f320c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:12.515134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e268-f0d8-455b-86b2-68d072f320c6 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:12.518651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e268-f0d8-455b-86b2-68d072f320c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:12.518651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e268-f0d8-455b-86b2-68d072f320c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:12.525924 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552e268-f0d8-455b-86b2-68d072f320c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:12.527395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552e268-f0d8-455b-86b2-68d072f320c6 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-4552e268-f0d8-455b-86b2-68d072f320c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:03:12.540996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:12.543728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:03:12.545371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:03:12.545371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:12.545371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:12.545371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 625/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:12.548498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2cbde-ff51-457d-adcb-9cba0b2a2df8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:12.647571 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2cbde-ff51-457d-adcb-9cba0b2a2df8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:12.680741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f90e4-5239-4404-85fe-2dff86448845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:12.681337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f90e4-5239-4404-85fe-2dff86448845 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:12.681609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f90e4-5239-4404-85fe-2dff86448845 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:12.681872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f90e4-5239-4404-85fe-2dff86448845 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:12.682611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f90e4-5239-4404-85fe-2dff86448845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:12.682943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f90e4-5239-4404-85fe-2dff86448845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:12.684284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f90e4-5239-4404-85fe-2dff86448845 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:12.695918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 645/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:12.701739 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552e268-f0d8-455b-86b2-68d072f320c6 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:12.733283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:12.800264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552e268-f0d8-455b-86b2-68d072f320c6 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:12.834735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fe67e-5b1e-4703-92a1-add553b121ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:12.835357 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fe67e-5b1e-4703-92a1-add553b121ad None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:12.835635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fe67e-5b1e-4703-92a1-add553b121ad None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:12.835906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fe67e-5b1e-4703-92a1-add553b121ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:12.842446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fe67e-5b1e-4703-92a1-add553b121ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:12.843940 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fe67e-5b1e-4703-92a1-add553b121ad None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-f88fe67e-5b1e-4703-92a1-add553b121ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:03:12.855676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:12.856804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:12.858333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:03:12.858333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:03:12.858333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:03:12.858333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:03:12.858333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:03:12.858333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:03:12.858333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:03:12.858333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:12.858333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 626/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:12.863252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f90e4-5239-4404-85fe-2dff86448845 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:12.922218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:12.961810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f90e4-5239-4404-85fe-2dff86448845 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:12.995164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e87858-3761-4d0f-b7ce-3659c4233626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:12.995758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87858-3761-4d0f-b7ce-3659c4233626 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:12.996099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87858-3761-4d0f-b7ce-3659c4233626 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:12.996465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87858-3761-4d0f-b7ce-3659c4233626 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:12.997391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e87858-3761-4d0f-b7ce-3659c4233626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:12.997873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e87858-3761-4d0f-b7ce-3659c4233626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:12.999856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e87858-3761-4d0f-b7ce-3659c4233626 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:13.011996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 646/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:03:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:13.018169 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fe67e-5b1e-4703-92a1-add553b121ad None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:13.104880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:13.113653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fe67e-5b1e-4703-92a1-add553b121ad None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:13.146044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa833e-fc85-4a26-beac-e611263dfc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:13.146705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa833e-fc85-4a26-beac-e611263dfc2c None admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:13.146980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa833e-fc85-4a26-beac-e611263dfc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:13.147247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa833e-fc85-4a26-beac-e611263dfc2c None admin] PATH_INFO: `/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/7e6c855e2692410d83c78cc95cb4f37e/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:13.149125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa833e-fc85-4a26-beac-e611263dfc2c None admin] RBAC: Authorizing `identity:create_grant(project_id=daac4b88e8e447d2843ce79a4ca1ed4c, user_id=7e6c855e2692410d83c78cc95cb4f37e, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:13.150595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa833e-fc85-4a26-beac-e611263dfc2c None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:13.231631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 627/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Sep 8 16:03:13 2022] PUT /identity/v3/projects/daac4b88e8e447d2843ce79a4ca1ed4c/users/7e6c855e2692410d83c78cc95cb4f37e/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:03:15.387524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e087-8ce7-415d-aae4-fb5bb9b7815e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:15.388337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e087-8ce7-415d-aae4-fb5bb9b7815e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:15.388337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e087-8ce7-415d-aae4-fb5bb9b7815e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:15.390289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 647/1274] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:03:15.395489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dc85d-e6c2-4766-a03b-1d6ff9b07fb7 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:15.395892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dc85d-e6c2-4766-a03b-1d6ff9b07fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:15.396034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dc85d-e6c2-4766-a03b-1d6ff9b07fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:15.414062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-665dc85d-e6c2-4766-a03b-1d6ff9b07fb7 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:03:15.415275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-665dc85d-e6c2-4766-a03b-1d6ff9b07fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:03:15.480474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 628/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:03:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:03:15.750393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59e087-8ce7-415d-aae4-fb5bb9b7815e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:15.849020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59e087-8ce7-415d-aae4-fb5bb9b7815e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:15.866410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:15.883164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f33e60-126c-4cf5-ab20-1a510a4f38e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:15.883782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f33e60-126c-4cf5-ab20-1a510a4f38e5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:15.884055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f33e60-126c-4cf5-ab20-1a510a4f38e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:15.884340 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f33e60-126c-4cf5-ab20-1a510a4f38e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:15.894477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f33e60-126c-4cf5-ab20-1a510a4f38e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-92f33e60-126c-4cf5-ab20-1a510a4f38e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 16:03:15.899249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:15.907037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:15.908087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 648/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Sep 8 16:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:15.908959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dc85d-e6c2-4766-a03b-1d6ff9b07fb7 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:15.986531 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:16.003698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dc85d-e6c2-4766-a03b-1d6ff9b07fb7 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:16.037191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35cebd-7762-4050-bf7f-5ae69c033f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:16.037787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cebd-7762-4050-bf7f-5ae69c033f7f None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:16.038064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cebd-7762-4050-bf7f-5ae69c033f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:16.038332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cebd-7762-4050-bf7f-5ae69c033f7f None admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:16.039016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35cebd-7762-4050-bf7f-5ae69c033f7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:16.039315 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35cebd-7762-4050-bf7f-5ae69c033f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:16.040675 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35cebd-7762-4050-bf7f-5ae69c033f7f None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:16.048942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 629/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Sep 8 16:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:16.054950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f33e60-126c-4cf5-ab20-1a510a4f38e5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:16.155883 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f33e60-126c-4cf5-ab20-1a510a4f38e5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:16.194026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb36898-0a70-4efc-89c2-34e3eaeb45d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:16.194820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb36898-0a70-4efc-89c2-34e3eaeb45d2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:16.195149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb36898-0a70-4efc-89c2-34e3eaeb45d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:16.195426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb36898-0a70-4efc-89c2-34e3eaeb45d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:16.206518 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb36898-0a70-4efc-89c2-34e3eaeb45d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:16.208002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb36898-0a70-4efc-89c2-34e3eaeb45d2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ecb36898-0a70-4efc-89c2-34e3eaeb45d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:03:16.223239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:16.224465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:03:16.225547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:03:16.225547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:16.225547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:16.225547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 649/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:16.230189 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35cebd-7762-4050-bf7f-5ae69c033f7f None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:16.330094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35cebd-7762-4050-bf7f-5ae69c033f7f None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:16.363607 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43dc04-6b4b-4dbf-86fb-c3fdbae6db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:16.364213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43dc04-6b4b-4dbf-86fb-c3fdbae6db98 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:16.364490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43dc04-6b4b-4dbf-86fb-c3fdbae6db98 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:16.364759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43dc04-6b4b-4dbf-86fb-c3fdbae6db98 None admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:16.365394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43dc04-6b4b-4dbf-86fb-c3fdbae6db98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:16.365696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43dc04-6b4b-4dbf-86fb-c3fdbae6db98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:16.367180 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43dc04-6b4b-4dbf-86fb-c3fdbae6db98 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:16.378363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 630/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:16.384203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb36898-0a70-4efc-89c2-34e3eaeb45d2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:16.415690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:16.482616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb36898-0a70-4efc-89c2-34e3eaeb45d2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:16.515279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6915c-7a2c-422d-9138-3d89f97f5e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:16.516215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6915c-7a2c-422d-9138-3d89f97f5e20 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:16.516215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6915c-7a2c-422d-9138-3d89f97f5e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:16.516409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6915c-7a2c-422d-9138-3d89f97f5e20 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:16.523812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6915c-7a2c-422d-9138-3d89f97f5e20 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:16.525219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6915c-7a2c-422d-9138-3d89f97f5e20 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9ef6915c-7a2c-422d-9138-3d89f97f5e20 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 16:03:16.535934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:16.537023 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:16.538171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:16.538171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:16.538171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 16:03:16.538171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 16:03:16.538171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 16:03:16.538171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 16:03:16.538171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 16:03:16.538171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 16:03:16.538171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 16:03:16.538171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:16.538171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 650/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:16.545085 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43dc04-6b4b-4dbf-86fb-c3fdbae6db98 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:16.547384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:16.644751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43dc04-6b4b-4dbf-86fb-c3fdbae6db98 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:16.677712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901ce16-0108-4532-ba8f-66e2f46bf71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:16.678301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901ce16-0108-4532-ba8f-66e2f46bf71b None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:16.678571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901ce16-0108-4532-ba8f-66e2f46bf71b None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:16.678865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901ce16-0108-4532-ba8f-66e2f46bf71b None admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:16.679580 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901ce16-0108-4532-ba8f-66e2f46bf71b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:16.679873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901ce16-0108-4532-ba8f-66e2f46bf71b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:16.681287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901ce16-0108-4532-ba8f-66e2f46bf71b None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:16.698295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 631/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Sep 8 16:03:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:16.704217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6915c-7a2c-422d-9138-3d89f97f5e20 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:16.791276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:16.801131 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6915c-7a2c-422d-9138-3d89f97f5e20 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:16.832457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010346f4-4786-4df6-a302-86e85dcfcdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:16.833045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010346f4-4786-4df6-a302-86e85dcfcdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:16.833320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010346f4-4786-4df6-a302-86e85dcfcdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:16.833591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010346f4-4786-4df6-a302-86e85dcfcdb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:16.900035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010346f4-4786-4df6-a302-86e85dcfcdb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:16.901380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010346f4-4786-4df6-a302-86e85dcfcdb3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:16.988520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:16.998169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 651/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Sep 8 16:03:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 16:03:17.004040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901ce16-0108-4532-ba8f-66e2f46bf71b None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:17.064465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:17.102059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901ce16-0108-4532-ba8f-66e2f46bf71b None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:17.134649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8e69a-f5d1-40c1-8efe-2af3bfb84356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:17.136046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e69a-f5d1-40c1-8efe-2af3bfb84356 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:17.136350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e69a-f5d1-40c1-8efe-2af3bfb84356 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:17.136626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8e69a-f5d1-40c1-8efe-2af3bfb84356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:17.147841 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8e69a-f5d1-40c1-8efe-2af3bfb84356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:17.149287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8e69a-f5d1-40c1-8efe-2af3bfb84356 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-6db8e69a-f5d1-40c1-8efe-2af3bfb84356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 16:03:17.165493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:17.166614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 16:03:17.167592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 16:03:17.167592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 16:03:17.167592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:17.167592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 632/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:17.171307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010346f4-4786-4df6-a302-86e85dcfcdb3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:17.279572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010346f4-4786-4df6-a302-86e85dcfcdb3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:17.312411 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f9fcc-2f22-4441-b595-efbc233dd286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:17.313010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9fcc-2f22-4441-b595-efbc233dd286 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:17.313289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9fcc-2f22-4441-b595-efbc233dd286 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:17.313556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9fcc-2f22-4441-b595-efbc233dd286 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:17.314184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f9fcc-2f22-4441-b595-efbc233dd286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:17.314481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f9fcc-2f22-4441-b595-efbc233dd286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:17.315971 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f9fcc-2f22-4441-b595-efbc233dd286 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:17.327402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 652/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Sep 8 16:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:17.333672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8e69a-f5d1-40c1-8efe-2af3bfb84356 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:17.431987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8e69a-f5d1-40c1-8efe-2af3bfb84356 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:17.445568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:17.464986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1bee-e49c-4d3b-a4aa-ff7c97e956ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:17.465605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1bee-e49c-4d3b-a4aa-ff7c97e956ae None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:17.465884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1bee-e49c-4d3b-a4aa-ff7c97e956ae None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:17.466156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1bee-e49c-4d3b-a4aa-ff7c97e956ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:17.472470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea1bee-e49c-4d3b-a4aa-ff7c97e956ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:17.473915 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea1bee-e49c-4d3b-a4aa-ff7c97e956ae None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application [None req-ddea1bee-e49c-4d3b-a4aa-ff7c97e956ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 16:03:17.484990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:17.486062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:17.487192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 16:03:17.487192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 16:03:17.487192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 16:03:17.487192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 16:03:17.487192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 16:03:17.487192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 16:03:17.487192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 16:03:17.487192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: ERROR keystone.server.flask.application Sep 08 16:03:17.487192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 633/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Sep 8 16:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:17.492078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f9fcc-2f22-4441-b595-efbc233dd286 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:17.541798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:17.592188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f9fcc-2f22-4441-b595-efbc233dd286 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:17.625390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de0235-7dc6-49b1-b4ac-10b606632035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:17.625978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de0235-7dc6-49b1-b4ac-10b606632035 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:17.626256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de0235-7dc6-49b1-b4ac-10b606632035 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:17.626523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de0235-7dc6-49b1-b4ac-10b606632035 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:17.627226 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de0235-7dc6-49b1-b4ac-10b606632035 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:17.627525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de0235-7dc6-49b1-b4ac-10b606632035 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:17.628965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de0235-7dc6-49b1-b4ac-10b606632035 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:17.641339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 653/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Sep 8 16:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:17.647584 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1bee-e49c-4d3b-a4aa-ff7c97e956ae None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:17.743573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1bee-e49c-4d3b-a4aa-ff7c97e956ae None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:17.777279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159e568-a7b7-403f-ad32-1c479635b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:17.777875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159e568-a7b7-403f-ad32-1c479635b3fc None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:17.778153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159e568-a7b7-403f-ad32-1c479635b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:17.778425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159e568-a7b7-403f-ad32-1c479635b3fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:17.779236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159e568-a7b7-403f-ad32-1c479635b3fc None admin] RBAC: Adding query filter params (role.id=519b356d36364663a59265dc7eeff0b8, scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c, user.id=7e6c855e2692410d83c78cc95cb4f37e) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:17.779543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159e568-a7b7-403f-ad32-1c479635b3fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:17.780968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159e568-a7b7-403f-ad32-1c479635b3fc None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:17.786563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 634/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Sep 8 16:03:17 2022] GET /identity/v3/role_assignments?user.id=7e6c855e2692410d83c78cc95cb4f37e&scope.project.id=daac4b88e8e447d2843ce79a4ca1ed4c&role.id=519b356d36364663a59265dc7eeff0b8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:19.977833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa808-c3d3-49d5-bfed-b0c59395d8d6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:19.978387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa808-c3d3-49d5-bfed-b0c59395d8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:19.978387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fa808-c3d3-49d5-bfed-b0c59395d8d6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:19.979787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 654/1288] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:03:19.984916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c057ff-210d-44e5-b926-677ef7291295 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:19.985313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c057ff-210d-44e5-b926-677ef7291295 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:19.985474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c057ff-210d-44e5-b926-677ef7291295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:20.003984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-16c057ff-210d-44e5-b926-677ef7291295 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:03:20.005171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-16c057ff-210d-44e5-b926-677ef7291295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:03:20.034264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:20.071996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 635/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:03:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:03:20.338852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fa808-c3d3-49d5-bfed-b0c59395d8d6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:20.438638 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fa808-c3d3-49d5-bfed-b0c59395d8d6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:20.449196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:20.471800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142a6ff-0220-4062-9427-cf834088a1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:20.472422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142a6ff-0220-4062-9427-cf834088a1bd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:20.472698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142a6ff-0220-4062-9427-cf834088a1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:20.472967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142a6ff-0220-4062-9427-cf834088a1bd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:20.473536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142a6ff-0220-4062-9427-cf834088a1bd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:20.476786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142a6ff-0220-4062-9427-cf834088a1bd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1142a6ff-0220-4062-9427-cf834088a1bd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:20.484111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:20.485319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:20.486163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 655/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Sep 8 16:03:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:20.491468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c057ff-210d-44e5-b926-677ef7291295 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:20.586267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c057ff-210d-44e5-b926-677ef7291295 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:20.623845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd589d38-b95a-4226-9bde-b7e1a0531b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:20.623845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd589d38-b95a-4226-9bde-b7e1a0531b3a None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:20.623845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd589d38-b95a-4226-9bde-b7e1a0531b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:20.623845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd589d38-b95a-4226-9bde-b7e1a0531b3a None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:20.624236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd589d38-b95a-4226-9bde-b7e1a0531b3a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:20.624236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd589d38-b95a-4226-9bde-b7e1a0531b3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:20.624405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd589d38-b95a-4226-9bde-b7e1a0531b3a None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:20.629027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 636/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Sep 8 16:03:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:20.634828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142a6ff-0220-4062-9427-cf834088a1bd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:20.730956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142a6ff-0220-4062-9427-cf834088a1bd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:20.763830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cdfe6-9b9c-4cf3-bac8-eb9c93f54ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:20.764417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cdfe6-9b9c-4cf3-bac8-eb9c93f54ccb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:20.764689 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cdfe6-9b9c-4cf3-bac8-eb9c93f54ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:20.764957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cdfe6-9b9c-4cf3-bac8-eb9c93f54ccb None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:20.765565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cdfe6-9b9c-4cf3-bac8-eb9c93f54ccb None admin] RBAC: Adding query filter params (type=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:20.765859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cdfe6-9b9c-4cf3-bac8-eb9c93f54ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:20.767227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cdfe6-9b9c-4cf3-bac8-eb9c93f54ccb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:20.771457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 656/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Sep 8 16:03:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:22.936813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50585c4c-e86d-405d-8398-36ba99f351c7 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:22.937402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50585c4c-e86d-405d-8398-36ba99f351c7 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:22.937402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50585c4c-e86d-405d-8398-36ba99f351c7 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:22.938732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 637/1293] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:03:22.943870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb0108-8ed8-4872-8deb-2eee109695d8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:22.944295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb0108-8ed8-4872-8deb-2eee109695d8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:22.944436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb0108-8ed8-4872-8deb-2eee109695d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:22.963000 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cedb0108-8ed8-4872-8deb-2eee109695d8 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:03:22.964197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cedb0108-8ed8-4872-8deb-2eee109695d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:03:22.993065 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:23.029397 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 657/1294] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:03:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:03:23.299615 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50585c4c-e86d-405d-8398-36ba99f351c7 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:23.330247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:23.397946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50585c4c-e86d-405d-8398-36ba99f351c7 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:23.431956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdb2e1-d2c2-4082-8cc2-3ac34eacb0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:23.432558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb2e1-d2c2-4082-8cc2-3ac34eacb0e8 None admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:23.432830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb2e1-d2c2-4082-8cc2-3ac34eacb0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:23.433094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb2e1-d2c2-4082-8cc2-3ac34eacb0e8 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:23.433742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdb2e1-d2c2-4082-8cc2-3ac34eacb0e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:23.435174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdb2e1-d2c2-4082-8cc2-3ac34eacb0e8 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:23.525139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 638/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Sep 8 16:03:23 2022] POST /identity/v3/services => generated 246 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:03:25.684805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb5cc5-87a0-4b4d-a0a2-aa8ee3744afc None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:25.685318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb5cc5-87a0-4b4d-a0a2-aa8ee3744afc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:25.685420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb5cc5-87a0-4b4d-a0a2-aa8ee3744afc None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:25.686722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 658/1296] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:03:25.691904 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3052-cfe3-471c-9d3b-b7dd2697d570 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:25.692293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3052-cfe3-471c-9d3b-b7dd2697d570 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:25.692519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3052-cfe3-471c-9d3b-b7dd2697d570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:25.710162 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-6f7a3052-cfe3-471c-9d3b-b7dd2697d570 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:03:25.711389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6f7a3052-cfe3-471c-9d3b-b7dd2697d570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:03:25.781510 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 639/1297] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:03:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:03:26.046957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb5cc5-87a0-4b4d-a0a2-aa8ee3744afc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:26.146682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb5cc5-87a0-4b4d-a0a2-aa8ee3744afc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:26.180529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9eb6c-d547-4357-a1ba-172d9f18d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:26.181142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9eb6c-d547-4357-a1ba-172d9f18d335 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:26.181414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9eb6c-d547-4357-a1ba-172d9f18d335 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:26.181677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9eb6c-d547-4357-a1ba-172d9f18d335 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:26.182247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9eb6c-d547-4357-a1ba-172d9f18d335 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:26.183616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9eb6c-d547-4357-a1ba-172d9f18d335 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d6e9eb6c-d547-4357-a1ba-172d9f18d335 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:26.192155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:26.193499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:26.194718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 659/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Sep 8 16:03:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:26.199206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a3052-cfe3-471c-9d3b-b7dd2697d570 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:26.217764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:26.295509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a3052-cfe3-471c-9d3b-b7dd2697d570 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:26.328734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ebf75-2874-45ea-9969-1ff3627741c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:26.329272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ebf75-2874-45ea-9969-1ff3627741c5 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:26.329546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ebf75-2874-45ea-9969-1ff3627741c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:26.329813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ebf75-2874-45ea-9969-1ff3627741c5 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:26.330426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ebf75-2874-45ea-9969-1ff3627741c5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:26.330750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ebf75-2874-45ea-9969-1ff3627741c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:26.332103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ebf75-2874-45ea-9969-1ff3627741c5 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:26.337147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 640/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Sep 8 16:03:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:26.343721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9eb6c-d547-4357-a1ba-172d9f18d335 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:26.374654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:26.440685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9eb6c-d547-4357-a1ba-172d9f18d335 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:26.473301 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669247e-e747-4825-94a7-5acfd6913afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:26.473894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669247e-e747-4825-94a7-5acfd6913afd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:26.474167 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669247e-e747-4825-94a7-5acfd6913afd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:26.474435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669247e-e747-4825-94a7-5acfd6913afd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:26.475145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669247e-e747-4825-94a7-5acfd6913afd None admin] RBAC: Adding query filter params (interface=public, service_id=c9fb4d90c2cc465b8c07a54c142bec8c, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:26.475445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669247e-e747-4825-94a7-5acfd6913afd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:26.476785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669247e-e747-4825-94a7-5acfd6913afd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:26.481589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 660/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Sep 8 16:03:26 2022] GET /identity/v3/endpoints?service_id=c9fb4d90c2cc465b8c07a54c142bec8c&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:26.487408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ebf75-2874-45ea-9969-1ff3627741c5 None admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:26.566624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:26.584369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ebf75-2874-45ea-9969-1ff3627741c5 None admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:26.616187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ff800-df07-4bbd-974f-593448407aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:26.616786 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ff800-df07-4bbd-974f-593448407aee None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:26.617064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ff800-df07-4bbd-974f-593448407aee None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:26.617336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ff800-df07-4bbd-974f-593448407aee None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:26.617934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ff800-df07-4bbd-974f-593448407aee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:26.619356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ff800-df07-4bbd-974f-593448407aee None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:26.626703 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 641/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Sep 8 16:03:26 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:03:28.750350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12334df3-f726-470a-a44f-d2e1fb081bba None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:28.750925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12334df3-f726-470a-a44f-d2e1fb081bba None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:28.750925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12334df3-f726-470a-a44f-d2e1fb081bba None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:28.752262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 661/1302] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:03:28.757479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56fffe-43cd-4600-b206-d71d087c40c6 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:28.761548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56fffe-43cd-4600-b206-d71d087c40c6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:28.761548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56fffe-43cd-4600-b206-d71d087c40c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:28.776648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-ce56fffe-43cd-4600-b206-d71d087c40c6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:03:28.777838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ce56fffe-43cd-4600-b206-d71d087c40c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:03:28.843762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 642/1303] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:03:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 16:03:29.111447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12334df3-f726-470a-a44f-d2e1fb081bba None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:29.213511 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:29.220849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12334df3-f726-470a-a44f-d2e1fb081bba None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:29.253024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e45a0e-380a-43aa-9d49-ee0c9d35764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:29.253643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e45a0e-380a-43aa-9d49-ee0c9d35764a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:29.253918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e45a0e-380a-43aa-9d49-ee0c9d35764a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:29.254187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e45a0e-380a-43aa-9d49-ee0c9d35764a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:29.254789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e45a0e-380a-43aa-9d49-ee0c9d35764a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:29.256134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e45a0e-380a-43aa-9d49-ee0c9d35764a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-17e45a0e-380a-43aa-9d49-ee0c9d35764a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 16:03:29.265407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 16:03:29.266590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Sep 08 16:03:29.267738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 662/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Sep 8 16:03:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 16:03:29.272582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56fffe-43cd-4600-b206-d71d087c40c6 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:29.346943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:29.368394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56fffe-43cd-4600-b206-d71d087c40c6 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:29.402953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fc682-a39a-46f1-a10d-f0fb54b83655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:29.403553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fc682-a39a-46f1-a10d-f0fb54b83655 None admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:29.403827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fc682-a39a-46f1-a10d-f0fb54b83655 None admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:29.404096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fc682-a39a-46f1-a10d-f0fb54b83655 None admin] PATH_INFO: `/v3/services` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:29.404731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fc682-a39a-46f1-a10d-f0fb54b83655 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:03:29.405026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fc682-a39a-46f1-a10d-f0fb54b83655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:29.406411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fc682-a39a-46f1-a10d-f0fb54b83655 None admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:29.411527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 643/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Sep 8 16:03:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:03:29.417346 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e45a0e-380a-43aa-9d49-ee0c9d35764a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:03:29.513967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e45a0e-380a-43aa-9d49-ee0c9d35764a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:03:29.553751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ea80f-a2cf-49a6-9ca7-775a64734e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:03:29.554354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ea80f-a2cf-49a6-9ca7-775a64734e68 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:03:29.554630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ea80f-a2cf-49a6-9ca7-775a64734e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:03:29.555015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ea80f-a2cf-49a6-9ca7-775a64734e68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:03:29.555667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ea80f-a2cf-49a6-9ca7-775a64734e68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:03:29.557031 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ea80f-a2cf-49a6-9ca7-775a64734e68 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:03:29.648617 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 663/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:03:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:03:39.408447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=30 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:03:39.644005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:17.350445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afd02c-3a58-4d23-82aa-38b4fbc2746a None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:17.350952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afd02c-3a58-4d23-82aa-38b4fbc2746a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:17.351034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afd02c-3a58-4d23-82aa-38b4fbc2746a None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:17.357640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade927da-c328-4978-bee1-825d97c77f13 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:17.358028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade927da-c328-4978-bee1-825d97c77f13 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:17.358117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade927da-c328-4978-bee1-825d97c77f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:17.363273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 644/1307] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:17 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:17.455708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ade927da-c328-4978-bee1-825d97c77f13 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:17.456985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ade927da-c328-4978-bee1-825d97c77f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:17.619957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 664/1308] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:09:17.926648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a17ba6-e9d2-48b5-9348-82e82632f78a None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:17.926878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a17ba6-e9d2-48b5-9348-82e82632f78a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:17.927132 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a17ba6-e9d2-48b5-9348-82e82632f78a None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:17.928925 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 645/1309] 10.222.0.23 () {54 vars in 965 bytes} [Thu Sep 8 16:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:17.935404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d92d2-6ba7-4b3d-af3f-be552ecdd2c7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:17.935714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d92d2-6ba7-4b3d-af3f-be552ecdd2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:17.935954 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d92d2-6ba7-4b3d-af3f-be552ecdd2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:18.033974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cd4d92d2-6ba7-4b3d-af3f-be552ecdd2c7 None None] MFA Rules not processed for user `e08c9de660c04ed98f6100be2d687ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:18.035300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cd4d92d2-6ba7-4b3d-af3f-be552ecdd2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:18.063659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:18.125130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 665/1310] 10.222.0.23 () {58 vars in 1062 bytes} [Thu Sep 8 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:18.134645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a17ba6-e9d2-48b5-9348-82e82632f78a None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:18.136495 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b2a17ba6-e9d2-48b5-9348-82e82632f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:18.248417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a17ba6-e9d2-48b5-9348-82e82632f78a None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:18.323684 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee347dd-7eb1-4df6-90db-cf88a93b3305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:18.324300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee347dd-7eb1-4df6-90db-cf88a93b3305 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:18.324576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee347dd-7eb1-4df6-90db-cf88a93b3305 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:18.324846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee347dd-7eb1-4df6-90db-cf88a93b3305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:18.326445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1ee347dd-7eb1-4df6-90db-cf88a93b3305 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:18.383564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:18.445906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee347dd-7eb1-4df6-90db-cf88a93b3305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:18.447416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee347dd-7eb1-4df6-90db-cf88a93b3305 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:18.467259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 646/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:20.906129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b24fdb-f8ed-43b4-82e3-1573656a3e12 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:20.906738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b24fdb-f8ed-43b4-82e3-1573656a3e12 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:20.906839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b24fdb-f8ed-43b4-82e3-1573656a3e12 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:20.908408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 666/1312] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:20.913905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0eeafd-2a8d-40ea-912c-7e3735afec72 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:20.914327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0eeafd-2a8d-40ea-912c-7e3735afec72 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:20.914437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0eeafd-2a8d-40ea-912c-7e3735afec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:20.985531 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-bf0eeafd-2a8d-40ea-912c-7e3735afec72 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:20.986766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-bf0eeafd-2a8d-40ea-912c-7e3735afec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:21.084356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 647/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:21.370359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b24fdb-f8ed-43b4-82e3-1573656a3e12 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:21.371969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-46b24fdb-f8ed-43b4-82e3-1573656a3e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:21.482680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b24fdb-f8ed-43b4-82e3-1573656a3e12 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:21.555308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:21.557653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afb14d-c5b0-4d57-b673-56949603ec9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:21.558269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afb14d-c5b0-4d57-b673-56949603ec9f service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:21.558545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afb14d-c5b0-4d57-b673-56949603ec9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:21.558848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afb14d-c5b0-4d57-b673-56949603ec9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:21.560465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-34afb14d-c5b0-4d57-b673-56949603ec9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:21.672867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afb14d-c5b0-4d57-b673-56949603ec9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:21.674347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afb14d-c5b0-4d57-b673-56949603ec9f service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:21.692084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 667/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:24.323912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fde85-4b20-4475-8c11-9f429f1f788c None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:24.324489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fde85-4b20-4475-8c11-9f429f1f788c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:24.324489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fde85-4b20-4475-8c11-9f429f1f788c None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:24.325789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 648/1315] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:24.330949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887eb0-c354-4953-81d5-9bf42644fbbf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:24.331335 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887eb0-c354-4953-81d5-9bf42644fbbf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:24.331499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887eb0-c354-4953-81d5-9bf42644fbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:24.395859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cb887eb0-c354-4953-81d5-9bf42644fbbf None None] MFA Rules not processed for user `0a61cd86a351421ca5fde715dd4da46e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:24.397070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cb887eb0-c354-4953-81d5-9bf42644fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:24.448410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:24.491509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 668/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:24.773559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fde85-4b20-4475-8c11-9f429f1f788c None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:24.775181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-209fde85-4b20-4475-8c11-9f429f1f788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:24.785520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:24.875675 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fde85-4b20-4475-8c11-9f429f1f788c None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:24.947328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7217ee3-532b-4dd2-86a8-7792501cd28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:24.947843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7217ee3-532b-4dd2-86a8-7792501cd28f service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:24.948119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7217ee3-532b-4dd2-86a8-7792501cd28f service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:24.948394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7217ee3-532b-4dd2-86a8-7792501cd28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:24.949990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b7217ee3-532b-4dd2-86a8-7792501cd28f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:25.010494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:25.056126 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7217ee3-532b-4dd2-86a8-7792501cd28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:25.057570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7217ee3-532b-4dd2-86a8-7792501cd28f service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:25.075221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 649/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:27.947971 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218a43-7094-4997-b05d-b12f5f385a14 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:27.948506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218a43-7094-4997-b05d-b12f5f385a14 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:27.948506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218a43-7094-4997-b05d-b12f5f385a14 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:27.949832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 669/1318] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:27.954995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef445454-0eed-4b2d-9255-c07ad2fcb0d0 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:27.955419 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef445454-0eed-4b2d-9255-c07ad2fcb0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:27.955547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef445454-0eed-4b2d-9255-c07ad2fcb0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:28.020180 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-ef445454-0eed-4b2d-9255-c07ad2fcb0d0 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:28.021421 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ef445454-0eed-4b2d-9255-c07ad2fcb0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:28.121968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 650/1319] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:28.419405 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f589c0-282f-4768-8017-2c90e5e8cef6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:28.419688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f589c0-282f-4768-8017-2c90e5e8cef6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:28.419963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f589c0-282f-4768-8017-2c90e5e8cef6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:28.421965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 670/1320] 10.222.0.23 () {54 vars in 965 bytes} [Thu Sep 8 16:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:28.430472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248e287-9f9d-47d0-b1ff-3da3ea81cc8c None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:28.430788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248e287-9f9d-47d0-b1ff-3da3ea81cc8c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:28.431062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248e287-9f9d-47d0-b1ff-3da3ea81cc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:28.455275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:28.508326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-e248e287-9f9d-47d0-b1ff-3da3ea81cc8c None None] MFA Rules not processed for user `e08c9de660c04ed98f6100be2d687ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:28.509557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e248e287-9f9d-47d0-b1ff-3da3ea81cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:28.582616 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 651/1321] 10.222.0.23 () {58 vars in 1062 bytes} [Thu Sep 8 16:09:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:28.591734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f589c0-282f-4768-8017-2c90e5e8cef6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:28.593771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-37f589c0-282f-4768-8017-2c90e5e8cef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:28.695153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f589c0-282f-4768-8017-2c90e5e8cef6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:28.772099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bef35-b78c-477e-a374-cb8e9553d6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:28.772706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bef35-b78c-477e-a374-cb8e9553d6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:28.772982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bef35-b78c-477e-a374-cb8e9553d6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:28.773252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bef35-b78c-477e-a374-cb8e9553d6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:28.774897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-523bef35-b78c-477e-a374-cb8e9553d6f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:28.782432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:28.883164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bef35-b78c-477e-a374-cb8e9553d6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:28.884509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bef35-b78c-477e-a374-cb8e9553d6f6 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:28.902508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 671/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:32.455631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8aa6-765c-46cb-afd5-983d29d7a68e None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:32.456202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8aa6-765c-46cb-afd5-983d29d7a68e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:32.456202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8aa6-765c-46cb-afd5-983d29d7a68e None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:32.457497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 652/1323] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:32.462638 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ed6b1-f6da-4a85-af4e-c417b4d76702 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:32.463076 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ed6b1-f6da-4a85-af4e-c417b4d76702 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:32.463224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ed6b1-f6da-4a85-af4e-c417b4d76702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:32.528682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a68ed6b1-f6da-4a85-af4e-c417b4d76702 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:32.529896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a68ed6b1-f6da-4a85-af4e-c417b4d76702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:32.594174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:32.635386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 672/1324] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:32.920865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e8aa6-765c-46cb-afd5-983d29d7a68e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:32.922407 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b59e8aa6-765c-46cb-afd5-983d29d7a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:33.025737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e8aa6-765c-46cb-afd5-983d29d7a68e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:33.037968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:33.111055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cb067-308e-4b22-9320-c73377f10111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:33.111667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cb067-308e-4b22-9320-c73377f10111 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:33.111939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cb067-308e-4b22-9320-c73377f10111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:33.112206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cb067-308e-4b22-9320-c73377f10111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:33.113816 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-145cb067-308e-4b22-9320-c73377f10111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:33.224376 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cb067-308e-4b22-9320-c73377f10111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:33.225817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cb067-308e-4b22-9320-c73377f10111 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:33.243890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 653/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:35.474797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc8aff-b3c1-489d-8288-dc2bc4e7ecdf None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:35.475352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc8aff-b3c1-489d-8288-dc2bc4e7ecdf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:35.475352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc8aff-b3c1-489d-8288-dc2bc4e7ecdf None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:35.476703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 673/1326] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:35.482184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc18655-c41a-47b1-9f94-5a7b4f8c9868 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:35.482590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc18655-c41a-47b1-9f94-5a7b4f8c9868 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:35.482782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc18655-c41a-47b1-9f94-5a7b4f8c9868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:35.532134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:35.550051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0dc18655-c41a-47b1-9f94-5a7b4f8c9868 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:35.551302 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0dc18655-c41a-47b1-9f94-5a7b4f8c9868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:35.652913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 654/1327] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:35.939309 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc8aff-b3c1-489d-8288-dc2bc4e7ecdf None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:35.940822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-48dc8aff-b3c1-489d-8288-dc2bc4e7ecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:36.043211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc8aff-b3c1-489d-8288-dc2bc4e7ecdf None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:36.116182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321bab6-6946-4368-a19a-d7384985b322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:36.116808 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bab6-6946-4368-a19a-d7384985b322 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:36.117101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bab6-6946-4368-a19a-d7384985b322 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:36.117359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bab6-6946-4368-a19a-d7384985b322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:36.119015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8321bab6-6946-4368-a19a-d7384985b322 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:36.136907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:36.230128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321bab6-6946-4368-a19a-d7384985b322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:36.231597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321bab6-6946-4368-a19a-d7384985b322 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:36.251963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 674/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:38.478737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e8f5-7134-4030-85b0-c5139cc08abc None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:38.479293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e8f5-7134-4030-85b0-c5139cc08abc None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:38.479293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590e8f5-7134-4030-85b0-c5139cc08abc None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:38.480605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 655/1329] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:38.486416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22517fe2-4ef2-40b3-adfe-25af5bb0e25f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:38.486821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22517fe2-4ef2-40b3-adfe-25af5bb0e25f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:38.486990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22517fe2-4ef2-40b3-adfe-25af5bb0e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:38.557886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-22517fe2-4ef2-40b3-adfe-25af5bb0e25f None None] MFA Rules not processed for user `0a61cd86a351421ca5fde715dd4da46e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:38.559117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-22517fe2-4ef2-40b3-adfe-25af5bb0e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:38.624977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:38.655674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 675/1330] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:38.941347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590e8f5-7134-4030-85b0-c5139cc08abc None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:38.943071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c590e8f5-7134-4030-85b0-c5139cc08abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:39.057380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590e8f5-7134-4030-85b0-c5139cc08abc None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:39.078952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:39.143078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb12ccf-31e7-46e0-b98e-490ba67a2040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:39.143885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12ccf-31e7-46e0-b98e-490ba67a2040 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:39.144069 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12ccf-31e7-46e0-b98e-490ba67a2040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:39.144308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12ccf-31e7-46e0-b98e-490ba67a2040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:39.145930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-8cb12ccf-31e7-46e0-b98e-490ba67a2040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:39.256548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb12ccf-31e7-46e0-b98e-490ba67a2040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:39.257995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb12ccf-31e7-46e0-b98e-490ba67a2040 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:39.276652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 656/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:41.873830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07fb2-a1b3-4819-9f01-3640bfbf1ea6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:41.874364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07fb2-a1b3-4819-9f01-3640bfbf1ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:41.874364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a07fb2-a1b3-4819-9f01-3640bfbf1ea6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:41.875744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 676/1332] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:41.880937 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7f1e0-4af7-47e5-9b9f-7179212afa1d None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:41.881342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7f1e0-4af7-47e5-9b9f-7179212afa1d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:41.886190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7f1e0-4af7-47e5-9b9f-7179212afa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:41.944766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:41.947343 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-bdd7f1e0-4af7-47e5-9b9f-7179212afa1d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:41.948538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-bdd7f1e0-4af7-47e5-9b9f-7179212afa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:42.044257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 657/1333] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:42.324888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a07fb2-a1b3-4819-9f01-3640bfbf1ea6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:42.326469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-35a07fb2-a1b3-4819-9f01-3640bfbf1ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:42.428195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a07fb2-a1b3-4819-9f01-3640bfbf1ea6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:42.500166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952741f-49b3-4a54-a002-e4a2f7e04d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:42.500769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952741f-49b3-4a54-a002-e4a2f7e04d4f service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:42.501045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952741f-49b3-4a54-a002-e4a2f7e04d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:42.501315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952741f-49b3-4a54-a002-e4a2f7e04d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:42.502946 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9952741f-49b3-4a54-a002-e4a2f7e04d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:42.529276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:42.611268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952741f-49b3-4a54-a002-e4a2f7e04d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:42.612618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952741f-49b3-4a54-a002-e4a2f7e04d4f service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:42.631530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 677/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:44.847500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cde8b-f2a0-475d-b023-7cff42edbe56 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:44.848055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cde8b-f2a0-475d-b023-7cff42edbe56 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:44.848055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cde8b-f2a0-475d-b023-7cff42edbe56 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:44.849366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 658/1335] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:44.854800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd5ce4-5729-4371-850e-6d9fdbfa8a86 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:44.855221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd5ce4-5729-4371-850e-6d9fdbfa8a86 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:44.855341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd5ce4-5729-4371-850e-6d9fdbfa8a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:44.919839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-56dd5ce4-5729-4371-850e-6d9fdbfa8a86 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:44.921066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-56dd5ce4-5729-4371-850e-6d9fdbfa8a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:44.998012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:45.020424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 678/1336] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:45.304337 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cde8b-f2a0-475d-b023-7cff42edbe56 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:45.305877 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-158cde8b-f2a0-475d-b023-7cff42edbe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:45.406585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cde8b-f2a0-475d-b023-7cff42edbe56 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:45.437137 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:45.481576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90788ee-5dd3-4fb1-9547-6c085df36c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:45.482185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90788ee-5dd3-4fb1-9547-6c085df36c27 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:45.482465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90788ee-5dd3-4fb1-9547-6c085df36c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:45.482770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90788ee-5dd3-4fb1-9547-6c085df36c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:45.484923 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e90788ee-5dd3-4fb1-9547-6c085df36c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:45.591197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90788ee-5dd3-4fb1-9547-6c085df36c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:45.592558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90788ee-5dd3-4fb1-9547-6c085df36c27 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:45.611061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 659/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:48.376622 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c414a-3201-4a40-8c2c-ff547d0a4b8e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:48.377209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c414a-3201-4a40-8c2c-ff547d0a4b8e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:48.377209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c414a-3201-4a40-8c2c-ff547d0a4b8e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:48.378508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 679/1338] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:48.383721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe3170-1dbf-4d54-9f39-d63ce2537eea None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:48.384130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe3170-1dbf-4d54-9f39-d63ce2537eea None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:48.384280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe3170-1dbf-4d54-9f39-d63ce2537eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:48.449851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0dbe3170-1dbf-4d54-9f39-d63ce2537eea None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:48.451105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0dbe3170-1dbf-4d54-9f39-d63ce2537eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:48.459299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:48.548194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 660/1339] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:48.832229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c414a-3201-4a40-8c2c-ff547d0a4b8e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:48.833778 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-762c414a-3201-4a40-8c2c-ff547d0a4b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:48.943660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c414a-3201-4a40-8c2c-ff547d0a4b8e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:49.016084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e727f7-1885-48ac-bb9d-4f7cc961ed8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:49.016682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e727f7-1885-48ac-bb9d-4f7cc961ed8c service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:49.016954 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e727f7-1885-48ac-bb9d-4f7cc961ed8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:49.017215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e727f7-1885-48ac-bb9d-4f7cc961ed8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:49.018833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-83e727f7-1885-48ac-bb9d-4f7cc961ed8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:49.054071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:49.127310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e727f7-1885-48ac-bb9d-4f7cc961ed8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:49.128739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e727f7-1885-48ac-bb9d-4f7cc961ed8c service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:49.149511 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 680/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:53.587901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93ffbe-9d1f-4b91-8603-c07e113eaae3 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:53.588403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93ffbe-9d1f-4b91-8603-c07e113eaae3 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:53.588403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93ffbe-9d1f-4b91-8603-c07e113eaae3 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:53.589879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 661/1341] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:53.595682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be817a41-f6d6-497a-907f-cca4f28a80db None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:53.596100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be817a41-f6d6-497a-907f-cca4f28a80db None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:53.596228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be817a41-f6d6-497a-907f-cca4f28a80db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:53.663111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-be817a41-f6d6-497a-907f-cca4f28a80db None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:53.664319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-be817a41-f6d6-497a-907f-cca4f28a80db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:53.748414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:53.759121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 681/1342] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:09:54.043144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93ffbe-9d1f-4b91-8603-c07e113eaae3 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:54.044722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-af93ffbe-9d1f-4b91-8603-c07e113eaae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:54.147303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93ffbe-9d1f-4b91-8603-c07e113eaae3 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:54.184260 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:54.220033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409bec-a5fe-433e-ac71-aee495e77c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:54.220640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409bec-a5fe-433e-ac71-aee495e77c59 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:54.220914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409bec-a5fe-433e-ac71-aee495e77c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:54.221182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409bec-a5fe-433e-ac71-aee495e77c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:54.222783 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-52409bec-a5fe-433e-ac71-aee495e77c59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:54.329704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52409bec-a5fe-433e-ac71-aee495e77c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:54.331119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52409bec-a5fe-433e-ac71-aee495e77c59 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:54.349176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 662/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:57.529899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326fb3-6f91-43fb-8b0f-1895acb217fa None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:57.531273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326fb3-6f91-43fb-8b0f-1895acb217fa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:57.531273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326fb3-6f91-43fb-8b0f-1895acb217fa None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:57.532633 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 682/1344] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:09:57.537965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c260a4-a79e-4e35-a643-0d5ed0711316 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:57.538361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c260a4-a79e-4e35-a643-0d5ed0711316 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:57.538507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c260a4-a79e-4e35-a643-0d5ed0711316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:57.604536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-63c260a4-a79e-4e35-a643-0d5ed0711316 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:09:57.605740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-63c260a4-a79e-4e35-a643-0d5ed0711316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:57.623370 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:57.704086 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 663/1345] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:09:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:09:57.998049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326fb3-6f91-43fb-8b0f-1895acb217fa None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:09:58.000219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5c326fb3-6f91-43fb-8b0f-1895acb217fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:58.103567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326fb3-6f91-43fb-8b0f-1895acb217fa None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:09:58.197700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aa424-ef02-4570-9ec4-85d23e932b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:09:58.198316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa424-ef02-4570-9ec4-85d23e932b9f service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:09:58.198588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa424-ef02-4570-9ec4-85d23e932b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:09:58.198890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa424-ef02-4570-9ec4-85d23e932b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:09:58.200489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-778aa424-ef02-4570-9ec4-85d23e932b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:09:58.253388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:58.323849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aa424-ef02-4570-9ec4-85d23e932b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:09:58.325300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aa424-ef02-4570-9ec4-85d23e932b9f service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:09:58.346458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 683/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:09:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:02.897635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566ed9c-1a2c-45eb-9554-5d10b6d3578d None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:02.898234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566ed9c-1a2c-45eb-9554-5d10b6d3578d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:02.898234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566ed9c-1a2c-45eb-9554-5d10b6d3578d None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:02.899709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 664/1347] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:02.905098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eb897-2f29-47aa-8173-43a958a176bf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:02.905549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eb897-2f29-47aa-8173-43a958a176bf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:02.905632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eb897-2f29-47aa-8173-43a958a176bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:02.976172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fb9eb897-2f29-47aa-8173-43a958a176bf None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:02.977422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fb9eb897-2f29-47aa-8173-43a958a176bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:03.095190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:03.097434 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 684/1348] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:03.382379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566ed9c-1a2c-45eb-9554-5d10b6d3578d None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:03.383993 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f566ed9c-1a2c-45eb-9554-5d10b6d3578d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:03.486329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566ed9c-1a2c-45eb-9554-5d10b6d3578d None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:03.533439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:03.559977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f4bdb-550d-4719-a18c-51d2a4f18fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:03.560575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4bdb-550d-4719-a18c-51d2a4f18fde service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:03.560850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4bdb-550d-4719-a18c-51d2a4f18fde service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:03.561116 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4bdb-550d-4719-a18c-51d2a4f18fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:03.562722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-572f4bdb-550d-4719-a18c-51d2a4f18fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:03.671879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f4bdb-550d-4719-a18c-51d2a4f18fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:03.673383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f4bdb-550d-4719-a18c-51d2a4f18fde service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:03.691240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 665/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:08.640575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee083ad-4f26-4738-aa6d-f3d66d914e6f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:08.640999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee083ad-4f26-4738-aa6d-f3d66d914e6f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:08.641194 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee083ad-4f26-4738-aa6d-f3d66d914e6f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:08.642477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 685/1350] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:08.647989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1e86-b493-4c28-ae4e-5fe3d0665593 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:08.648637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1e86-b493-4c28-ae4e-5fe3d0665593 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:08.648637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1e86-b493-4c28-ae4e-5fe3d0665593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:08.755885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a67b1e86-b493-4c28-ae4e-5fe3d0665593 None None] MFA Rules not processed for user `7e6c855e2692410d83c78cc95cb4f37e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:08.757272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a67b1e86-b493-4c28-ae4e-5fe3d0665593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:08.788154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:08.928089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 666/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:10:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:13.131735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c773a7-3442-476d-b8d4-be8e554e2365 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:13.132255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c773a7-3442-476d-b8d4-be8e554e2365 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:13.132656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c773a7-3442-476d-b8d4-be8e554e2365 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:13.134818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 686/1352] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:10:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:13.140944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75101ebe-1372-4754-aa72-dc72751a71f7 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:13.141410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75101ebe-1372-4754-aa72-dc72751a71f7 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:13.141491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75101ebe-1372-4754-aa72-dc72751a71f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:13.222981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-75101ebe-1372-4754-aa72-dc72751a71f7 None None] MFA Rules not processed for user `7e6c855e2692410d83c78cc95cb4f37e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:13.224445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-75101ebe-1372-4754-aa72-dc72751a71f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:13.301195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:13.341565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 667/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:14.630992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eb830-6cc3-42ba-9cd1-2159f33c0efc None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:14.631536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eb830-6cc3-42ba-9cd1-2159f33c0efc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:14.631536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eb830-6cc3-42ba-9cd1-2159f33c0efc None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:14.632892 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 687/1354] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:14.638259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3f339-6451-41c0-af58-8db728707c04 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:14.638724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3f339-6451-41c0-af58-8db728707c04 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:14.639467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3f339-6451-41c0-af58-8db728707c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:14.716032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-afd3f339-6451-41c0-af58-8db728707c04 None None] MFA Rules not processed for user `7e6c855e2692410d83c78cc95cb4f37e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:14.717901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-afd3f339-6451-41c0-af58-8db728707c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:14.828892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 668/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:10:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:10:18.506631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269ab1-cb1d-4a38-b986-c61f7998a99a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:18.507162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269ab1-cb1d-4a38-b986-c61f7998a99a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:18.507162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269ab1-cb1d-4a38-b986-c61f7998a99a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:18.508906 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 688/1356] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:18.514293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bb241-a53a-4736-9349-449a13899887 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:18.514293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bb241-a53a-4736-9349-449a13899887 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:18.514854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bb241-a53a-4736-9349-449a13899887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:18.570138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:18.606300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-2e2bb241-a53a-4736-9349-449a13899887 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:18.607546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2e2bb241-a53a-4736-9349-449a13899887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:18.709003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 669/1357] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:19.007218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e059-5c28-42b7-a301-8dd70aead511 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:19.007383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e059-5c28-42b7-a301-8dd70aead511 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:19.007660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e059-5c28-42b7-a301-8dd70aead511 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:19.008994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 689/1358] 10.222.0.23 () {54 vars in 962 bytes} [Thu Sep 8 16:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:19.017516 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689e9be-8209-4603-bdc3-8ee1b2273fb4 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:19.018066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689e9be-8209-4603-bdc3-8ee1b2273fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:19.018533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689e9be-8209-4603-bdc3-8ee1b2273fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:19.102168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b689e9be-8209-4603-bdc3-8ee1b2273fb4 None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:19.103425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b689e9be-8209-4603-bdc3-8ee1b2273fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:19.155469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:19.234844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 670/1359] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Sep 8 16:10:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:19.237569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e059-5c28-42b7-a301-8dd70aead511 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:19.239357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8d47e059-5c28-42b7-a301-8dd70aead511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:19.413734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e059-5c28-42b7-a301-8dd70aead511 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:19.493047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:19.535087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c5ed2-c01a-4440-bd17-a3eddf75da4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:19.535727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c5ed2-c01a-4440-bd17-a3eddf75da4a service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:19.536005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c5ed2-c01a-4440-bd17-a3eddf75da4a service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:19.536235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c5ed2-c01a-4440-bd17-a3eddf75da4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:19.537835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-180c5ed2-c01a-4440-bd17-a3eddf75da4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:19.634082 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c5ed2-c01a-4440-bd17-a3eddf75da4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:19.635821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c5ed2-c01a-4440-bd17-a3eddf75da4a service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:19.658189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 690/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:22.056983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6fbf-caea-48fa-af36-31786d0c85d4 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:22.057519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6fbf-caea-48fa-af36-31786d0c85d4 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:22.057519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6fbf-caea-48fa-af36-31786d0c85d4 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:22.058918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 671/1361] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:22.065277 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e54c-5205-48f7-8733-01a997f0f7de None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:22.065772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e54c-5205-48f7-8733-01a997f0f7de None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:22.065879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e54c-5205-48f7-8733-01a997f0f7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:22.154785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2b60e54c-5205-48f7-8733-01a997f0f7de None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:22.156992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2b60e54c-5205-48f7-8733-01a997f0f7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:22.206276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:22.271134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 691/1362] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:22.566789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf6fbf-caea-48fa-af36-31786d0c85d4 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:22.568510 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-29bf6fbf-caea-48fa-af36-31786d0c85d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:22.744302 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf6fbf-caea-48fa-af36-31786d0c85d4 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:22.756332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:22.875017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaabff-34d0-4d76-ac80-bf8bfe9059b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:22.875760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaabff-34d0-4d76-ac80-bf8bfe9059b1 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:22.875760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaabff-34d0-4d76-ac80-bf8bfe9059b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:22.876235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaabff-34d0-4d76-ac80-bf8bfe9059b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:22.878121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9ccaabff-34d0-4d76-ac80-bf8bfe9059b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:22.971488 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaabff-34d0-4d76-ac80-bf8bfe9059b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:22.973457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccaabff-34d0-4d76-ac80-bf8bfe9059b1 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:22.991375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 672/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:25.602854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d183-694b-46ff-a086-fa294b5f849d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:25.603417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d183-694b-46ff-a086-fa294b5f849d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:25.603417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d183-694b-46ff-a086-fa294b5f849d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:25.605010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 692/1364] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:25.611078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb5c69-e456-4e20-8510-4843279387c6 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:25.611887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb5c69-e456-4e20-8510-4843279387c6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:25.612386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb5c69-e456-4e20-8510-4843279387c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:25.628915 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:25.681006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-2deb5c69-e456-4e20-8510-4843279387c6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:25.682131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2deb5c69-e456-4e20-8510-4843279387c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:25.786584 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 673/1365] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:26.083213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4e6d-8c24-4721-bf3b-e18f947744d3 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:26.083878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4e6d-8c24-4721-bf3b-e18f947744d3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:26.084270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4e6d-8c24-4721-bf3b-e18f947744d3 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:26.085927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 693/1366] 10.222.0.23 () {54 vars in 962 bytes} [Thu Sep 8 16:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:26.091344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b928-d192-49de-a6e8-71e980a253cc None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:26.091858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b928-d192-49de-a6e8-71e980a253cc None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:26.092305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b928-d192-49de-a6e8-71e980a253cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:26.170828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-2506b928-d192-49de-a6e8-71e980a253cc None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:26.172416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2506b928-d192-49de-a6e8-71e980a253cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:26.208708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:26.295404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 674/1367] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Sep 8 16:10:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:26.304415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4e6d-8c24-4721-bf3b-e18f947744d3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:26.306053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-118a4e6d-8c24-4721-bf3b-e18f947744d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:26.501943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4e6d-8c24-4721-bf3b-e18f947744d3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:26.538193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:26.697896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea186a6-5b69-4825-8488-b7de2f02db4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:26.699934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea186a6-5b69-4825-8488-b7de2f02db4e service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:26.700475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea186a6-5b69-4825-8488-b7de2f02db4e service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:26.700969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea186a6-5b69-4825-8488-b7de2f02db4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:26.703058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8ea186a6-5b69-4825-8488-b7de2f02db4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:26.826928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea186a6-5b69-4825-8488-b7de2f02db4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:26.828965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea186a6-5b69-4825-8488-b7de2f02db4e service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:26.853303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 694/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:26.909529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da1a8-8a59-4542-8a55-49f54bfb33fd None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:26.910345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da1a8-8a59-4542-8a55-49f54bfb33fd None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:26.910345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da1a8-8a59-4542-8a55-49f54bfb33fd None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:26.911841 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 675/1369] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:26.917147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624b3c-803e-4300-898b-92221a147f05 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:26.917504 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624b3c-803e-4300-898b-92221a147f05 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:26.917785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624b3c-803e-4300-898b-92221a147f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:26.949798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:26.989182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ea624b3c-803e-4300-898b-92221a147f05 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:26.991453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ea624b3c-803e-4300-898b-92221a147f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:27.097998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 695/1370] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:27.437552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa21f82-57bc-411f-8ada-16bde1635491 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:27.437552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa21f82-57bc-411f-8ada-16bde1635491 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:27.437552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa21f82-57bc-411f-8ada-16bde1635491 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:27.439564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 676/1371] 10.222.0.23 () {54 vars in 964 bytes} [Thu Sep 8 16:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:27.443590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e668c4a-8ef2-4fe7-ac26-0ef9b5c65c7c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:27.443590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e668c4a-8ef2-4fe7-ac26-0ef9b5c65c7c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:27.443590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e668c4a-8ef2-4fe7-ac26-0ef9b5c65c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:27.524444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1e668c4a-8ef2-4fe7-ac26-0ef9b5c65c7c None None] MFA Rules not processed for user `e1d9c18139104883848f3ba22b38b360`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:27.525667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1e668c4a-8ef2-4fe7-ac26-0ef9b5c65c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:27.576506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:27.612038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 696/1372] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Sep 8 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:27.619788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa21f82-57bc-411f-8ada-16bde1635491 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:27.621296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4aa21f82-57bc-411f-8ada-16bde1635491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:27.729275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa21f82-57bc-411f-8ada-16bde1635491 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:27.776148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:27.817449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656d538-2d6e-4ede-a2de-871dc9627288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:27.818682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656d538-2d6e-4ede-a2de-871dc9627288 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:27.819331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656d538-2d6e-4ede-a2de-871dc9627288 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:27.819902 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656d538-2d6e-4ede-a2de-871dc9627288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:27.823309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3656d538-2d6e-4ede-a2de-871dc9627288 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:27.985194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656d538-2d6e-4ede-a2de-871dc9627288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:27.987647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656d538-2d6e-4ede-a2de-871dc9627288 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:28.012518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 677/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:29.220045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a5e1-fe5f-4e60-889d-9ca77108679a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:29.220593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a5e1-fe5f-4e60-889d-9ca77108679a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:29.220593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a5e1-fe5f-4e60-889d-9ca77108679a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:29.221917 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 697/1374] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:29.227168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143479f-2961-4e96-a3d8-f359b4385d7c None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:29.232939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143479f-2961-4e96-a3d8-f359b4385d7c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:29.232939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143479f-2961-4e96-a3d8-f359b4385d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:29.294829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-8143479f-2961-4e96-a3d8-f359b4385d7c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:29.296830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-8143479f-2961-4e96-a3d8-f359b4385d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:29.317626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:29.394341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 678/1375] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:29.684964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41a5e1-fe5f-4e60-889d-9ca77108679a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:29.686616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3f41a5e1-fe5f-4e60-889d-9ca77108679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:29.848567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41a5e1-fe5f-4e60-889d-9ca77108679a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:29.901213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:29.968235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a676c-ab38-49fa-85bd-29351f8494bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:29.969135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a676c-ab38-49fa-85bd-29351f8494bf service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:29.969545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a676c-ab38-49fa-85bd-29351f8494bf service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:29.969948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a676c-ab38-49fa-85bd-29351f8494bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:29.972486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-680a676c-ab38-49fa-85bd-29351f8494bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:30.073900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a676c-ab38-49fa-85bd-29351f8494bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:30.075532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a676c-ab38-49fa-85bd-29351f8494bf service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:30.098795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 698/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:32.644787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0dab5-e939-403e-9965-6a053ca69648 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:32.645520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0dab5-e939-403e-9965-6a053ca69648 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:32.645945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0dab5-e939-403e-9965-6a053ca69648 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:32.647803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 679/1377] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:32.654440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baddcd-5d2d-4aba-9139-ec20a709facd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:32.655803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baddcd-5d2d-4aba-9139-ec20a709facd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:32.656385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baddcd-5d2d-4aba-9139-ec20a709facd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:32.729026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-66baddcd-5d2d-4aba-9139-ec20a709facd None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:32.730237 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-66baddcd-5d2d-4aba-9139-ec20a709facd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:32.738058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:32.832070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 699/1378] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:33.120646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0dab5-e939-403e-9965-6a053ca69648 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:33.122392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-45f0dab5-e939-403e-9965-6a053ca69648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:33.282575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0dab5-e939-403e-9965-6a053ca69648 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:33.287285 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:33.403754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76fb53-087e-439f-b3be-ba80cc820947 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:33.405142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76fb53-087e-439f-b3be-ba80cc820947 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:33.405528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76fb53-087e-439f-b3be-ba80cc820947 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:33.405900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76fb53-087e-439f-b3be-ba80cc820947 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:33.407679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ea76fb53-087e-439f-b3be-ba80cc820947 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:33.509245 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76fb53-087e-439f-b3be-ba80cc820947 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:33.511113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76fb53-087e-439f-b3be-ba80cc820947 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:33.531210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 680/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:35.872675 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d29d01-82fc-47dd-9c69-227c15ce3994 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:35.873697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d29d01-82fc-47dd-9c69-227c15ce3994 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:35.873815 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d29d01-82fc-47dd-9c69-227c15ce3994 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:35.875146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 700/1380] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:35.880417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8db36-d56f-459c-ae18-afb527dc29d7 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:35.880838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8db36-d56f-459c-ae18-afb527dc29d7 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:35.880965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8db36-d56f-459c-ae18-afb527dc29d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:35.892980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:35.948142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c6d8db36-d56f-459c-ae18-afb527dc29d7 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:35.949366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c6d8db36-d56f-459c-ae18-afb527dc29d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:36.049349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 681/1381] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:36.345053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d29d01-82fc-47dd-9c69-227c15ce3994 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:36.346654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-20d29d01-82fc-47dd-9c69-227c15ce3994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:36.497379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:36.508479 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d29d01-82fc-47dd-9c69-227c15ce3994 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:36.642409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b41c4-5c6e-49db-94a7-e84a5c34db48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:36.643343 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b41c4-5c6e-49db-94a7-e84a5c34db48 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:36.643981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b41c4-5c6e-49db-94a7-e84a5c34db48 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:36.644380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b41c4-5c6e-49db-94a7-e84a5c34db48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:36.646532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-504b41c4-5c6e-49db-94a7-e84a5c34db48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:36.756692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b41c4-5c6e-49db-94a7-e84a5c34db48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:36.758372 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b41c4-5c6e-49db-94a7-e84a5c34db48 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:36.768804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:36.777585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 701/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:39.189927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07102b-60b9-4d50-b211-749497ba3a7a None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:39.190539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07102b-60b9-4d50-b211-749497ba3a7a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:39.190539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07102b-60b9-4d50-b211-749497ba3a7a None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:39.191834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 682/1383] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:39.198070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9099f-c99d-4a80-9a86-7e308119ecba None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:39.198794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9099f-c99d-4a80-9a86-7e308119ecba None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:39.198794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9099f-c99d-4a80-9a86-7e308119ecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:39.285802 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-68d9099f-c99d-4a80-9a86-7e308119ecba None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:39.287099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-68d9099f-c99d-4a80-9a86-7e308119ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:39.401801 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 702/1384] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:39.702447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07102b-60b9-4d50-b211-749497ba3a7a None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:39.704192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5d07102b-60b9-4d50-b211-749497ba3a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:39.803331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:39.874288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07102b-60b9-4d50-b211-749497ba3a7a None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:40.012427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b311c07-7802-448e-81e4-b80cd5eefd56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:40.013241 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311c07-7802-448e-81e4-b80cd5eefd56 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:40.013589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311c07-7802-448e-81e4-b80cd5eefd56 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:40.013917 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b311c07-7802-448e-81e4-b80cd5eefd56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:40.016096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6b311c07-7802-448e-81e4-b80cd5eefd56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:40.086475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:40.156272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b311c07-7802-448e-81e4-b80cd5eefd56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:40.158435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b311c07-7802-448e-81e4-b80cd5eefd56 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:40.183647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 683/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:42.404133 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e2b3-3af4-4aec-96fb-8d6529dd7b35 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:42.404594 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e2b3-3af4-4aec-96fb-8d6529dd7b35 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:42.404710 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e2b3-3af4-4aec-96fb-8d6529dd7b35 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:42.406240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 703/1386] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:42.412228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748aff-3f7f-4c85-98fb-176f2b209eb2 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:42.412736 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748aff-3f7f-4c85-98fb-176f2b209eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:42.412817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748aff-3f7f-4c85-98fb-176f2b209eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:42.480495 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3d748aff-3f7f-4c85-98fb-176f2b209eb2 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:42.481732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3d748aff-3f7f-4c85-98fb-176f2b209eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:42.576696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 684/1387] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:42.866868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37e2b3-3af4-4aec-96fb-8d6529dd7b35 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:42.868377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dd37e2b3-3af4-4aec-96fb-8d6529dd7b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:42.945634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:43.017612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37e2b3-3af4-4aec-96fb-8d6529dd7b35 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:43.143365 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8327870-4252-45f9-807b-237b019bb1b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:43.143977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8327870-4252-45f9-807b-237b019bb1b1 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:43.144252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8327870-4252-45f9-807b-237b019bb1b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:43.144520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8327870-4252-45f9-807b-237b019bb1b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:43.146122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c8327870-4252-45f9-807b-237b019bb1b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:43.184645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:43.236556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8327870-4252-45f9-807b-237b019bb1b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:43.238167 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8327870-4252-45f9-807b-237b019bb1b1 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:43.256098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 704/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:43.705577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2971e-fc14-4dbf-8930-5451242a3ef0 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:43.706171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2971e-fc14-4dbf-8930-5451242a3ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:43.706171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2971e-fc14-4dbf-8930-5451242a3ef0 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:43.707490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 685/1389] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:43.712669 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053de2c1-c074-4b7d-a1ce-13176b2d856c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:43.713105 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053de2c1-c074-4b7d-a1ce-13176b2d856c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:43.713251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053de2c1-c074-4b7d-a1ce-13176b2d856c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:43.781748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-053de2c1-c074-4b7d-a1ce-13176b2d856c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:43.783227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-053de2c1-c074-4b7d-a1ce-13176b2d856c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:43.886505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 705/1390] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:44.190437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33673-9af9-4648-a02f-87a5298887a2 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:44.191094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33673-9af9-4648-a02f-87a5298887a2 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:44.191553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33673-9af9-4648-a02f-87a5298887a2 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:44.193073 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 686/1391] 10.222.0.23 () {54 vars in 966 bytes} [Thu Sep 8 16:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:44.199777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4badf4-9b00-43ed-8cc1-666e35577c32 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:44.200292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4badf4-9b00-43ed-8cc1-666e35577c32 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:44.200866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4badf4-9b00-43ed-8cc1-666e35577c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:44.217803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:44.281056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8e4badf4-9b00-43ed-8cc1-666e35577c32 None None] MFA Rules not processed for user `d0892bfab3ce435b90b93b0786899f84`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:44.282304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8e4badf4-9b00-43ed-8cc1-666e35577c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:44.361613 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 706/1392] 10.222.0.23 () {58 vars in 1063 bytes} [Thu Sep 8 16:10:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:10:44.370692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b33673-9af9-4648-a02f-87a5298887a2 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:44.372270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-84b33673-9af9-4648-a02f-87a5298887a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:44.403351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:44.479238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b33673-9af9-4648-a02f-87a5298887a2 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:44.559898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047083-eae5-4771-9009-7a7cedfcefee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0892bfab3ce435b90b93b0786899f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:44.560438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047083-eae5-4771-9009-7a7cedfcefee service glance] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:44.560713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047083-eae5-4771-9009-7a7cedfcefee service glance] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:44.560986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047083-eae5-4771-9009-7a7cedfcefee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:44.562581 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-04047083-eae5-4771-9009-7a7cedfcefee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:44.642141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:44.675524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04047083-eae5-4771-9009-7a7cedfcefee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:44.676938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04047083-eae5-4771-9009-7a7cedfcefee service glance] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:44.695781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 687/1393] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:45.577875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7dc2d-a554-4f75-9caa-f0ea905e1403 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:45.578400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7dc2d-a554-4f75-9caa-f0ea905e1403 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:45.578507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7dc2d-a554-4f75-9caa-f0ea905e1403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:45.632462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ce9b8-f96a-42f9-82e1-b421df72a371 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:45.632990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ce9b8-f96a-42f9-82e1-b421df72a371 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:45.632990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ce9b8-f96a-42f9-82e1-b421df72a371 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:45.634989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 688/1394] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:10:45.639914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27c9f-13cc-4d4c-a0e0-185055e15d9d None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:45.640218 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27c9f-13cc-4d4c-a0e0-185055e15d9d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:45.640489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d27c9f-13cc-4d4c-a0e0-185055e15d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:45.647323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-feb7dc2d-a554-4f75-9caa-f0ea905e1403 None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:45.648547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-feb7dc2d-a554-4f75-9caa-f0ea905e1403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:45.706204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:45.707913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-64d27c9f-13cc-4d4c-a0e0-185055e15d9d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:45.709141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-64d27c9f-13cc-4d4c-a0e0-185055e15d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:45.739220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 707/1395] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:10:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:45.781478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290faba-fbd6-44f3-a02e-15113d77bbc7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:45.781822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290faba-fbd6-44f3-a02e-15113d77bbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:45.782155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290faba-fbd6-44f3-a02e-15113d77bbc7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:45.783574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 708/1396] 10.222.0.23 () {54 vars in 943 bytes} [Thu Sep 8 16:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:10:45.790562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfddac-f9aa-402f-8255-31111f6c5100 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:45.790880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfddac-f9aa-402f-8255-31111f6c5100 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:45.791159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfddac-f9aa-402f-8255-31111f6c5100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:45.809099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 689/1397] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:10:45.867652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-61bfddac-f9aa-402f-8255-31111f6c5100 None None] MFA Rules not processed for user `50c9553845ba42e78de0293fd3a338d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:45.868877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-61bfddac-f9aa-402f-8255-31111f6c5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:45.979406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 709/1398] 10.222.0.23 () {58 vars in 1040 bytes} [Thu Sep 8 16:10:45 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:10:45.988649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d27c9f-13cc-4d4c-a0e0-185055e15d9d None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:45.989958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-64d27c9f-13cc-4d4c-a0e0-185055e15d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:46.029693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:46.094746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d27c9f-13cc-4d4c-a0e0-185055e15d9d None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:46.101053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfddac-f9aa-402f-8255-31111f6c5100 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:46.102254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-61bfddac-f9aa-402f-8255-31111f6c5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:46.134227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:46.201337 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91acd39-a9d2-4b7a-8902-14a37333c6aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:46.201984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91acd39-a9d2-4b7a-8902-14a37333c6aa service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:46.202264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91acd39-a9d2-4b7a-8902-14a37333c6aa service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:46.202531 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91acd39-a9d2-4b7a-8902-14a37333c6aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:46.203961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfddac-f9aa-402f-8255-31111f6c5100 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:46.204290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c91acd39-a9d2-4b7a-8902-14a37333c6aa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:46.263759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:46.295021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91acd39-a9d2-4b7a-8902-14a37333c6aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:46.296641 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91acd39-a9d2-4b7a-8902-14a37333c6aa service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:46.304912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 690/1399] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:10:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:10:46.327276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd63ad-1414-4e67-b7d0-8800eb454d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:46.327899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd63ad-1414-4e67-b7d0-8800eb454d58 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:46.328181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd63ad-1414-4e67-b7d0-8800eb454d58 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:46.328642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd63ad-1414-4e67-b7d0-8800eb454d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:46.330272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-97bd63ad-1414-4e67-b7d0-8800eb454d58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:46.371911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:46.419890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd63ad-1414-4e67-b7d0-8800eb454d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:46.421504 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd63ad-1414-4e67-b7d0-8800eb454d58 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:46.440863 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 710/1400] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:10:48.795610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3658471-2ac7-483b-8340-7de21ecf1a54 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:48.796144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3658471-2ac7-483b-8340-7de21ecf1a54 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:48.796144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3658471-2ac7-483b-8340-7de21ecf1a54 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:48.797626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 691/1401] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:48.802898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638dbd6-6ddb-46c2-9987-ff93d311b3ea None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:48.803315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638dbd6-6ddb-46c2-9987-ff93d311b3ea None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:48.803439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638dbd6-6ddb-46c2-9987-ff93d311b3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:48.881819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8638dbd6-6ddb-46c2-9987-ff93d311b3ea None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:48.882388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8638dbd6-6ddb-46c2-9987-ff93d311b3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:49.011546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 711/1402] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:49.319214 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3658471-2ac7-483b-8340-7de21ecf1a54 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:49.320934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e3658471-2ac7-483b-8340-7de21ecf1a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:49.500076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3658471-2ac7-483b-8340-7de21ecf1a54 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:49.555297 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:49.632035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621bfdb-f4f1-4299-a00b-8a71507a4941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:49.632924 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621bfdb-f4f1-4299-a00b-8a71507a4941 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:49.633204 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621bfdb-f4f1-4299-a00b-8a71507a4941 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:49.633478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621bfdb-f4f1-4299-a00b-8a71507a4941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:49.635140 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5621bfdb-f4f1-4299-a00b-8a71507a4941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:49.749432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621bfdb-f4f1-4299-a00b-8a71507a4941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:49.751106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621bfdb-f4f1-4299-a00b-8a71507a4941 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:49.769471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 692/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:52.119253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d7a1b-0363-42c0-b648-104347a39d7b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:52.119798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d7a1b-0363-42c0-b648-104347a39d7b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:52.119798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d7a1b-0363-42c0-b648-104347a39d7b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:52.121160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 712/1404] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:52.126395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860891b9-9511-427b-8636-d785c3d7205f None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:52.126843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860891b9-9511-427b-8636-d785c3d7205f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:52.126976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860891b9-9511-427b-8636-d785c3d7205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:52.206899 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-860891b9-9511-427b-8636-d785c3d7205f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:52.208398 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-860891b9-9511-427b-8636-d785c3d7205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:52.211462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:52.316075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 693/1405] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:52.611582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d7a1b-0363-42c0-b648-104347a39d7b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:52.613173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-472d7a1b-0363-42c0-b648-104347a39d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:52.636608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:52.781115 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d7a1b-0363-42c0-b648-104347a39d7b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:52.882584 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:52.907788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fc5ba-2395-420f-8560-41b16a6910f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:52.908435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc5ba-2395-420f-8560-41b16a6910f6 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:52.908708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc5ba-2395-420f-8560-41b16a6910f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:52.909101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fc5ba-2395-420f-8560-41b16a6910f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:52.911472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-119fc5ba-2395-420f-8560-41b16a6910f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:53.011415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fc5ba-2395-420f-8560-41b16a6910f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:53.013599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fc5ba-2395-420f-8560-41b16a6910f6 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:53.035087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 713/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:10:55.375709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14ac8-1b3b-4623-9d71-c3878a742333 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:55.376338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14ac8-1b3b-4623-9d71-c3878a742333 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:55.376338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb14ac8-1b3b-4623-9d71-c3878a742333 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:55.377751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 694/1407] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:10:55.385620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd02ce-202b-4d30-a929-35d6318649dc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:55.386056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd02ce-202b-4d30-a929-35d6318649dc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:55.386429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd02ce-202b-4d30-a929-35d6318649dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:55.476318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-67bd02ce-202b-4d30-a929-35d6318649dc None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:10:55.477553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-67bd02ce-202b-4d30-a929-35d6318649dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:55.535962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:55.585080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 714/1408] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:10:55.891666 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb14ac8-1b3b-4623-9d71-c3878a742333 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:10:55.893272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0bb14ac8-1b3b-4623-9d71-c3878a742333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:56.047275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:56.061754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb14ac8-1b3b-4623-9d71-c3878a742333 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:10:56.185225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7180847-fcfa-48b3-98b5-84eaea11b412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:10:56.186164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7180847-fcfa-48b3-98b5-84eaea11b412 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:10:56.186625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7180847-fcfa-48b3-98b5-84eaea11b412 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:10:56.186944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7180847-fcfa-48b3-98b5-84eaea11b412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:10:56.188618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a7180847-fcfa-48b3-98b5-84eaea11b412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:10:56.284681 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7180847-fcfa-48b3-98b5-84eaea11b412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:10:56.286598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7180847-fcfa-48b3-98b5-84eaea11b412 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:10:56.296013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:56.305569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 695/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:05.583091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=19 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:06.327312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:10.407805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df1c6-8d6e-48a7-b764-d50f610de1d0 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:10.408398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df1c6-8d6e-48a7-b764-d50f610de1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:10.408398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df1c6-8d6e-48a7-b764-d50f610de1d0 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:10.409740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 715/1410] 10.222.0.23 () {54 vars in 918 bytes} [Thu Sep 8 16:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:10.415527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3d2dd-891a-4abf-a69e-6bcc65a16d29 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:10.415956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3d2dd-891a-4abf-a69e-6bcc65a16d29 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:10.416099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3d2dd-891a-4abf-a69e-6bcc65a16d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:10.492495 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b4b3d2dd-891a-4abf-a69e-6bcc65a16d29 None None] MFA Rules not processed for user `7e6c855e2692410d83c78cc95cb4f37e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:10.493735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b4b3d2dd-891a-4abf-a69e-6bcc65a16d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:10.598135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 696/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Sep 8 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:11:10.612688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab1ab-33ca-4341-9992-fdec6b3d241e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:10.612975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab1ab-33ca-4341-9992-fdec6b3d241e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:10.613250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ab1ab-33ca-4341-9992-fdec6b3d241e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:10.614625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 716/1412] 10.222.0.23 () {54 vars in 918 bytes} [Thu Sep 8 16:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:10.619287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d336f-cd75-4b5f-aa3b-dee2ce7413c2 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:10.619567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d336f-cd75-4b5f-aa3b-dee2ce7413c2 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:10.619833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d336f-cd75-4b5f-aa3b-dee2ce7413c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:10.691710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:10.694594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-658d336f-cd75-4b5f-aa3b-dee2ce7413c2 None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:10.695892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-658d336f-cd75-4b5f-aa3b-dee2ce7413c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:10.808499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 697/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Sep 8 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:13.359146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067289d-699c-4985-bc96-f352b8d50d3d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:13.359715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067289d-699c-4985-bc96-f352b8d50d3d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:13.359715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067289d-699c-4985-bc96-f352b8d50d3d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:13.361004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:13.366237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c91c1-1971-4426-a2d4-0a02ce6f2f6a None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:13.366637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c91c1-1971-4426-a2d4-0a02ce6f2f6a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:13.366823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c91c1-1971-4426-a2d4-0a02ce6f2f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:13.432951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-440c91c1-1971-4426-a2d4-0a02ce6f2f6a None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:13.434744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-440c91c1-1971-4426-a2d4-0a02ce6f2f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:13.490372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:13.533027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:13.824049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067289d-699c-4985-bc96-f352b8d50d3d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:13.825601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6067289d-699c-4985-bc96-f352b8d50d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:13.969024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067289d-699c-4985-bc96-f352b8d50d3d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:14.042579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:14.083515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2e966-e1aa-4ed3-81bf-e22ec297b839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:14.083735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e966-e1aa-4ed3-81bf-e22ec297b839 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:14.084008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e966-e1aa-4ed3-81bf-e22ec297b839 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:14.084275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2e966-e1aa-4ed3-81bf-e22ec297b839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:14.085916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e1e2e966-e1aa-4ed3-81bf-e22ec297b839 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:14.178456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2e966-e1aa-4ed3-81bf-e22ec297b839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:14.180205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2e966-e1aa-4ed3-81bf-e22ec297b839 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:14.198379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 718/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:15.337674 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c1511-fd86-44bc-b0b1-ca0d5c464fa3 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:15.338248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c1511-fd86-44bc-b0b1-ca0d5c464fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:15.338248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c1511-fd86-44bc-b0b1-ca0d5c464fa3 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:15.339581 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:15.346028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aff66d-16ae-4eef-825d-49ac98ac5452 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:15.346450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aff66d-16ae-4eef-825d-49ac98ac5452 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:15.346568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aff66d-16ae-4eef-825d-49ac98ac5452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:15.421196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c6aff66d-16ae-4eef-825d-49ac98ac5452 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:15.422980 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c6aff66d-16ae-4eef-825d-49ac98ac5452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:15.454371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:15.523157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:15.674680 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c1511-fd86-44bc-b0b1-ca0d5c464fa3 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:15.676162 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-fc4c1511-fd86-44bc-b0b1-ca0d5c464fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:15.823279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c1511-fd86-44bc-b0b1-ca0d5c464fa3 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:15.863496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:15.934965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ff53d-d8cf-49b4-8df2-d539c3293a31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:15.935570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ff53d-d8cf-49b4-8df2-d539c3293a31 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:15.935851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ff53d-d8cf-49b4-8df2-d539c3293a31 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:15.936124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ff53d-d8cf-49b4-8df2-d539c3293a31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:15.937716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e34ff53d-d8cf-49b4-8df2-d539c3293a31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:16.025356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ff53d-d8cf-49b4-8df2-d539c3293a31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:16.026987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ff53d-d8cf-49b4-8df2-d539c3293a31 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:16.045421 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 700/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:17.186869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2f94-0ff0-48e6-8df1-86aa6bb481ef None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:17.187394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2f94-0ff0-48e6-8df1-86aa6bb481ef None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:17.187394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac2f94-0ff0-48e6-8df1-86aa6bb481ef None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:17.188748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:17.194929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121098-df2d-4817-bf8d-f02f153715b8 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:17.195339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121098-df2d-4817-bf8d-f02f153715b8 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:17.195559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121098-df2d-4817-bf8d-f02f153715b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:17.249377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:17.270631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-2d121098-df2d-4817-bf8d-f02f153715b8 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:17.271880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2d121098-df2d-4817-bf8d-f02f153715b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:17.367850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:17.519514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac2f94-0ff0-48e6-8df1-86aa6bb481ef None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:17.520965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b6ac2f94-0ff0-48e6-8df1-86aa6bb481ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:17.667032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac2f94-0ff0-48e6-8df1-86aa6bb481ef None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:17.678916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:17.790281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770bdbd-de56-4dd8-b684-12972941149c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:17.791420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770bdbd-de56-4dd8-b684-12972941149c service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:17.791834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770bdbd-de56-4dd8-b684-12972941149c service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:17.792232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770bdbd-de56-4dd8-b684-12972941149c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:17.794789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1770bdbd-de56-4dd8-b684-12972941149c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:17.894156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770bdbd-de56-4dd8-b684-12972941149c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:17.895766 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770bdbd-de56-4dd8-b684-12972941149c service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:17.913530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 721/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:19.023907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f4e55-f89d-4304-85ea-2f304db29a31 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:19.024328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f4e55-f89d-4304-85ea-2f304db29a31 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:19.024432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f4e55-f89d-4304-85ea-2f304db29a31 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:19.025734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:19.032743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa01fe-d791-4f60-8c07-e0b316e7aaf2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:19.033209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa01fe-d791-4f60-8c07-e0b316e7aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:19.033309 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa01fe-d791-4f60-8c07-e0b316e7aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:19.053035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:19.108944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-12aa01fe-d791-4f60-8c07-e0b316e7aaf2 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:19.110150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-12aa01fe-d791-4f60-8c07-e0b316e7aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:19.206137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:19.356950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f4e55-f89d-4304-85ea-2f304db29a31 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:19.358428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-893f4e55-f89d-4304-85ea-2f304db29a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:19.469274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:19.504256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f4e55-f89d-4304-85ea-2f304db29a31 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:19.613527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b06ac-7374-44ca-964f-60c65aa8c580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:19.614075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b06ac-7374-44ca-964f-60c65aa8c580 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:19.614347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b06ac-7374-44ca-964f-60c65aa8c580 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:19.614613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b06ac-7374-44ca-964f-60c65aa8c580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:19.616270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c00b06ac-7374-44ca-964f-60c65aa8c580 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:19.692206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:19.705305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b06ac-7374-44ca-964f-60c65aa8c580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:19.706992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b06ac-7374-44ca-964f-60c65aa8c580 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:19.725082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 703/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:20.832579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8377add-7533-441f-8ee6-2350115bbc39 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:20.833122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8377add-7533-441f-8ee6-2350115bbc39 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:20.833122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8377add-7533-441f-8ee6-2350115bbc39 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:20.834481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:20.841282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c64944-3455-419b-bb38-23522308b1a0 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:20.841742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c64944-3455-419b-bb38-23522308b1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:20.841866 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c64944-3455-419b-bb38-23522308b1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:20.916482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-90c64944-3455-419b-bb38-23522308b1a0 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:20.917688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-90c64944-3455-419b-bb38-23522308b1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:21.011998 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:21.165687 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8377add-7533-441f-8ee6-2350115bbc39 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:21.167265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d8377add-7533-441f-8ee6-2350115bbc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:21.250701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:21.312461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8377add-7533-441f-8ee6-2350115bbc39 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:21.423713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e05ff3-00f5-4864-8860-7b67cc545964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:21.424326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e05ff3-00f5-4864-8860-7b67cc545964 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:21.424598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e05ff3-00f5-4864-8860-7b67cc545964 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:21.424863 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e05ff3-00f5-4864-8860-7b67cc545964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:21.426460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-99e05ff3-00f5-4864-8860-7b67cc545964 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:21.474595 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:21.514834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e05ff3-00f5-4864-8860-7b67cc545964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:21.516421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e05ff3-00f5-4864-8860-7b67cc545964 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:21.534420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 724/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:22.685291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bc2f8-0b08-4c54-83de-5136fdd25598 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:22.685805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bc2f8-0b08-4c54-83de-5136fdd25598 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:22.685903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bc2f8-0b08-4c54-83de-5136fdd25598 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:22.687268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:22.693505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f757ea-cba6-40bb-bd89-a4565c0907d4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:22.693961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f757ea-cba6-40bb-bd89-a4565c0907d4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:22.694059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f757ea-cba6-40bb-bd89-a4565c0907d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:22.769390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d1f757ea-cba6-40bb-bd89-a4565c0907d4 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:22.770593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d1f757ea-cba6-40bb-bd89-a4565c0907d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:22.864976 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:11:23.015884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bc2f8-0b08-4c54-83de-5136fdd25598 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:23.017368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-de4bc2f8-0b08-4c54-83de-5136fdd25598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:23.066323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:23.161586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bc2f8-0b08-4c54-83de-5136fdd25598 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:23.272402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156901f-8b6c-4a11-8128-30e458e0814e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:23.272935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156901f-8b6c-4a11-8128-30e458e0814e service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:23.273217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156901f-8b6c-4a11-8128-30e458e0814e service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:23.273491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156901f-8b6c-4a11-8128-30e458e0814e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:23.275124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1156901f-8b6c-4a11-8128-30e458e0814e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:23.281942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:23.363672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156901f-8b6c-4a11-8128-30e458e0814e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:23.365263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156901f-8b6c-4a11-8128-30e458e0814e service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:23.383589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 706/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:24.494135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7ba9-81ff-4d50-9bb9-c0926474f06a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:24.494719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7ba9-81ff-4d50-9bb9-c0926474f06a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:24.494719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7ba9-81ff-4d50-9bb9-c0926474f06a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:24.496106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:24.502528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1294baf-3b63-4d87-8236-41ca4402134c None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:24.506285 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1294baf-3b63-4d87-8236-41ca4402134c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:24.506285 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1294baf-3b63-4d87-8236-41ca4402134c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:24.580830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-d1294baf-3b63-4d87-8236-41ca4402134c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:24.582045 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d1294baf-3b63-4d87-8236-41ca4402134c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:24.647762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:24.675734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:24.825348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7ba9-81ff-4d50-9bb9-c0926474f06a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:24.826875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0f2a7ba9-81ff-4d50-9bb9-c0926474f06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:24.844090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:24.969509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7ba9-81ff-4d50-9bb9-c0926474f06a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:25.055500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:25.081206 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179719f5-0f2b-4a7c-9269-906d52f5050e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:25.081818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179719f5-0f2b-4a7c-9269-906d52f5050e service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:25.082321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179719f5-0f2b-4a7c-9269-906d52f5050e service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:25.082614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179719f5-0f2b-4a7c-9269-906d52f5050e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:25.084690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-179719f5-0f2b-4a7c-9269-906d52f5050e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:25.171978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179719f5-0f2b-4a7c-9269-906d52f5050e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:25.173574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179719f5-0f2b-4a7c-9269-906d52f5050e service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:25.191542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 727/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:26.284822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2c72a-1e9c-4d5d-85e5-bdc2c5c81be6 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:26.285379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2c72a-1e9c-4d5d-85e5-bdc2c5c81be6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:26.285379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2c72a-1e9c-4d5d-85e5-bdc2c5c81be6 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:26.287000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:26.293259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bc36a-0a38-45b7-a18a-3e9814ed0d7d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:26.293730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bc36a-0a38-45b7-a18a-3e9814ed0d7d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:26.293863 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bc36a-0a38-45b7-a18a-3e9814ed0d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:26.369135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-269bc36a-0a38-45b7-a18a-3e9814ed0d7d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:26.370350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-269bc36a-0a38-45b7-a18a-3e9814ed0d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:26.412318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:26.467660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:26.619202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2c72a-1e9c-4d5d-85e5-bdc2c5c81be6 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:26.620677 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-08d2c72a-1e9c-4d5d-85e5-bdc2c5c81be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:26.764266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2c72a-1e9c-4d5d-85e5-bdc2c5c81be6 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:26.818164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:26.875925 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd8643-0a44-4240-8dc2-3f733bdffaf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:26.876459 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd8643-0a44-4240-8dc2-3f733bdffaf0 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:26.876732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd8643-0a44-4240-8dc2-3f733bdffaf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:26.876999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd8643-0a44-4240-8dc2-3f733bdffaf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:26.878581 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-18fd8643-0a44-4240-8dc2-3f733bdffaf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:26.965595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd8643-0a44-4240-8dc2-3f733bdffaf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:26.967220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd8643-0a44-4240-8dc2-3f733bdffaf0 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:26.985083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 709/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:28.080929 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddfc70-ef34-44f8-b4d5-8f65b7ec9ec7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:28.081502 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddfc70-ef34-44f8-b4d5-8f65b7ec9ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:28.081502 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddfc70-ef34-44f8-b4d5-8f65b7ec9ec7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:28.082830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:28.089204 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd25bb-f9ca-4e22-8a51-1b22405914d5 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:28.089671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd25bb-f9ca-4e22-8a51-1b22405914d5 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:28.089782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd25bb-f9ca-4e22-8a51-1b22405914d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:28.282330 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-69dd25bb-f9ca-4e22-8a51-1b22405914d5 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:28.283590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-69dd25bb-f9ca-4e22-8a51-1b22405914d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:28.285776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:28.380227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:28.529119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddfc70-ef34-44f8-b4d5-8f65b7ec9ec7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:28.530640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ecddfc70-ef34-44f8-b4d5-8f65b7ec9ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:28.673963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddfc70-ef34-44f8-b4d5-8f65b7ec9ec7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:28.701722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:28.786451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b8464-3998-410e-a537-11c665396955 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:28.787093 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8464-3998-410e-a537-11c665396955 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:28.787370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8464-3998-410e-a537-11c665396955 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:28.787641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b8464-3998-410e-a537-11c665396955 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:28.789243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5a2b8464-3998-410e-a537-11c665396955 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:28.880161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b8464-3998-410e-a537-11c665396955 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:28.881768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b8464-3998-410e-a537-11c665396955 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:28.899658 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 730/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:30.971084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd081e-f12e-495f-81d0-ac5ea2908f64 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:30.971685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd081e-f12e-495f-81d0-ac5ea2908f64 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:30.971685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd081e-f12e-495f-81d0-ac5ea2908f64 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:30.972943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:30.978223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43835e95-bccf-4256-9434-631ab880283e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:30.978626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43835e95-bccf-4256-9434-631ab880283e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:30.978855 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43835e95-bccf-4256-9434-631ab880283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:31.020222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:31.045393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-43835e95-bccf-4256-9434-631ab880283e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:31.046599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-43835e95-bccf-4256-9434-631ab880283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:31.140732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:31.431384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd081e-f12e-495f-81d0-ac5ea2908f64 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:31.432920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-66dd081e-f12e-495f-81d0-ac5ea2908f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:31.534114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd081e-f12e-495f-81d0-ac5ea2908f64 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:31.566146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:31.606253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856ff5-01c8-4e1c-b483-165d994a2995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:31.607135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856ff5-01c8-4e1c-b483-165d994a2995 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:31.607475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856ff5-01c8-4e1c-b483-165d994a2995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:31.607893 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856ff5-01c8-4e1c-b483-165d994a2995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:31.609856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-72856ff5-01c8-4e1c-b483-165d994a2995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:31.716654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72856ff5-01c8-4e1c-b483-165d994a2995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:31.718116 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72856ff5-01c8-4e1c-b483-165d994a2995 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:31.735523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 712/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:34.143596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb963dc0-7d34-467b-9d4a-f485bd3fe42f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:34.144160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb963dc0-7d34-467b-9d4a-f485bd3fe42f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:34.144160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb963dc0-7d34-467b-9d4a-f485bd3fe42f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:34.145480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:34.150637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b61ca-df26-4b96-9b09-6de5a8d2e478 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:34.151098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b61ca-df26-4b96-9b09-6de5a8d2e478 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:34.151225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b61ca-df26-4b96-9b09-6de5a8d2e478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:34.220791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-537b61ca-df26-4b96-9b09-6de5a8d2e478 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:34.222007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-537b61ca-df26-4b96-9b09-6de5a8d2e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:34.234606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:34.317020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:34.596790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb963dc0-7d34-467b-9d4a-f485bd3fe42f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:34.600118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-eb963dc0-7d34-467b-9d4a-f485bd3fe42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:34.699937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb963dc0-7d34-467b-9d4a-f485bd3fe42f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:34.712762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:34.772783 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49635bc9-4d2b-4200-ab80-1e35dffb752e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:34.773382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635bc9-4d2b-4200-ab80-1e35dffb752e service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:34.773739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635bc9-4d2b-4200-ab80-1e35dffb752e service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:34.774017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49635bc9-4d2b-4200-ab80-1e35dffb752e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:34.775633 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-49635bc9-4d2b-4200-ab80-1e35dffb752e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:34.883393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635bc9-4d2b-4200-ab80-1e35dffb752e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:34.884821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49635bc9-4d2b-4200-ab80-1e35dffb752e service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:34.902267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 733/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:37.387766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6e27e-adb5-479f-895b-a37b6e4421a1 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:37.388336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6e27e-adb5-479f-895b-a37b6e4421a1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:37.388336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6e27e-adb5-479f-895b-a37b6e4421a1 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:37.389669 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:37.395142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4e848-1621-43c6-8b19-38fc92b62710 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:37.395567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4e848-1621-43c6-8b19-38fc92b62710 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:37.395678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4e848-1621-43c6-8b19-38fc92b62710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:37.443446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:37.460852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c1b4e848-1621-43c6-8b19-38fc92b62710 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:37.462052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c1b4e848-1621-43c6-8b19-38fc92b62710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:37.557837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:11:37.842972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6e27e-adb5-479f-895b-a37b6e4421a1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:37.844525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0aa6e27e-adb5-479f-895b-a37b6e4421a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:37.944863 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6e27e-adb5-479f-895b-a37b6e4421a1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:37.984144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:38.017406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95e9b9-a6ea-4d8b-9b7a-16baf556e7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:38.018007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e9b9-a6ea-4d8b-9b7a-16baf556e7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:38.018283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e9b9-a6ea-4d8b-9b7a-16baf556e7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:38.018582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95e9b9-a6ea-4d8b-9b7a-16baf556e7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:38.020193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-bb95e9b9-a6ea-4d8b-9b7a-16baf556e7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:38.126417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95e9b9-a6ea-4d8b-9b7a-16baf556e7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:38.127829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95e9b9-a6ea-4d8b-9b7a-16baf556e7b8 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:38.146077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 715/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:40.469558 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b4ed0-73b7-4c83-a092-dd191a72beda None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:40.470115 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b4ed0-73b7-4c83-a092-dd191a72beda None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:40.470115 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b4ed0-73b7-4c83-a092-dd191a72beda None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:40.471496 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:11:40.478141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bab43-d990-400f-a246-6a566b6ed93d None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:40.478141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bab43-d990-400f-a246-6a566b6ed93d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:40.478141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bab43-d990-400f-a246-6a566b6ed93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:40.544480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-7b8bab43-d990-400f-a246-6a566b6ed93d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:40.545731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7b8bab43-d990-400f-a246-6a566b6ed93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:40.567168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:40.642424 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:40.925435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b4ed0-73b7-4c83-a092-dd191a72beda None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:40.927089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-386b4ed0-73b7-4c83-a092-dd191a72beda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:41.028719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b4ed0-73b7-4c83-a092-dd191a72beda None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:41.050049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:41.101414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a314c-68dd-4971-970b-0e79e126c246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:41.102016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a314c-68dd-4971-970b-0e79e126c246 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:41.102290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a314c-68dd-4971-970b-0e79e126c246 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:41.102559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a314c-68dd-4971-970b-0e79e126c246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:41.104216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9e8a314c-68dd-4971-970b-0e79e126c246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:41.211885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a314c-68dd-4971-970b-0e79e126c246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:41.213322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a314c-68dd-4971-970b-0e79e126c246 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:41.232328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 736/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:43.417125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c08e4-70b6-4c7b-b288-fb2fc49f1390 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:43.417702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c08e4-70b6-4c7b-b288-fb2fc49f1390 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:43.417702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c08e4-70b6-4c7b-b288-fb2fc49f1390 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:43.419093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:43.424594 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0b57-de41-44d3-abe6-cee761bdfa89 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:43.424967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0b57-de41-44d3-abe6-cee761bdfa89 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:43.425147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0b57-de41-44d3-abe6-cee761bdfa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:43.487560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:43.490142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-99dd0b57-de41-44d3-abe6-cee761bdfa89 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:43.491388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-99dd0b57-de41-44d3-abe6-cee761bdfa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:43.586496 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:43.869387 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c08e4-70b6-4c7b-b288-fb2fc49f1390 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:43.871567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-334c08e4-70b6-4c7b-b288-fb2fc49f1390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:43.971950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c08e4-70b6-4c7b-b288-fb2fc49f1390 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:44.020173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:44.044428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e7b62-7eef-4044-b7c9-5dcef4953e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:44.045025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e7b62-7eef-4044-b7c9-5dcef4953e34 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:44.056944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e7b62-7eef-4044-b7c9-5dcef4953e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:44.056944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e7b62-7eef-4044-b7c9-5dcef4953e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:44.056944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-cb6e7b62-7eef-4044-b7c9-5dcef4953e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:44.154435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e7b62-7eef-4044-b7c9-5dcef4953e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:44.156567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e7b62-7eef-4044-b7c9-5dcef4953e34 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:44.174799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 718/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:46.391316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc97b-68de-44d8-b938-a91be9b29de6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:46.391864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc97b-68de-44d8-b938-a91be9b29de6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:46.391864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc97b-68de-44d8-b938-a91be9b29de6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:46.393267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:46.398934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eddb0-6d4c-4b32-b6cc-e83cb2eb7e3e None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:46.399421 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eddb0-6d4c-4b32-b6cc-e83cb2eb7e3e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:46.399522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eddb0-6d4c-4b32-b6cc-e83cb2eb7e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:46.466088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c74eddb0-6d4c-4b32-b6cc-e83cb2eb7e3e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:46.467350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c74eddb0-6d4c-4b32-b6cc-e83cb2eb7e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:46.497201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:46.564068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:46.849051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dc97b-68de-44d8-b938-a91be9b29de6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:46.850594 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-018dc97b-68de-44d8-b938-a91be9b29de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:46.953301 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dc97b-68de-44d8-b938-a91be9b29de6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:46.981974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:47.027556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaa520-a95c-4761-bb6b-dc3a2e5bd79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:47.028094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa520-a95c-4761-bb6b-dc3a2e5bd79d service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:47.028372 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa520-a95c-4761-bb6b-dc3a2e5bd79d service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:47.028644 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaa520-a95c-4761-bb6b-dc3a2e5bd79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:47.030253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ccfaa520-a95c-4761-bb6b-dc3a2e5bd79d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:47.138349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaa520-a95c-4761-bb6b-dc3a2e5bd79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:47.139818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaa520-a95c-4761-bb6b-dc3a2e5bd79d service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:47.158429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 739/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:49.364694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc56f9-b631-4991-8836-36d477a5dca3 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:49.365291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc56f9-b631-4991-8836-36d477a5dca3 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:49.365291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc56f9-b631-4991-8836-36d477a5dca3 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:49.366563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:49.372435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d54e-8422-4fac-af39-7e177a5ec5e3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:49.372841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d54e-8422-4fac-af39-7e177a5ec5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:49.373005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7d54e-8422-4fac-af39-7e177a5ec5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:49.438417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-36d7d54e-8422-4fac-af39-7e177a5ec5e3 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:49.439652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-36d7d54e-8422-4fac-af39-7e177a5ec5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:49.447734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:49.533597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:49.820499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc56f9-b631-4991-8836-36d477a5dca3 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:49.822060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7bcc56f9-b631-4991-8836-36d477a5dca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:49.922297 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc56f9-b631-4991-8836-36d477a5dca3 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:49.975861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:49.993313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e940b-9a5e-4b4f-86c8-ff0714d18fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:50.000999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e940b-9a5e-4b4f-86c8-ff0714d18fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:50.000999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e940b-9a5e-4b4f-86c8-ff0714d18fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:50.000999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e940b-9a5e-4b4f-86c8-ff0714d18fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:50.000999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-578e940b-9a5e-4b4f-86c8-ff0714d18fa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:50.102231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e940b-9a5e-4b4f-86c8-ff0714d18fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:50.103647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e940b-9a5e-4b4f-86c8-ff0714d18fa2 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:50.121644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 721/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:52.412616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d6bb-9a47-4862-a429-08228f0b5e49 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:52.413137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d6bb-9a47-4862-a429-08228f0b5e49 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:52.413137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3d6bb-9a47-4862-a429-08228f0b5e49 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:52.414493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:52.420150 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ba2c-2220-4d90-a8d3-5717820ffb40 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:52.420606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ba2c-2220-4d90-a8d3-5717820ffb40 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:52.420853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ba2c-2220-4d90-a8d3-5717820ffb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:52.485851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-ba92ba2c-2220-4d90-a8d3-5717820ffb40 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:52.487088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ba92ba2c-2220-4d90-a8d3-5717820ffb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:52.524996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:52.582380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:52.862541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3d6bb-9a47-4862-a429-08228f0b5e49 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:52.864113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-12c3d6bb-9a47-4862-a429-08228f0b5e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:52.965995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3d6bb-9a47-4862-a429-08228f0b5e49 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:53.003777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:53.038619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb5d28-b05b-47cb-81fa-dc1082f07cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:53.039232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb5d28-b05b-47cb-81fa-dc1082f07cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:53.039503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb5d28-b05b-47cb-81fa-dc1082f07cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:53.039764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb5d28-b05b-47cb-81fa-dc1082f07cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:53.041343 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8ffb5d28-b05b-47cb-81fa-dc1082f07cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:53.147486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb5d28-b05b-47cb-81fa-dc1082f07cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:53.148910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb5d28-b05b-47cb-81fa-dc1082f07cd7 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:53.169404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 742/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:55.319805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bb92d-2ae8-4eec-b3bb-28775bc6db26 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:55.320346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bb92d-2ae8-4eec-b3bb-28775bc6db26 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:55.320346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883bb92d-2ae8-4eec-b3bb-28775bc6db26 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:55.321799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:55.327946 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05067887-b2a3-48a7-a8d1-0044b8ec6981 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:55.328388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05067887-b2a3-48a7-a8d1-0044b8ec6981 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:55.328497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05067887-b2a3-48a7-a8d1-0044b8ec6981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:55.394380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-05067887-b2a3-48a7-a8d1-0044b8ec6981 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:55.395627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-05067887-b2a3-48a7-a8d1-0044b8ec6981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:55.413637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:55.493063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:55.773124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bb92d-2ae8-4eec-b3bb-28775bc6db26 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:55.774688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-883bb92d-2ae8-4eec-b3bb-28775bc6db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:55.874221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883bb92d-2ae8-4eec-b3bb-28775bc6db26 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:55.938971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:55.945253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f3e1f-5973-48fb-9fdd-d3605cf5f228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:55.945846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f3e1f-5973-48fb-9fdd-d3605cf5f228 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:55.946118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f3e1f-5973-48fb-9fdd-d3605cf5f228 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:55.946381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f3e1f-5973-48fb-9fdd-d3605cf5f228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:55.947974 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-bb4f3e1f-5973-48fb-9fdd-d3605cf5f228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:56.056117 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f3e1f-5973-48fb-9fdd-d3605cf5f228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:56.057473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f3e1f-5973-48fb-9fdd-d3605cf5f228 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:56.075116 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 724/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:11:58.207492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe325a-f4b4-44d8-9fb8-00d41dcd98f1 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:58.208341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe325a-f4b4-44d8-9fb8-00d41dcd98f1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:58.208341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe325a-f4b4-44d8-9fb8-00d41dcd98f1 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:58.209901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:11:58.215354 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb199b-7994-4681-8da2-ddce22a7b990 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:58.215759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb199b-7994-4681-8da2-ddce22a7b990 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:58.215898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb199b-7994-4681-8da2-ddce22a7b990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:58.283061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-45eb199b-7994-4681-8da2-ddce22a7b990 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:11:58.284280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-45eb199b-7994-4681-8da2-ddce22a7b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:58.335395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:58.386522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:11:58.669511 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe325a-f4b4-44d8-9fb8-00d41dcd98f1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:11:58.671090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-eabe325a-f4b4-44d8-9fb8-00d41dcd98f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:58.771830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe325a-f4b4-44d8-9fb8-00d41dcd98f1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:11:58.819233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:58.844780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0697fa-bcb3-48ef-b2c1-6e82a1fd6fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:11:58.848527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0697fa-bcb3-48ef-b2c1-6e82a1fd6fea service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:11:58.848527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0697fa-bcb3-48ef-b2c1-6e82a1fd6fea service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:11:58.848527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0697fa-bcb3-48ef-b2c1-6e82a1fd6fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:11:58.848527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4e0697fa-bcb3-48ef-b2c1-6e82a1fd6fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:11:58.954603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0697fa-bcb3-48ef-b2c1-6e82a1fd6fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:11:58.956054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0697fa-bcb3-48ef-b2c1-6e82a1fd6fea service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:11:58.974317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 745/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:12:08.383976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=22 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:08.972098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=66 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:19.029386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3dfa-a61b-4bae-a94e-07e73fe1622c None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:19.029934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3dfa-a61b-4bae-a94e-07e73fe1622c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:19.029934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3dfa-a61b-4bae-a94e-07e73fe1622c None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:19.031374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 726/1471] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:12:19.036813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70377424-a7f1-4e1b-b1c6-fec128088b4f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:19.037248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70377424-a7f1-4e1b-b1c6-fec128088b4f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:19.037353 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70377424-a7f1-4e1b-b1c6-fec128088b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:19.111785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-70377424-a7f1-4e1b-b1c6-fec128088b4f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:12:19.113010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-70377424-a7f1-4e1b-b1c6-fec128088b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:19.211318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 746/1472] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:12:19.516957 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb48bd8-f71a-446d-8a08-cb1b63c7f43f None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:19.517237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb48bd8-f71a-446d-8a08-cb1b63c7f43f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:19.517508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb48bd8-f71a-446d-8a08-cb1b63c7f43f None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:19.518867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 727/1473] 10.222.0.23 () {54 vars in 966 bytes} [Thu Sep 8 16:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:12:19.523792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097879f-1529-415e-9fd4-87f2e67ec28e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:19.524074 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097879f-1529-415e-9fd4-87f2e67ec28e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:19.524344 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097879f-1529-415e-9fd4-87f2e67ec28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:19.599283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3097879f-1529-415e-9fd4-87f2e67ec28e None None] MFA Rules not processed for user `d0892bfab3ce435b90b93b0786899f84`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:12:19.600477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3097879f-1529-415e-9fd4-87f2e67ec28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:19.620975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:19.676274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 747/1474] 10.222.0.23 () {58 vars in 1063 bytes} [Thu Sep 8 16:12:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:12:19.684461 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb48bd8-f71a-446d-8a08-cb1b63c7f43f None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:12:19.686008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0cb48bd8-f71a-446d-8a08-cb1b63c7f43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:19.788684 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb48bd8-f71a-446d-8a08-cb1b63c7f43f None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:12:19.861175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5f462-7a32-4743-9e5b-13dbff419509 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0892bfab3ce435b90b93b0786899f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:12:19.861784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f462-7a32-4743-9e5b-13dbff419509 service glance] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:19.862068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f462-7a32-4743-9e5b-13dbff419509 service glance] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:19.862341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f462-7a32-4743-9e5b-13dbff419509 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:19.863978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7fd5f462-7a32-4743-9e5b-13dbff419509 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:19.917669 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:19.970743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5f462-7a32-4743-9e5b-13dbff419509 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:12:19.972193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5f462-7a32-4743-9e5b-13dbff419509 service glance] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:12:19.990590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 728/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:12:22.247537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca35e3-f7a5-41ad-998c-0a3ea740bd17 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:22.252522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca35e3-f7a5-41ad-998c-0a3ea740bd17 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:22.252522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca35e3-f7a5-41ad-998c-0a3ea740bd17 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:22.252522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 748/1476] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:12:22.254733 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b146a-a2d1-4a41-887b-cb2d1c0da7b3 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:22.255134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b146a-a2d1-4a41-887b-cb2d1c0da7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:22.255283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b146a-a2d1-4a41-887b-cb2d1c0da7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:22.320697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-6d2b146a-a2d1-4a41-887b-cb2d1c0da7b3 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:12:22.322058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6d2b146a-a2d1-4a41-887b-cb2d1c0da7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:22.419081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 729/1477] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:12:22.695961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca35e3-f7a5-41ad-998c-0a3ea740bd17 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:12:22.697541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-50ca35e3-f7a5-41ad-998c-0a3ea740bd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:22.821843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca35e3-f7a5-41ad-998c-0a3ea740bd17 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:12:22.871814 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:22.913967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17956fef-f7cf-46ba-861e-9601e9af2e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:12:22.914566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956fef-f7cf-46ba-861e-9601e9af2e38 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:22.914881 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956fef-f7cf-46ba-861e-9601e9af2e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:22.915150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17956fef-f7cf-46ba-861e-9601e9af2e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:22.915796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17956fef-f7cf-46ba-861e-9601e9af2e38 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:12:22.919020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-17956fef-f7cf-46ba-861e-9601e9af2e38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:12:22.919020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Sep 08 16:12:22.919020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: Sep 08 16:12:22.920190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17956fef-f7cf-46ba-861e-9601e9af2e38 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:12:22.939874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 749/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Sep 8 16:12:22 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:12:25.093838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311496c-deb4-49f2-97fa-149c94b75b9f None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:25.094344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311496c-deb4-49f2-97fa-149c94b75b9f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:25.094344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311496c-deb4-49f2-97fa-149c94b75b9f None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:25.095679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 730/1479] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:12:25.101028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9b0b-7e8a-4ce0-a5a9-0eafeba350a3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:25.101499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9b0b-7e8a-4ce0-a5a9-0eafeba350a3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:25.101597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9b0b-7e8a-4ce0-a5a9-0eafeba350a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:25.167339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4d4e9b0b-7e8a-4ce0-a5a9-0eafeba350a3 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:12:25.168571 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4d4e9b0b-7e8a-4ce0-a5a9-0eafeba350a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:25.263376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 750/1480] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:12:25.557545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311496c-deb4-49f2-97fa-149c94b75b9f None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:12:25.559118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e311496c-deb4-49f2-97fa-149c94b75b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:25.569647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:25.705259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311496c-deb4-49f2-97fa-149c94b75b9f None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:12:25.782822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:25.815192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef0214-9975-48b2-b7c3-577ef053fdb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:12:25.815868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef0214-9975-48b2-b7c3-577ef053fdb0 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:25.816334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef0214-9975-48b2-b7c3-577ef053fdb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:25.816774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef0214-9975-48b2-b7c3-577ef053fdb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:25.818645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0aef0214-9975-48b2-b7c3-577ef053fdb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:25.905755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef0214-9975-48b2-b7c3-577ef053fdb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:12:25.907383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef0214-9975-48b2-b7c3-577ef053fdb0 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:12:25.925782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 731/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:12:28.249104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08cab-678c-4569-8d34-69d99c535b1a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:28.249684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08cab-678c-4569-8d34-69d99c535b1a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:28.249684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08cab-678c-4569-8d34-69d99c535b1a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:28.251032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 751/1482] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:12:28.256560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fe0da-25ae-44d0-a274-4bde2f3e9f77 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:28.257012 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fe0da-25ae-44d0-a274-4bde2f3e9f77 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:28.257121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fe0da-25ae-44d0-a274-4bde2f3e9f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:28.323104 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-955fe0da-25ae-44d0-a274-4bde2f3e9f77 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:12:28.324359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-955fe0da-25ae-44d0-a274-4bde2f3e9f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:28.370424 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:28.421861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 732/1483] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:12:28.708460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e08cab-678c-4569-8d34-69d99c535b1a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:12:28.710037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d9e08cab-678c-4569-8d34-69d99c535b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:28.734459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:28.812868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e08cab-678c-4569-8d34-69d99c535b1a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:12:28.884304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec2d5b-610b-4d9c-b301-f02e72437890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:12:28.885562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec2d5b-610b-4d9c-b301-f02e72437890 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:28.885837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec2d5b-610b-4d9c-b301-f02e72437890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:28.886102 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec2d5b-610b-4d9c-b301-f02e72437890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:28.887713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-40ec2d5b-610b-4d9c-b301-f02e72437890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:28.962444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:28.996275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec2d5b-610b-4d9c-b301-f02e72437890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:12:28.997703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec2d5b-610b-4d9c-b301-f02e72437890 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:12:29.133169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 752/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:12:31.321338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d7ec3-3ea8-4c3e-993d-ed88ede24a2e None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:31.321919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d7ec3-3ea8-4c3e-993d-ed88ede24a2e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:31.321919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d7ec3-3ea8-4c3e-993d-ed88ede24a2e None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:31.323784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 733/1485] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:12:31.329113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943494d-9cee-48c0-b03e-5ee8ce0036cb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:31.329555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943494d-9cee-48c0-b03e-5ee8ce0036cb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:31.329651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943494d-9cee-48c0-b03e-5ee8ce0036cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:31.394922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2943494d-9cee-48c0-b03e-5ee8ce0036cb None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:12:31.396130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2943494d-9cee-48c0-b03e-5ee8ce0036cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:31.492730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 753/1486] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:12:31.790490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d7ec3-3ea8-4c3e-993d-ed88ede24a2e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:12:31.792841 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6f9d7ec3-3ea8-4c3e-993d-ed88ede24a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:31.912759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d7ec3-3ea8-4c3e-993d-ed88ede24a2e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:12:31.988971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:31.990426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa39a67-c06d-47d3-8455-7dbded3c9e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:12:31.991114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa39a67-c06d-47d3-8455-7dbded3c9e3a service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:31.991384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa39a67-c06d-47d3-8455-7dbded3c9e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:31.991660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa39a67-c06d-47d3-8455-7dbded3c9e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:31.993319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9aa39a67-c06d-47d3-8455-7dbded3c9e3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:32.099268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa39a67-c06d-47d3-8455-7dbded3c9e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:12:32.100621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa39a67-c06d-47d3-8455-7dbded3c9e3a service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:12:32.118476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 734/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:12:34.460939 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8194b-315e-4ca9-834c-0008f2084aa9 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:34.461500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8194b-315e-4ca9-834c-0008f2084aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:34.461500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8194b-315e-4ca9-834c-0008f2084aa9 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:34.463380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 754/1488] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:12:34.468739 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5db5-07ec-4f60-a649-2eba8b132ea9 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:34.469191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5db5-07ec-4f60-a649-2eba8b132ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:34.469297 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a5db5-07ec-4f60-a649-2eba8b132ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:34.537636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-019a5db5-07ec-4f60-a649-2eba8b132ea9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:12:34.538899 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-019a5db5-07ec-4f60-a649-2eba8b132ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:34.599885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:34.643848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 735/1489] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:12:34.939569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8194b-315e-4ca9-834c-0008f2084aa9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:12:34.941098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9bd8194b-315e-4ca9-834c-0008f2084aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:34.977557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:35.044128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8194b-315e-4ca9-834c-0008f2084aa9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:12:35.116168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ebee7-ad77-42fd-b4e9-af1158ecb841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:12:35.116706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ebee7-ad77-42fd-b4e9-af1158ecb841 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:35.116982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ebee7-ad77-42fd-b4e9-af1158ecb841 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:35.117251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ebee7-ad77-42fd-b4e9-af1158ecb841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:35.119380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-620ebee7-ad77-42fd-b4e9-af1158ecb841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:35.199888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:35.227997 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ebee7-ad77-42fd-b4e9-af1158ecb841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:12:35.229452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ebee7-ad77-42fd-b4e9-af1158ecb841 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:12:35.248014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 755/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:12:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:12:37.836277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf3a3-8cf4-4f7c-bfdf-851409d47a0b None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:37.836837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf3a3-8cf4-4f7c-bfdf-851409d47a0b None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:37.836837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbf3a3-8cf4-4f7c-bfdf-851409d47a0b None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:37.838185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 736/1491] 10.222.0.23 () {54 vars in 927 bytes} [Thu Sep 8 16:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:12:37.843591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0253d-8554-43e3-a819-01b2ec7e3780 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:37.843990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0253d-8554-43e3-a819-01b2ec7e3780 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:37.844130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0253d-8554-43e3-a819-01b2ec7e3780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:37.911220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d3f0253d-8554-43e3-a819-01b2ec7e3780 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:12:37.912686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d3f0253d-8554-43e3-a819-01b2ec7e3780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:38.007029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 756/1492] 10.222.0.23 () {58 vars in 1024 bytes} [Thu Sep 8 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:12:38.300048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbf3a3-8cf4-4f7c-bfdf-851409d47a0b None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:12:38.301648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-96cbf3a3-8cf4-4f7c-bfdf-851409d47a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:38.404856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbf3a3-8cf4-4f7c-bfdf-851409d47a0b None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:12:38.478555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278795ff-1aeb-4482-9426-86355f9b716f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:12:38.479182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278795ff-1aeb-4482-9426-86355f9b716f service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:12:38.479456 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278795ff-1aeb-4482-9426-86355f9b716f service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:12:38.479723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278795ff-1aeb-4482-9426-86355f9b716f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:12:38.481409 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-278795ff-1aeb-4482-9426-86355f9b716f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:12:38.490523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:38.590278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278795ff-1aeb-4482-9426-86355f9b716f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:12:38.591681 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278795ff-1aeb-4482-9426-86355f9b716f service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:12:38.609373 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 737/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:12:48.005477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=82 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:48.607083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=50 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:00.420254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d2e9-ffaf-4adf-a13a-267ff9993db8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:00.420938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d2e9-ffaf-4adf-a13a-267ff9993db8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:00.420938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d2e9-ffaf-4adf-a13a-267ff9993db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:00.494950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5041d2e9-ffaf-4adf-a13a-267ff9993db8 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:14:00.496142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5041d2e9-ffaf-4adf-a13a-267ff9993db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:00.589367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 757/1494] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:14:00.597404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19856da0-93d3-4123-80bd-9e0eb6f9303b None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:00.597880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19856da0-93d3-4123-80bd-9e0eb6f9303b None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:00.598011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19856da0-93d3-4123-80bd-9e0eb6f9303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:00.672531 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-19856da0-93d3-4123-80bd-9e0eb6f9303b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:14:00.673733 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-19856da0-93d3-4123-80bd-9e0eb6f9303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:00.767010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 738/1495] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:14:00.771681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d2e9-ffaf-4adf-a13a-267ff9993db8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:14:00.773376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5041d2e9-ffaf-4adf-a13a-267ff9993db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:00.784517 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d2e9-ffaf-4adf-a13a-267ff9993db8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:14:00.844397 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:00.878834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d031f9-243f-4068-9795-0fbfc81c9ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:14:00.879437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d031f9-243f-4068-9795-0fbfc81c9ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:00.879714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d031f9-243f-4068-9795-0fbfc81c9ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:00.879982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d031f9-243f-4068-9795-0fbfc81c9ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:00.880623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d031f9-243f-4068-9795-0fbfc81c9ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:14:00.880923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d031f9-243f-4068-9795-0fbfc81c9ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:14:00.882442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-e1d031f9-243f-4068-9795-0fbfc81c9ea1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:14:00.882442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Sep 08 16:14:00.882442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: Sep 08 16:14:00.883354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d031f9-243f-4068-9795-0fbfc81c9ea1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:14:00.894357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 758/1496] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:14:00.903197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19856da0-93d3-4123-80bd-9e0eb6f9303b None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:14:00.912162 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19856da0-93d3-4123-80bd-9e0eb6f9303b None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:14:00.971984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:01.004672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd416ac-b2d6-430a-9362-a06aeec0caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:14:01.005270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd416ac-b2d6-430a-9362-a06aeec0caa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:01.005539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd416ac-b2d6-430a-9362-a06aeec0caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:01.005803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd416ac-b2d6-430a-9362-a06aeec0caa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:01.006985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd416ac-b2d6-430a-9362-a06aeec0caa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:14:01.008701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: WARNING py.warnings [None req-1bd416ac-b2d6-430a-9362-a06aeec0caa7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:14:01.008701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: warnings.warn(msg) Sep 08 16:14:01.008701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: Sep 08 16:14:01.009876 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd416ac-b2d6-430a-9362-a06aeec0caa7 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:14:01.110992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 739/1497] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:14:00 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:14:01.115200 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d031f9-243f-4068-9795-0fbfc81c9ea1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:14:01.116729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e1d031f9-243f-4068-9795-0fbfc81c9ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:01.151658 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d031f9-243f-4068-9795-0fbfc81c9ea1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:14:01.242674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c6281-bbd5-4665-90d2-d41cabeace8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:14:01.243294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c6281-bbd5-4665-90d2-d41cabeace8c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:01.243566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c6281-bbd5-4665-90d2-d41cabeace8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:01.243830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c6281-bbd5-4665-90d2-d41cabeace8c admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:01.244442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c6281-bbd5-4665-90d2-d41cabeace8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:14:01.245441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-948c6281-bbd5-4665-90d2-d41cabeace8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:14:01.245441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Sep 08 16:14:01.245441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: Sep 08 16:14:01.246631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c6281-bbd5-4665-90d2-d41cabeace8c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:14:01.364769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 759/1498] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:14:01 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:14:01.369305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd416ac-b2d6-430a-9362-a06aeec0caa7 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:14:01.370822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1bd416ac-b2d6-430a-9362-a06aeec0caa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:01.432816 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd416ac-b2d6-430a-9362-a06aeec0caa7 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:14:01.514802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:01.524668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2622a3b-5a3b-479b-8ac9-1293c3e9488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:14:01.525266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2622a3b-5a3b-479b-8ac9-1293c3e9488d admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:01.525538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2622a3b-5a3b-479b-8ac9-1293c3e9488d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:01.525801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2622a3b-5a3b-479b-8ac9-1293c3e9488d admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:01.526425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2622a3b-5a3b-479b-8ac9-1293c3e9488d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:14:01.527473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: WARNING py.warnings [None req-c2622a3b-5a3b-479b-8ac9-1293c3e9488d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:14:01.527473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: warnings.warn(msg) Sep 08 16:14:01.527473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: Sep 08 16:14:01.528389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2622a3b-5a3b-479b-8ac9-1293c3e9488d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:14:01.541438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 740/1499] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:14:01.545227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c6281-bbd5-4665-90d2-d41cabeace8c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:14:01.546783 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-948c6281-bbd5-4665-90d2-d41cabeace8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:01.558847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c6281-bbd5-4665-90d2-d41cabeace8c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:14:01.584273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:01.654574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d933c2-114c-4676-815b-46906bf6dfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:14:01.655131 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d933c2-114c-4676-815b-46906bf6dfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:01.655409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d933c2-114c-4676-815b-46906bf6dfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:01.655677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d933c2-114c-4676-815b-46906bf6dfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:01.656312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d933c2-114c-4676-815b-46906bf6dfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:14:01.657307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-b6d933c2-114c-4676-815b-46906bf6dfe2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:14:01.657307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Sep 08 16:14:01.657307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: Sep 08 16:14:01.658201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d933c2-114c-4676-815b-46906bf6dfe2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:14:01.671566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 760/1500] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:14:01.675709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2622a3b-5a3b-479b-8ac9-1293c3e9488d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:14:01.677232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c2622a3b-5a3b-479b-8ac9-1293c3e9488d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:01.710153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2622a3b-5a3b-479b-8ac9-1293c3e9488d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:14:01.801618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae155a-ed10-449c-8240-21deb6024eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:14:01.802267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae155a-ed10-449c-8240-21deb6024eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:01.802540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae155a-ed10-449c-8240-21deb6024eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:01.802845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae155a-ed10-449c-8240-21deb6024eaa admin admin] PATH_INFO: `/v3/projects/08053240479c4575bd49434a8a5f8495/users/24263d81356d428ba422638cf9e3db95/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:01.825067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae155a-ed10-449c-8240-21deb6024eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=08053240479c4575bd49434a8a5f8495, user_id=24263d81356d428ba422638cf9e3db95, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:14:01.826092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: WARNING py.warnings [None req-a2ae155a-ed10-449c-8240-21deb6024eaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:14:01.826092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: warnings.warn(msg) Sep 08 16:14:01.826092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: Sep 08 16:14:01.828050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae155a-ed10-449c-8240-21deb6024eaa admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:14:01.920019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 741/1501] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:14:01 2022] PUT /identity/v3/projects/08053240479c4575bd49434a8a5f8495/users/24263d81356d428ba422638cf9e3db95/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:14:01.935483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd66fa-4305-4a75-a09c-5885ba22d669 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:01.935764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd66fa-4305-4a75-a09c-5885ba22d669 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:01.936037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd66fa-4305-4a75-a09c-5885ba22d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:01.993067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-dccd66fa-4305-4a75-a09c-5885ba22d669 None None] MFA Rules not processed for user `24263d81356d428ba422638cf9e3db95`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:14:01.994301 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dccd66fa-4305-4a75-a09c-5885ba22d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:02.070721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 761/1502] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:14:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:14:02.083987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dcebb-8bc6-4fb0-b175-19f020c6fbd6 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:02.084810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dcebb-8bc6-4fb0-b175-19f020c6fbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:02.085088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dcebb-8bc6-4fb0-b175-19f020c6fbd6 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:02.086418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 742/1503] 10.222.0.23 () {54 vars in 964 bytes} [Thu Sep 8 16:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:14:02.091180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae821d-a731-423e-a2c2-ad2d09f620cd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:02.091465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae821d-a731-423e-a2c2-ad2d09f620cd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:02.091737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae821d-a731-423e-a2c2-ad2d09f620cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:02.123125 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:02.168879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a7ae821d-a731-423e-a2c2-ad2d09f620cd None None] MFA Rules not processed for user `e1d9c18139104883848f3ba22b38b360`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:14:02.170136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a7ae821d-a731-423e-a2c2-ad2d09f620cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:02.244338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 762/1504] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Sep 8 16:14:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:14:02.252247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dcebb-8bc6-4fb0-b175-19f020c6fbd6 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:14:02.254026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f96dcebb-8bc6-4fb0-b175-19f020c6fbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:02.348824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:02.401509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dcebb-8bc6-4fb0-b175-19f020c6fbd6 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:14:02.475065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e193dd-09d9-4ede-ba5c-bb6be4207f4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:14:02.475668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e193dd-09d9-4ede-ba5c-bb6be4207f4f service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:02.475939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e193dd-09d9-4ede-ba5c-bb6be4207f4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:02.476203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e193dd-09d9-4ede-ba5c-bb6be4207f4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:02.477784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-13e193dd-09d9-4ede-ba5c-bb6be4207f4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:02.573832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e193dd-09d9-4ede-ba5c-bb6be4207f4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:14:02.575309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e193dd-09d9-4ede-ba5c-bb6be4207f4f service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:14:02.578793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:02.593076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 743/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:14:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:14:02.637920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a329-fd9c-40bd-9cf7-b9c5a589a96d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:02.638337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a329-fd9c-40bd-9cf7-b9c5a589a96d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:02.638495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a329-fd9c-40bd-9cf7-b9c5a589a96d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:02.639821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 763/1506] 10.222.0.23 () {52 vars in 830 bytes} [Thu Sep 8 16:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:14:02.643364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e193dd-09d9-4ede-ba5c-bb6be4207f4f service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:14:02.644567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-13e193dd-09d9-4ede-ba5c-bb6be4207f4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:02.741300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e193dd-09d9-4ede-ba5c-bb6be4207f4f service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:14:02.832526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:14:02.833155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:02.833426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:02.833693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] PATH_INFO: `/v3/users/24263d81356d428ba422638cf9e3db95` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:02.846814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24263d81356d428ba422638cf9e3db95)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:14:02.847843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: WARNING py.warnings [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:14:02.847843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: warnings.warn(msg) Sep 08 16:14:02.847843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: Sep 08 16:14:02.849049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:14:02.858473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:03.024193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24263d81356d428ba422638cf9e3db95'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:14:03.024667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24263d81356d428ba422638cf9e3db95'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:14:03.094952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24263d81356d428ba422638cf9e3db95'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:14:03.095372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24263d81356d428ba422638cf9e3db95'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:14:03.109179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24263d81356d428ba422638cf9e3db95'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:14:03.138080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 744/1507] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:14:02 2022] DELETE /identity/v3/users/24263d81356d428ba422638cf9e3db95 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:14:03.142419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d852d8-61fb-4d38-9a5d-15551f0f570d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:03.142730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d852d8-61fb-4d38-9a5d-15551f0f570d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:03.143007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d852d8-61fb-4d38-9a5d-15551f0f570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:03.199436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-28d852d8-61fb-4d38-9a5d-15551f0f570d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:14:03.200642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-28d852d8-61fb-4d38-9a5d-15551f0f570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:03.274909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:03.286412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 764/1508] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:14:03.296766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:14:03.297976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:03.395145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901bca3-a012-43c9-93f0-644302a25849 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:14:03.522583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:03.522583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece0905-fe60-4e29-b195-284117799e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:14:03.522583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece0905-fe60-4e29-b195-284117799e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:03.522583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece0905-fe60-4e29-b195-284117799e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:03.523109 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece0905-fe60-4e29-b195-284117799e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:03.523109 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4ece0905-fe60-4e29-b195-284117799e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:03.585950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece0905-fe60-4e29-b195-284117799e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:14:03.587372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece0905-fe60-4e29-b195-284117799e12 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:14:03.605640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 745/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:14:04.071550 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d852d8-61fb-4d38-9a5d-15551f0f570d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:14:04.072920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-28d852d8-61fb-4d38-9a5d-15551f0f570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:14:04.087402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d852d8-61fb-4d38-9a5d-15551f0f570d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:14:04.186700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:14:04.187305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:14:04.187577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:14:04.187841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] PATH_INFO: `/v3/projects/08053240479c4575bd49434a8a5f8495` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:14:04.197471 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08053240479c4575bd49434a8a5f8495)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:14:04.198485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:14:04.198485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Sep 08 16:14:04.198485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: Sep 08 16:14:04.199733 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:14:04.346614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08053240479c4575bd49434a8a5f8495', 'request_id': 'req-e0fb8ac3-3de3-488c-bc60-29afff859f08'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:14:04.353293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08053240479c4575bd49434a8a5f8495', 'request_id': 'req-e0fb8ac3-3de3-488c-bc60-29afff859f08'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:14:04.367615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08053240479c4575bd49434a8a5f8495', 'request_id': 'req-e0fb8ac3-3de3-488c-bc60-29afff859f08'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:14:04.470168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] The token cache is being invalidate because project 08053240479c4575bd49434a8a5f8495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:14:04.470465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:14:04.471024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e0fb8ac3-3de3-488c-bc60-29afff859f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:14:04.472330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 765/1510] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:14:04 2022] DELETE /identity/v3/projects/08053240479c4575bd49434a8a5f8495 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:14:13.603427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=62 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:14.468083 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:15:35.524991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e849b-a48d-45e3-b505-709759091080 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:35.525560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e849b-a48d-45e3-b505-709759091080 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:35.525560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e849b-a48d-45e3-b505-709759091080 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:35.526903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:15:35.531769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ac22b-b1b9-43ff-857b-dc4d32272b43 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:35.532195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ac22b-b1b9-43ff-857b-dc4d32272b43 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:35.532320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ac22b-b1b9-43ff-857b-dc4d32272b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:35.614102 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f80ac22b-b1b9-43ff-857b-dc4d32272b43 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:15:35.615355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f80ac22b-b1b9-43ff-857b-dc4d32272b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:15:35.716519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:15:35.868430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e849b-a48d-45e3-b505-709759091080 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:15:35.870530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-553e849b-a48d-45e3-b505-709759091080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:15:35.985809 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e849b-a48d-45e3-b505-709759091080 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:15:35.991185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169750c3-95cc-49ff-beb2-51355d0ace29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:15:35.991801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169750c3-95cc-49ff-beb2-51355d0ace29 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:35.992076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169750c3-95cc-49ff-beb2-51355d0ace29 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:35.992340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169750c3-95cc-49ff-beb2-51355d0ace29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:36.000654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169750c3-95cc-49ff-beb2-51355d0ace29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:15:36.002225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169750c3-95cc-49ff-beb2-51355d0ace29 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:15:36.011386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 747/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:15:37.101342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d772e-f1d6-4710-b947-0c4212052071 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:37.101931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d772e-f1d6-4710-b947-0c4212052071 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:37.101931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d772e-f1d6-4710-b947-0c4212052071 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:37.103329 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:15:37.109513 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecb8d5-65bc-410d-a5d5-a9daea406804 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:37.109958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecb8d5-65bc-410d-a5d5-a9daea406804 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:37.110067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecb8d5-65bc-410d-a5d5-a9daea406804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:37.129866 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-63ecb8d5-65bc-410d-a5d5-a9daea406804 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:15:37.131119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-63ecb8d5-65bc-410d-a5d5-a9daea406804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:15:37.139039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:15:37.295950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d772e-f1d6-4710-b947-0c4212052071 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:15:37.310280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d772e-f1d6-4710-b947-0c4212052071 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:15:37.315654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378abdc3-380f-4189-b41d-26c55d68b6f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:15:37.316252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378abdc3-380f-4189-b41d-26c55d68b6f1 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:37.316520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378abdc3-380f-4189-b41d-26c55d68b6f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:37.316789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378abdc3-380f-4189-b41d-26c55d68b6f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:37.324751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378abdc3-380f-4189-b41d-26c55d68b6f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:15:37.326320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378abdc3-380f-4189-b41d-26c55d68b6f1 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:15:37.336106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 768/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:15:37.734466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33f20-2e73-4dcf-a929-85389a719fa6 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:37.734784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33f20-2e73-4dcf-a929-85389a719fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:37.735065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff33f20-2e73-4dcf-a929-85389a719fa6 None None] PATH_INFO: `/v3` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:37.736403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 749/1517] 10.222.0.43 () {54 vars in 925 bytes} [Thu Sep 8 16:15:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:15:37.742932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2706a9-6a99-4828-934a-3e66ce1c8037 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:37.743214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2706a9-6a99-4828-934a-3e66ce1c8037 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:37.743487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2706a9-6a99-4828-934a-3e66ce1c8037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:37.801996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8a2706a9-6a99-4828-934a-3e66ce1c8037 None None] MFA Rules not processed for user `7e6c855e2692410d83c78cc95cb4f37e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:15:37.803232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8a2706a9-6a99-4828-934a-3e66ce1c8037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:15:37.820069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:15:37.877899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 769/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Sep 8 16:15:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:15:41.721091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e19e-81ea-41e8-b7c1-e88fcdbfe380 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:41.721537 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e19e-81ea-41e8-b7c1-e88fcdbfe380 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:41.721642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e19e-81ea-41e8-b7c1-e88fcdbfe380 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:41.723006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 750/1519] 10.222.0.23 () {54 vars in 961 bytes} [Thu Sep 8 16:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:15:41.728183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bbed4-70f6-41cc-a763-0320c739978f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:41.728567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bbed4-70f6-41cc-a763-0320c739978f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:41.728743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bbed4-70f6-41cc-a763-0320c739978f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:41.748462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-542bbed4-70f6-41cc-a763-0320c739978f None None] MFA Rules not processed for user `7e6c855e2692410d83c78cc95cb4f37e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:15:41.749678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-542bbed4-70f6-41cc-a763-0320c739978f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:15:41.761470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 770/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Sep 8 16:15:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:15:41.769270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e19e-81ea-41e8-b7c1-e88fcdbfe380 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:15:41.783230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e19e-81ea-41e8-b7c1-e88fcdbfe380 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:15:41.788591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dbc85-081d-4f4d-8aa2-72f06a2936d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:15:41.789244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dbc85-081d-4f4d-8aa2-72f06a2936d4 service placement] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:41.789524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dbc85-081d-4f4d-8aa2-72f06a2936d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:41.789814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dbc85-081d-4f4d-8aa2-72f06a2936d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:41.801847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dbc85-081d-4f4d-8aa2-72f06a2936d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:15:41.803498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dbc85-081d-4f4d-8aa2-72f06a2936d4 service placement] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:15:41.813636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 751/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:15:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:15:48.848988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b37061-8554-4b62-9db2-630a6969d965 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:48.849562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b37061-8554-4b62-9db2-630a6969d965 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:48.849562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b37061-8554-4b62-9db2-630a6969d965 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:48.850996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:15:48.857242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e1ec-9b93-405c-93e2-e17974fe7b1c None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:48.857674 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e1ec-9b93-405c-93e2-e17974fe7b1c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:48.857793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e1ec-9b93-405c-93e2-e17974fe7b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:48.877379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a796e1ec-9b93-405c-93e2-e17974fe7b1c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:15:48.878573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a796e1ec-9b93-405c-93e2-e17974fe7b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:15:48.886318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:15:49.039721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b37061-8554-4b62-9db2-630a6969d965 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:15:49.054493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b37061-8554-4b62-9db2-630a6969d965 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:15:49.060047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635b1c2-71af-409f-a0f0-4896d0898a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:15:49.060678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b1c2-71af-409f-a0f0-4896d0898a80 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:49.060952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b1c2-71af-409f-a0f0-4896d0898a80 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:49.061222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b1c2-71af-409f-a0f0-4896d0898a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:49.069537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635b1c2-71af-409f-a0f0-4896d0898a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:15:49.071164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635b1c2-71af-409f-a0f0-4896d0898a80 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:15:49.080917 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 772/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:15:50.148652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab792e9-53d1-41c2-8ffa-17e62018dd48 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:50.149232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab792e9-53d1-41c2-8ffa-17e62018dd48 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:50.149232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab792e9-53d1-41c2-8ffa-17e62018dd48 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:50.150525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 16:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:15:50.156590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e8737-d6fc-433f-bbe1-144045c717f1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:50.156977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e8737-d6fc-433f-bbe1-144045c717f1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:50.157127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e8737-d6fc-433f-bbe1-144045c717f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:50.176914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-659e8737-d6fc-433f-bbe1-144045c717f1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:15:50.178115 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-659e8737-d6fc-433f-bbe1-144045c717f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:15:50.185776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 16:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:15:50.337125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab792e9-53d1-41c2-8ffa-17e62018dd48 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:15:50.352381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab792e9-53d1-41c2-8ffa-17e62018dd48 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:15:50.357972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4b654-cbb5-4f48-9d15-2bf855b25c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:15:50.358591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4b654-cbb5-4f48-9d15-2bf855b25c8e service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:50.358875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4b654-cbb5-4f48-9d15-2bf855b25c8e service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:50.359142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4b654-cbb5-4f48-9d15-2bf855b25c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:50.367798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4b654-cbb5-4f48-9d15-2bf855b25c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:15:50.369366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4b654-cbb5-4f48-9d15-2bf855b25c8e service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:15:50.378514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 754/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:15:54.320706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4fb8f-b68a-49c2-8142-aa337ae052db None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:54.321279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4fb8f-b68a-49c2-8142-aa337ae052db None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:54.321279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4fb8f-b68a-49c2-8142-aa337ae052db None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:54.322590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:15:54.327760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aec13-169f-4dac-a8eb-47907f6e1adb None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:54.328148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aec13-169f-4dac-a8eb-47907f6e1adb None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:54.328407 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aec13-169f-4dac-a8eb-47907f6e1adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:54.348065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-ae6aec13-169f-4dac-a8eb-47907f6e1adb None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:15:54.349259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ae6aec13-169f-4dac-a8eb-47907f6e1adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:15:54.357061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:15:54.655831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4fb8f-b68a-49c2-8142-aa337ae052db None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:15:54.657568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6ed4fb8f-b68a-49c2-8142-aa337ae052db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:15:54.737710 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4fb8f-b68a-49c2-8142-aa337ae052db None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:15:54.741926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d857d1-1f0d-48c5-a20e-9b3df827addf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:15:54.742532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d857d1-1f0d-48c5-a20e-9b3df827addf service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:54.742836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d857d1-1f0d-48c5-a20e-9b3df827addf service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:54.743107 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d857d1-1f0d-48c5-a20e-9b3df827addf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:54.751877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d857d1-1f0d-48c5-a20e-9b3df827addf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:15:54.753311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d857d1-1f0d-48c5-a20e-9b3df827addf service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:15:54.763230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 775/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:15:56.893212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e88e28-e5ef-43d9-8462-3d939e8f247d None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:56.893751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e88e28-e5ef-43d9-8462-3d939e8f247d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:56.893751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e88e28-e5ef-43d9-8462-3d939e8f247d None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:56.895657 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 16:15:56.900708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84a6f-5ddb-4bc6-ad37-ce27e7ca1039 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:56.901109 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84a6f-5ddb-4bc6-ad37-ce27e7ca1039 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:56.901267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84a6f-5ddb-4bc6-ad37-ce27e7ca1039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:56.921225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e8a84a6f-5ddb-4bc6-ad37-ce27e7ca1039 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:15:56.922411 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e8a84a6f-5ddb-4bc6-ad37-ce27e7ca1039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:15:56.930152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:15:57.215265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e88e28-e5ef-43d9-8462-3d939e8f247d None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:15:57.225953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e88e28-e5ef-43d9-8462-3d939e8f247d None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:15:57.229445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb254269-5ecf-41d3-aae1-175e0cb73f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:15:57.230028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb254269-5ecf-41d3-aae1-175e0cb73f29 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:15:57.230302 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb254269-5ecf-41d3-aae1-175e0cb73f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:15:57.230569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb254269-5ecf-41d3-aae1-175e0cb73f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:15:57.239212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb254269-5ecf-41d3-aae1-175e0cb73f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:15:57.240620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb254269-5ecf-41d3-aae1-175e0cb73f29 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:15:57.249704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 757/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:16:00.901276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04536593-0f35-4ec3-bbab-b474554b8a2d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:16:00.901841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04536593-0f35-4ec3-bbab-b474554b8a2d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:16:00.901841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04536593-0f35-4ec3-bbab-b474554b8a2d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:16:00.903202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:16:00.908381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c1b94-90ca-49dd-8fd8-44d12bc4ea45 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:16:00.908821 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c1b94-90ca-49dd-8fd8-44d12bc4ea45 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:16:00.909007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c1b94-90ca-49dd-8fd8-44d12bc4ea45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:16:00.928366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-196c1b94-90ca-49dd-8fd8-44d12bc4ea45 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:16:00.929569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-196c1b94-90ca-49dd-8fd8-44d12bc4ea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:16:00.937368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:16:01.237089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04536593-0f35-4ec3-bbab-b474554b8a2d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:16:01.239357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-04536593-0f35-4ec3-bbab-b474554b8a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:16:01.306862 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:01.320789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04536593-0f35-4ec3-bbab-b474554b8a2d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:16:01.324436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf1819-aafe-41f6-bcb4-1f67399dc416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:16:01.325043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf1819-aafe-41f6-bcb4-1f67399dc416 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:16:01.325322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf1819-aafe-41f6-bcb4-1f67399dc416 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:16:01.325596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf1819-aafe-41f6-bcb4-1f67399dc416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:16:01.334625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf1819-aafe-41f6-bcb4-1f67399dc416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:16:01.336085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf1819-aafe-41f6-bcb4-1f67399dc416 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:16:01.345938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 778/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:16:03.505892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829b6cb-1a4f-47b9-9046-7290f8e97d4c None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:16:03.506445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829b6cb-1a4f-47b9-9046-7290f8e97d4c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:16:03.506445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829b6cb-1a4f-47b9-9046-7290f8e97d4c None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:16:03.507825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 16:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:16:03.513155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09da57-8a4c-4bbc-bf16-6d36e7d82707 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:16:03.513556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09da57-8a4c-4bbc-bf16-6d36e7d82707 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:16:03.513701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09da57-8a4c-4bbc-bf16-6d36e7d82707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:16:03.533600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7f09da57-8a4c-4bbc-bf16-6d36e7d82707 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:16:03.535490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7f09da57-8a4c-4bbc-bf16-6d36e7d82707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:16:03.543657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 16:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:16:03.843483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829b6cb-1a4f-47b9-9046-7290f8e97d4c None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:16:03.845161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4829b6cb-1a4f-47b9-9046-7290f8e97d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:16:03.852701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=84 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:03.858849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829b6cb-1a4f-47b9-9046-7290f8e97d4c None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:16:03.862389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3114e88-058e-4115-9825-e6889c266e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:16:03.863047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3114e88-058e-4115-9825-e6889c266e8e service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:16:03.869861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3114e88-058e-4115-9825-e6889c266e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:16:03.869861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3114e88-058e-4115-9825-e6889c266e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:16:03.872330 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3114e88-058e-4115-9825-e6889c266e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:16:03.873753 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3114e88-058e-4115-9825-e6889c266e8e service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:16:03.883670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 760/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:16:13.528579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=11 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:13.886496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:34.649028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944433d-d6f3-4c7e-a51d-e76ddb3fc611 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:34.650136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944433d-d6f3-4c7e-a51d-e76ddb3fc611 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:34.650136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944433d-d6f3-4c7e-a51d-e76ddb3fc611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:34.674877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d944433d-d6f3-4c7e-a51d-e76ddb3fc611 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:34.676078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d944433d-d6f3-4c7e-a51d-e76ddb3fc611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:34.688186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 780/1540] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 08 16:17:34.697526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c229cf8-26c5-4bc9-be6c-ddefdd3b75bf None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:34.700480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c229cf8-26c5-4bc9-be6c-ddefdd3b75bf None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:34.700480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c229cf8-26c5-4bc9-be6c-ddefdd3b75bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:34.726033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3c229cf8-26c5-4bc9-be6c-ddefdd3b75bf None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:34.727766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3c229cf8-26c5-4bc9-be6c-ddefdd3b75bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:34.736721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 761/1541] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:34.741899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944433d-d6f3-4c7e-a51d-e76ddb3fc611 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:34.757091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944433d-d6f3-4c7e-a51d-e76ddb3fc611 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:34.766362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94728c73-6ee7-448a-bea4-904e8238e77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:34.767041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94728c73-6ee7-448a-bea4-904e8238e77b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:34.767322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94728c73-6ee7-448a-bea4-904e8238e77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:34.767729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94728c73-6ee7-448a-bea4-904e8238e77b admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:34.768405 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94728c73-6ee7-448a-bea4-904e8238e77b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:34.768720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94728c73-6ee7-448a-bea4-904e8238e77b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:34.770364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94728c73-6ee7-448a-bea4-904e8238e77b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:34.794629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 781/1542] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:34.807698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c229cf8-26c5-4bc9-be6c-ddefdd3b75bf None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:34.817398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104dd9e-10cc-4a9b-8c87-989e7214fab3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:34.817720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104dd9e-10cc-4a9b-8c87-989e7214fab3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:34.817953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104dd9e-10cc-4a9b-8c87-989e7214fab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:34.819009 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c229cf8-26c5-4bc9-be6c-ddefdd3b75bf None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:34.835368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de233217-bc61-474d-aa67-4fa0f61f6502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:34.836388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de233217-bc61-474d-aa67-4fa0f61f6502 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:34.836902 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de233217-bc61-474d-aa67-4fa0f61f6502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:34.837396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de233217-bc61-474d-aa67-4fa0f61f6502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:34.838264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de233217-bc61-474d-aa67-4fa0f61f6502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:34.840512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de233217-bc61-474d-aa67-4fa0f61f6502 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:34.853529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b104dd9e-10cc-4a9b-8c87-989e7214fab3 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:34.854805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b104dd9e-10cc-4a9b-8c87-989e7214fab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:34.867970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 782/1543] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 08 16:17:34.878700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44e99-512e-4c96-a9fb-6e3ac77bcf22 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:34.878700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44e99-512e-4c96-a9fb-6e3ac77bcf22 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:34.878700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44e99-512e-4c96-a9fb-6e3ac77bcf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:34.912720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1cc44e99-512e-4c96-a9fb-6e3ac77bcf22 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:34.914219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1cc44e99-512e-4c96-a9fb-6e3ac77bcf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:34.923914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 783/1544] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:17:34.930385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6750e7-9dbd-42e3-aca7-6cdda9d90900 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:34.930385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6750e7-9dbd-42e3-aca7-6cdda9d90900 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:34.930385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6750e7-9dbd-42e3-aca7-6cdda9d90900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:34.945248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5f6750e7-9dbd-42e3-aca7-6cdda9d90900 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:34.946447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5f6750e7-9dbd-42e3-aca7-6cdda9d90900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:34.955225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 762/1545] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:34 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:34.955396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 784/1546] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:34.956275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f7e5-414a-4de8-b11c-66a777ad4021 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:34.956410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300778-84de-4f19-a578-b3783150099b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:34.956502 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f7e5-414a-4de8-b11c-66a777ad4021 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:34.956590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300778-84de-4f19-a578-b3783150099b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:34.956781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f7e5-414a-4de8-b11c-66a777ad4021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:34.956889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300778-84de-4f19-a578-b3783150099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:34.980273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3c17f7e5-414a-4de8-b11c-66a777ad4021 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:34.981496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3c17f7e5-414a-4de8-b11c-66a777ad4021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:34.986035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-19300778-84de-4f19-a578-b3783150099b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:34.988121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-19300778-84de-4f19-a578-b3783150099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:35.051550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 763/1547] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:35.052740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42812041-aaf5-42ab-986c-88ecf25880e1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.053024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42812041-aaf5-42ab-986c-88ecf25880e1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.053295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42812041-aaf5-42ab-986c-88ecf25880e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.060900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 785/1548] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:35.062201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56cf6c-57ca-4e9d-a85a-82ed761c8007 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.063049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56cf6c-57ca-4e9d-a85a-82ed761c8007 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.063320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56cf6c-57ca-4e9d-a85a-82ed761c8007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.073248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-42812041-aaf5-42ab-986c-88ecf25880e1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:35.074465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-42812041-aaf5-42ab-986c-88ecf25880e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:35.083203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-aa56cf6c-57ca-4e9d-a85a-82ed761c8007 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:35.083359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 764/1549] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:35.084283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42812041-aaf5-42ab-986c-88ecf25880e1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.084396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-aa56cf6c-57ca-4e9d-a85a-82ed761c8007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:35.093708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42812041-aaf5-42ab-986c-88ecf25880e1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.094346 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 786/1550] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:35.095114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56cf6c-57ca-4e9d-a85a-82ed761c8007 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.104982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56cf6c-57ca-4e9d-a85a-82ed761c8007 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.105267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868a1f6-93c3-46b6-a33a-6079b3fe34c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.106061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868a1f6-93c3-46b6-a33a-6079b3fe34c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.106366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868a1f6-93c3-46b6-a33a-6079b3fe34c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.106600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868a1f6-93c3-46b6-a33a-6079b3fe34c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.107298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868a1f6-93c3-46b6-a33a-6079b3fe34c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:35.107704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868a1f6-93c3-46b6-a33a-6079b3fe34c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.108722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: WARNING py.warnings [None req-5868a1f6-93c3-46b6-a33a-6079b3fe34c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:17:35.108722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: warnings.warn(msg) Sep 08 16:17:35.108722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: Sep 08 16:17:35.109647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0b9fd-e216-41ab-816e-ccf49fc58e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.109797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868a1f6-93c3-46b6-a33a-6079b3fe34c6 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.110227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0b9fd-e216-41ab-816e-ccf49fc58e9b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.110503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0b9fd-e216-41ab-816e-ccf49fc58e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.110839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0b9fd-e216-41ab-816e-ccf49fc58e9b admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.111470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0b9fd-e216-41ab-816e-ccf49fc58e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.113378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0b9fd-e216-41ab-816e-ccf49fc58e9b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.121321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 765/1551] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:35.122546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f1862-e3df-45c3-87fc-4f6ab9ea1a24 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.122860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f1862-e3df-45c3-87fc-4f6ab9ea1a24 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.123133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f1862-e3df-45c3-87fc-4f6ab9ea1a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.146324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-308f1862-e3df-45c3-87fc-4f6ab9ea1a24 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:35.147584 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-308f1862-e3df-45c3-87fc-4f6ab9ea1a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:35.155612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 766/1552] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:35.156816 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb477e6-3804-42d6-ae38-2b6e1df8c2be None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.157109 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb477e6-3804-42d6-ae38-2b6e1df8c2be None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.157485 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb477e6-3804-42d6-ae38-2b6e1df8c2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.176016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3fb477e6-3804-42d6-ae38-2b6e1df8c2be None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:35.177169 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3fb477e6-3804-42d6-ae38-2b6e1df8c2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:35.184833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 767/1553] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:35.185941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978d1df-341d-43a8-a2b4-798260d274a4 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.186255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978d1df-341d-43a8-a2b4-798260d274a4 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.186489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978d1df-341d-43a8-a2b4-798260d274a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.197666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 787/1554] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:35.197666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa750890-88a9-4bdc-bb49-7aaf3efe9013 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.197666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa750890-88a9-4bdc-bb49-7aaf3efe9013 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.197666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa750890-88a9-4bdc-bb49-7aaf3efe9013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.209859 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c978d1df-341d-43a8-a2b4-798260d274a4 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:35.211088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c978d1df-341d-43a8-a2b4-798260d274a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:35.215903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fa750890-88a9-4bdc-bb49-7aaf3efe9013 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:35.222948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fa750890-88a9-4bdc-bb49-7aaf3efe9013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:35.223087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 768/1555] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:35.223087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b47d9-1a38-4fd1-8adf-003ff09764c3 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.223087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b47d9-1a38-4fd1-8adf-003ff09764c3 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.223087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b47d9-1a38-4fd1-8adf-003ff09764c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.225630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 788/1556] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:35.226949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e0961-12ef-4adc-9e68-373862f2c721 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.227327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e0961-12ef-4adc-9e68-373862f2c721 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.227696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e0961-12ef-4adc-9e68-373862f2c721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.239638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-783b47d9-1a38-4fd1-8adf-003ff09764c3 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:35.240818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-783b47d9-1a38-4fd1-8adf-003ff09764c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:35.248463 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 769/1557] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:35.248614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-307e0961-12ef-4adc-9e68-373862f2c721 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:35.249198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b47d9-1a38-4fd1-8adf-003ff09764c3 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.249647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-307e0961-12ef-4adc-9e68-373862f2c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:35.258910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b47d9-1a38-4fd1-8adf-003ff09764c3 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.260490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 789/1558] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:35.261350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e0961-12ef-4adc-9e68-373862f2c721 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.263505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ec9dc-491f-44ee-9a55-ff75822545a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.264423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec9dc-491f-44ee-9a55-ff75822545a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.264704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec9dc-491f-44ee-9a55-ff75822545a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.264973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ec9dc-491f-44ee-9a55-ff75822545a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.266178 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ec9dc-491f-44ee-9a55-ff75822545a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.268104 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ec9dc-491f-44ee-9a55-ff75822545a0 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.271545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e0961-12ef-4adc-9e68-373862f2c721 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.276125 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42bc62-72e0-4240-aad7-483f58b24a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.276709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42bc62-72e0-4240-aad7-483f58b24a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.276982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42bc62-72e0-4240-aad7-483f58b24a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.277252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42bc62-72e0-4240-aad7-483f58b24a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.277882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42bc62-72e0-4240-aad7-483f58b24a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:35.278179 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42bc62-72e0-4240-aad7-483f58b24a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.279783 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42bc62-72e0-4240-aad7-483f58b24a26 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.291432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 790/1559] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:35.292654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15311c3f-2695-46e7-8e8a-83d97e345514 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.292935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15311c3f-2695-46e7-8e8a-83d97e345514 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.294986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15311c3f-2695-46e7-8e8a-83d97e345514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.316556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-15311c3f-2695-46e7-8e8a-83d97e345514 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:35.317765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-15311c3f-2695-46e7-8e8a-83d97e345514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:35.325585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 791/1560] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:35.326483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15311c3f-2695-46e7-8e8a-83d97e345514 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.336283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15311c3f-2695-46e7-8e8a-83d97e345514 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.340952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5565e5-a0b7-41d2-89cd-0cc2fa9ffb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.341516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5565e5-a0b7-41d2-89cd-0cc2fa9ffb81 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.341792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5565e5-a0b7-41d2-89cd-0cc2fa9ffb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.342062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5565e5-a0b7-41d2-89cd-0cc2fa9ffb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.342713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5565e5-a0b7-41d2-89cd-0cc2fa9ffb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.344307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5565e5-a0b7-41d2-89cd-0cc2fa9ffb81 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.354239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 792/1561] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:35.355163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5565e5-a0b7-41d2-89cd-0cc2fa9ffb81 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.360807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 770/1562] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:35.362066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ec9dc-491f-44ee-9a55-ff75822545a0 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.367006 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5565e5-a0b7-41d2-89cd-0cc2fa9ffb81 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.420456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:35.420674 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:35.426087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ec9dc-491f-44ee-9a55-ff75822545a0 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.428965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d9916-07b7-4a83-af4c-c592b549fa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.429581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9916-07b7-4a83-af4c-c592b549fa56 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.429859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9916-07b7-4a83-af4c-c592b549fa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.430130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9916-07b7-4a83-af4c-c592b549fa56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.430770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17aebd-cb31-45dc-9b2c-35761cb815f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.430893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d9916-07b7-4a83-af4c-c592b549fa56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:35.431153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d9916-07b7-4a83-af4c-c592b549fa56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.431426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17aebd-cb31-45dc-9b2c-35761cb815f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.431705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17aebd-cb31-45dc-9b2c-35761cb815f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.431976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17aebd-cb31-45dc-9b2c-35761cb815f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.432645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17aebd-cb31-45dc-9b2c-35761cb815f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:35.432777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d9916-07b7-4a83-af4c-c592b549fa56 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.432947 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17aebd-cb31-45dc-9b2c-35761cb815f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.434547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17aebd-cb31-45dc-9b2c-35761cb815f3 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.452620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 793/1563] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:35.452620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d9916-07b7-4a83-af4c-c592b549fa56 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.452932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 771/1564] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:35.452932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17aebd-cb31-45dc-9b2c-35761cb815f3 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.463156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17aebd-cb31-45dc-9b2c-35761cb815f3 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.463331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d9916-07b7-4a83-af4c-c592b549fa56 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.467823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e98e74-a5f4-4a72-bf50-5885b87ae259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.470706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7fb16-e80f-44ea-8421-3af0f22eacef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.470846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98e74-a5f4-4a72-bf50-5885b87ae259 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.470846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98e74-a5f4-4a72-bf50-5885b87ae259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.471054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7fb16-e80f-44ea-8421-3af0f22eacef admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.471163 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98e74-a5f4-4a72-bf50-5885b87ae259 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.471261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7fb16-e80f-44ea-8421-3af0f22eacef admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.471261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7fb16-e80f-44ea-8421-3af0f22eacef admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.471433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e98e74-a5f4-4a72-bf50-5885b87ae259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:35.471433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e98e74-a5f4-4a72-bf50-5885b87ae259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.471612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7fb16-e80f-44ea-8421-3af0f22eacef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:35.471612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7fb16-e80f-44ea-8421-3af0f22eacef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.471779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e98e74-a5f4-4a72-bf50-5885b87ae259 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.472032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7fb16-e80f-44ea-8421-3af0f22eacef admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.491186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 794/1565] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:35.491399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 772/1566] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:35.491527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7fb16-e80f-44ea-8421-3af0f22eacef admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.491635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e98e74-a5f4-4a72-bf50-5885b87ae259 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.498885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e98e74-a5f4-4a72-bf50-5885b87ae259 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.501678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7fb16-e80f-44ea-8421-3af0f22eacef admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.504259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee36bbb-46c6-4d33-8853-b126f7558b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.504858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee36bbb-46c6-4d33-8853-b126f7558b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.505167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee36bbb-46c6-4d33-8853-b126f7558b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.505588 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee36bbb-46c6-4d33-8853-b126f7558b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.506229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee36bbb-46c6-4d33-8853-b126f7558b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:35.506529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee36bbb-46c6-4d33-8853-b126f7558b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.506722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770e9d-b1cb-4a48-8769-e794c3570de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.507293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770e9d-b1cb-4a48-8769-e794c3570de2 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.507574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770e9d-b1cb-4a48-8769-e794c3570de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.507845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770e9d-b1cb-4a48-8769-e794c3570de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.508245 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee36bbb-46c6-4d33-8853-b126f7558b54 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.508469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87770e9d-b1cb-4a48-8769-e794c3570de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.509472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-87770e9d-b1cb-4a48-8769-e794c3570de2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:17:35.509472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Sep 08 16:17:35.509472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: Sep 08 16:17:35.510681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87770e9d-b1cb-4a48-8769-e794c3570de2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.520413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 773/1567] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:35.521932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee36bbb-46c6-4d33-8853-b126f7558b54 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.533018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee36bbb-46c6-4d33-8853-b126f7558b54 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.537718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd729-d8b0-4091-8da2-9b1afda8b733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.538651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd729-d8b0-4091-8da2-9b1afda8b733 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.538976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd729-d8b0-4091-8da2-9b1afda8b733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.539233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd729-d8b0-4091-8da2-9b1afda8b733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.539864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcd729-d8b0-4091-8da2-9b1afda8b733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.541467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcd729-d8b0-4091-8da2-9b1afda8b733 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.552339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 774/1568] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:35.556514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd729-d8b0-4091-8da2-9b1afda8b733 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.563539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd729-d8b0-4091-8da2-9b1afda8b733 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.568218 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936c9b8-4467-40e1-89b6-5176c8b1a27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.568774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c9b8-4467-40e1-89b6-5176c8b1a27f admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.569052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c9b8-4467-40e1-89b6-5176c8b1a27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.569326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c9b8-4467-40e1-89b6-5176c8b1a27f admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.569930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936c9b8-4467-40e1-89b6-5176c8b1a27f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.570931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: WARNING py.warnings [None req-7936c9b8-4467-40e1-89b6-5176c8b1a27f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:17:35.570931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: warnings.warn(msg) Sep 08 16:17:35.570931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: Sep 08 16:17:35.572110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936c9b8-4467-40e1-89b6-5176c8b1a27f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.611946 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 795/1569] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:35.612875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770e9d-b1cb-4a48-8769-e794c3570de2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.673139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770e9d-b1cb-4a48-8769-e794c3570de2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.677812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6615df4-a430-4d22-8f7f-107db9dbb096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.678387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6615df4-a430-4d22-8f7f-107db9dbb096 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.678659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6615df4-a430-4d22-8f7f-107db9dbb096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.678954 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6615df4-a430-4d22-8f7f-107db9dbb096 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.679620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6615df4-a430-4d22-8f7f-107db9dbb096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.681499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6615df4-a430-4d22-8f7f-107db9dbb096 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.787569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 796/1570] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/projects => generated 389 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:35.788667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6615df4-a430-4d22-8f7f-107db9dbb096 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.848931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6615df4-a430-4d22-8f7f-107db9dbb096 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.853687 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903b458-3c30-422d-a6ce-09e29ee5cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.854281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903b458-3c30-422d-a6ce-09e29ee5cbdf admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.854587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903b458-3c30-422d-a6ce-09e29ee5cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.854913 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903b458-3c30-422d-a6ce-09e29ee5cbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.855536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903b458-3c30-422d-a6ce-09e29ee5cbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.857438 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903b458-3c30-422d-a6ce-09e29ee5cbdf admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.923673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 775/1571] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/users => generated 293 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:35.924633 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936c9b8-4467-40e1-89b6-5176c8b1a27f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.934091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936c9b8-4467-40e1-89b6-5176c8b1a27f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:35.938550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266a001-56bc-4036-8079-f387bd4fcc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:35.939154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a001-56bc-4036-8079-f387bd4fcc71 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:35.939431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a001-56bc-4036-8079-f387bd4fcc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:35.939702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a001-56bc-4036-8079-f387bd4fcc71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:35.940340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266a001-56bc-4036-8079-f387bd4fcc71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:35.942301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266a001-56bc-4036-8079-f387bd4fcc71 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:35.947120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 797/1572] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:35.947858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903b458-3c30-422d-a6ce-09e29ee5cbdf admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:35.975486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:36.010739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903b458-3c30-422d-a6ce-09e29ee5cbdf admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.015409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d95e9-2458-4f55-ae60-1984eadde1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.016010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d95e9-2458-4f55-ae60-1984eadde1af admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.016289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d95e9-2458-4f55-ae60-1984eadde1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.016562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d95e9-2458-4f55-ae60-1984eadde1af admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.017191 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d95e9-2458-4f55-ae60-1984eadde1af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.019149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d95e9-2458-4f55-ae60-1984eadde1af admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.035020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 776/1573] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:36.036372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266a001-56bc-4036-8079-f387bd4fcc71 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.097441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266a001-56bc-4036-8079-f387bd4fcc71 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.101996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fbd68-2074-4a80-abf8-5e563c08dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.102593 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fbd68-2074-4a80-abf8-5e563c08dbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.102900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fbd68-2074-4a80-abf8-5e563c08dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.103174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fbd68-2074-4a80-abf8-5e563c08dbf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.103791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fbd68-2074-4a80-abf8-5e563c08dbf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.105707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fbd68-2074-4a80-abf8-5e563c08dbf2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.143365 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 798/1574] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:35 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:36.144184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d95e9-2458-4f55-ae60-1984eadde1af admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.209918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d95e9-2458-4f55-ae60-1984eadde1af admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.214694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4f5a5-6de4-4699-9e4f-b44a8d10320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.220090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f5a5-6de4-4699-9e4f-b44a8d10320e admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.220090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f5a5-6de4-4699-9e4f-b44a8d10320e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.220090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4f5a5-6de4-4699-9e4f-b44a8d10320e admin admin] PATH_INFO: `/v3/projects/7d382b305c5c420a810036dd208f56d6/users/73f357cb7b2d4214bde8d5d0d212c91f/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.220353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 777/1575] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:36 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:36.220353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fbd68-2074-4a80-abf8-5e563c08dbf2 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.232300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4f5a5-6de4-4699-9e4f-b44a8d10320e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d382b305c5c420a810036dd208f56d6, user_id=73f357cb7b2d4214bde8d5d0d212c91f, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.233462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-bdd4f5a5-6de4-4699-9e4f-b44a8d10320e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:17:36.233462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Sep 08 16:17:36.233462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: Sep 08 16:17:36.235723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4f5a5-6de4-4699-9e4f-b44a8d10320e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.277805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:36.282099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fbd68-2074-4a80-abf8-5e563c08dbf2 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.286995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0ce0b-a38e-4e6a-933e-70b2b3b2445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.287629 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ce0b-a38e-4e6a-933e-70b2b3b2445b admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.287870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ce0b-a38e-4e6a-933e-70b2b3b2445b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.290889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ce0b-a38e-4e6a-933e-70b2b3b2445b admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.290889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0ce0b-a38e-4e6a-933e-70b2b3b2445b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.291147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0ce0b-a38e-4e6a-933e-70b2b3b2445b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.317131 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 799/1576] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:36 2022] PUT /identity/v3/projects/7d382b305c5c420a810036dd208f56d6/users/73f357cb7b2d4214bde8d5d0d212c91f/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:36.319585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4f5a5-6de4-4699-9e4f-b44a8d10320e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.378790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4f5a5-6de4-4699-9e4f-b44a8d10320e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.382393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 778/1577] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:36 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:36.383334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0ce0b-a38e-4e6a-933e-70b2b3b2445b admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.383474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e500a2-53cc-41f4-a717-4741dffbb687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.384028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e500a2-53cc-41f4-a717-4741dffbb687 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.384305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e500a2-53cc-41f4-a717-4741dffbb687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.384570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e500a2-53cc-41f4-a717-4741dffbb687 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.385278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e500a2-53cc-41f4-a717-4741dffbb687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.387345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e500a2-53cc-41f4-a717-4741dffbb687 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.395658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0ce0b-a38e-4e6a-933e-70b2b3b2445b admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.400438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac8d6-6220-48cb-8e8b-968953a225b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.401032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac8d6-6220-48cb-8e8b-968953a225b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.401309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac8d6-6220-48cb-8e8b-968953a225b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.401579 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac8d6-6220-48cb-8e8b-968953a225b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.402213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac8d6-6220-48cb-8e8b-968953a225b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.403977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac8d6-6220-48cb-8e8b-968953a225b6 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.415719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 779/1578] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.416511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac8d6-6220-48cb-8e8b-968953a225b6 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.426189 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac8d6-6220-48cb-8e8b-968953a225b6 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.430844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158af4c3-4bf3-4d6b-a0eb-a28ba3a2fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.431437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158af4c3-4bf3-4d6b-a0eb-a28ba3a2fd4f admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.431715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158af4c3-4bf3-4d6b-a0eb-a28ba3a2fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.431985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158af4c3-4bf3-4d6b-a0eb-a28ba3a2fd4f admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.432609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158af4c3-4bf3-4d6b-a0eb-a28ba3a2fd4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.434525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158af4c3-4bf3-4d6b-a0eb-a28ba3a2fd4f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.481898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 800/1579] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:36 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:36.481898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e500a2-53cc-41f4-a717-4741dffbb687 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.489319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e500a2-53cc-41f4-a717-4741dffbb687 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.493925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4df5c8-f5f5-440b-a038-e7dd0c36aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.494493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4df5c8-f5f5-440b-a038-e7dd0c36aa7b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.494799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4df5c8-f5f5-440b-a038-e7dd0c36aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.495070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4df5c8-f5f5-440b-a038-e7dd0c36aa7b admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.495678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4df5c8-f5f5-440b-a038-e7dd0c36aa7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.497591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4df5c8-f5f5-440b-a038-e7dd0c36aa7b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.507686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 780/1580] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:36 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:36.507686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158af4c3-4bf3-4d6b-a0eb-a28ba3a2fd4f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.518419 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158af4c3-4bf3-4d6b-a0eb-a28ba3a2fd4f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.523116 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fef4d-461c-426e-a43a-54b0411dd158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.523715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fef4d-461c-426e-a43a-54b0411dd158 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.524011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fef4d-461c-426e-a43a-54b0411dd158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.524264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fef4d-461c-426e-a43a-54b0411dd158 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.524886 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fef4d-461c-426e-a43a-54b0411dd158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.526837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fef4d-461c-426e-a43a-54b0411dd158 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.611920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 801/1581] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:36 2022] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:36.611920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4df5c8-f5f5-440b-a038-e7dd0c36aa7b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.614515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:36.619671 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4df5c8-f5f5-440b-a038-e7dd0c36aa7b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.624451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43f8cf-90fe-456f-b4f5-59e167629302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.625545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f8cf-90fe-456f-b4f5-59e167629302 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.625820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f8cf-90fe-456f-b4f5-59e167629302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.626100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43f8cf-90fe-456f-b4f5-59e167629302 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.626745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43f8cf-90fe-456f-b4f5-59e167629302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.628669 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43f8cf-90fe-456f-b4f5-59e167629302 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.639102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 781/1582] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:36 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:36.639252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0cd8b-4163-4aab-94b2-30dad2f49f9e None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.641128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0cd8b-4163-4aab-94b2-30dad2f49f9e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.641128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0cd8b-4163-4aab-94b2-30dad2f49f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.660522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-4da0cd8b-4163-4aab-94b2-30dad2f49f9e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:36.661707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4da0cd8b-4163-4aab-94b2-30dad2f49f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:36.669622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 782/1583] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:36.670366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0cd8b-4163-4aab-94b2-30dad2f49f9e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.679829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0cd8b-4163-4aab-94b2-30dad2f49f9e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.684822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0837f-8465-4892-8b0a-b8159b838940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.685435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0837f-8465-4892-8b0a-b8159b838940 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.685708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0837f-8465-4892-8b0a-b8159b838940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.685972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0837f-8465-4892-8b0a-b8159b838940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.686596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0837f-8465-4892-8b0a-b8159b838940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.688848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0837f-8465-4892-8b0a-b8159b838940 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.698739 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 783/1584] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.699497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0837f-8465-4892-8b0a-b8159b838940 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.709544 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0837f-8465-4892-8b0a-b8159b838940 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.715251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 802/1585] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:36 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:36.715251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43f8cf-90fe-456f-b4f5-59e167629302 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.715851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db201-be97-449d-a6fa-1321de2b28cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.715851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db201-be97-449d-a6fa-1321de2b28cd admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.715851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db201-be97-449d-a6fa-1321de2b28cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.715851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db201-be97-449d-a6fa-1321de2b28cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.716215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1db201-be97-449d-a6fa-1321de2b28cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.717620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1db201-be97-449d-a6fa-1321de2b28cd admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.723515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43f8cf-90fe-456f-b4f5-59e167629302 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.728437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57672f18-36ef-4f7e-84e5-c1560bd6a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.728743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 784/1586] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.729561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db201-be97-449d-a6fa-1321de2b28cd admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.729704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57672f18-36ef-4f7e-84e5-c1560bd6a9cd admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.730039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57672f18-36ef-4f7e-84e5-c1560bd6a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.730409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57672f18-36ef-4f7e-84e5-c1560bd6a9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.731191 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57672f18-36ef-4f7e-84e5-c1560bd6a9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.733042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57672f18-36ef-4f7e-84e5-c1560bd6a9cd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.739560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db201-be97-449d-a6fa-1321de2b28cd admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.746085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 803/1587] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.746085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57672f18-36ef-4f7e-84e5-c1560bd6a9cd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.746351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ed23f-6961-42c3-b92d-a24b40cd02ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.746351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ed23f-6961-42c3-b92d-a24b40cd02ee admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.746351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ed23f-6961-42c3-b92d-a24b40cd02ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.746351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ed23f-6961-42c3-b92d-a24b40cd02ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.746864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ed23f-6961-42c3-b92d-a24b40cd02ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.747740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ed23f-6961-42c3-b92d-a24b40cd02ee admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.754459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57672f18-36ef-4f7e-84e5-c1560bd6a9cd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.758587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 785/1588] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.759122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3514b97-5b36-481a-b4cc-174bfccc30d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.759401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ed23f-6961-42c3-b92d-a24b40cd02ee admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.759768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3514b97-5b36-481a-b4cc-174bfccc30d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.760046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3514b97-5b36-481a-b4cc-174bfccc30d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.760317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3514b97-5b36-481a-b4cc-174bfccc30d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.760936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3514b97-5b36-481a-b4cc-174bfccc30d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.762693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3514b97-5b36-481a-b4cc-174bfccc30d9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.771845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ed23f-6961-42c3-b92d-a24b40cd02ee admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.775950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 804/1589] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.775950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3514b97-5b36-481a-b4cc-174bfccc30d9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.776748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e33b5-f47e-4654-8d55-8070549a7f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.777341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e33b5-f47e-4654-8d55-8070549a7f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.777619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e33b5-f47e-4654-8d55-8070549a7f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.777892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e33b5-f47e-4654-8d55-8070549a7f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.778523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e33b5-f47e-4654-8d55-8070549a7f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.780152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e33b5-f47e-4654-8d55-8070549a7f4d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.790568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 786/1590] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.791254 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e33b5-f47e-4654-8d55-8070549a7f4d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.804020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e33b5-f47e-4654-8d55-8070549a7f4d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.808636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fea2c-e1f0-4f47-a43f-8bde960f5da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.809209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fea2c-e1f0-4f47-a43f-8bde960f5da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.809484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fea2c-e1f0-4f47-a43f-8bde960f5da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.809752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fea2c-e1f0-4f47-a43f-8bde960f5da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.810372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fea2c-e1f0-4f47-a43f-8bde960f5da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.811963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fea2c-e1f0-4f47-a43f-8bde960f5da0 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.822134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 787/1591] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.822932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fea2c-e1f0-4f47-a43f-8bde960f5da0 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.833075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fea2c-e1f0-4f47-a43f-8bde960f5da0 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.834317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3514b97-5b36-481a-b4cc-174bfccc30d9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.837689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13f682-7ebf-4874-9795-ba2755f9199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.837906 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8a84c-7c76-4592-8e42-40440b3d454d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.838258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f682-7ebf-4874-9795-ba2755f9199d admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.838499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8a84c-7c76-4592-8e42-40440b3d454d service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.838624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f682-7ebf-4874-9795-ba2755f9199d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.838817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8a84c-7c76-4592-8e42-40440b3d454d service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.838938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f682-7ebf-4874-9795-ba2755f9199d admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.839085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8a84c-7c76-4592-8e42-40440b3d454d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.839450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13f682-7ebf-4874-9795-ba2755f9199d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.841015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13f682-7ebf-4874-9795-ba2755f9199d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.848084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8a84c-7c76-4592-8e42-40440b3d454d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.849490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8a84c-7c76-4592-8e42-40440b3d454d service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.851515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 788/1592] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.852264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13f682-7ebf-4874-9795-ba2755f9199d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.859649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 805/1593] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:36.860439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8a84c-7c76-4592-8e42-40440b3d454d service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.862177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13f682-7ebf-4874-9795-ba2755f9199d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.867025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f2bb7-2762-4e6b-b1b3-5c0028550f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.867669 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f2bb7-2762-4e6b-b1b3-5c0028550f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.867951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f2bb7-2762-4e6b-b1b3-5c0028550f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.868226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f2bb7-2762-4e6b-b1b3-5c0028550f01 admin admin] PATH_INFO: `/v3/projects/dd07e758e414493187ec1949d45f0828/users/d235e94611884b28b85b637ac54204f8/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.869520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8a84c-7c76-4592-8e42-40440b3d454d service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.875758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1fd36-fc0a-4112-9ef0-7a8ba58ef919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.876348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1fd36-fc0a-4112-9ef0-7a8ba58ef919 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.876621 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1fd36-fc0a-4112-9ef0-7a8ba58ef919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.876890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1fd36-fc0a-4112-9ef0-7a8ba58ef919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.877631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1fd36-fc0a-4112-9ef0-7a8ba58ef919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.879513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1fd36-fc0a-4112-9ef0-7a8ba58ef919 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.884847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f2bb7-2762-4e6b-b1b3-5c0028550f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd07e758e414493187ec1949d45f0828, user_id=d235e94611884b28b85b637ac54204f8, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.887497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f2bb7-2762-4e6b-b1b3-5c0028550f01 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.889876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 806/1594] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.891596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1fd36-fc0a-4112-9ef0-7a8ba58ef919 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.901310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1fd36-fc0a-4112-9ef0-7a8ba58ef919 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.907819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5acd7-3f99-48d4-81ac-49cc1701173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.907819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5acd7-3f99-48d4-81ac-49cc1701173c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.907819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5acd7-3f99-48d4-81ac-49cc1701173c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.907819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5acd7-3f99-48d4-81ac-49cc1701173c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.908195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5acd7-3f99-48d4-81ac-49cc1701173c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.909199 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5acd7-3f99-48d4-81ac-49cc1701173c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.919021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 807/1595] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.919773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5acd7-3f99-48d4-81ac-49cc1701173c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.929336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5acd7-3f99-48d4-81ac-49cc1701173c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.933824 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35802a21-7233-4652-8d55-53807bd4045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.934359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35802a21-7233-4652-8d55-53807bd4045a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.934636 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35802a21-7233-4652-8d55-53807bd4045a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.934938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35802a21-7233-4652-8d55-53807bd4045a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.938322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35802a21-7233-4652-8d55-53807bd4045a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.938322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35802a21-7233-4652-8d55-53807bd4045a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.948175 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 808/1596] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.949072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35802a21-7233-4652-8d55-53807bd4045a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.958501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35802a21-7233-4652-8d55-53807bd4045a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.971806 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6083918-c8e2-4d3a-80d4-f70b9cc547bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.971806 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083918-c8e2-4d3a-80d4-f70b9cc547bd admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.971806 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083918-c8e2-4d3a-80d4-f70b9cc547bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.971806 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083918-c8e2-4d3a-80d4-f70b9cc547bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:36.972166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6083918-c8e2-4d3a-80d4-f70b9cc547bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:36.972166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6083918-c8e2-4d3a-80d4-f70b9cc547bd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:36.976584 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 809/1597] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:36.977445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6083918-c8e2-4d3a-80d4-f70b9cc547bd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:36.987796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6083918-c8e2-4d3a-80d4-f70b9cc547bd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:36.992620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af032a-a8a7-4254-a780-945ddbc01a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:36.993316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af032a-a8a7-4254-a780-945ddbc01a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:36.993688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af032a-a8a7-4254-a780-945ddbc01a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:36.993970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af032a-a8a7-4254-a780-945ddbc01a95 admin admin] PATH_INFO: `/v3/projects/b050456e54af416c90e154e8e8210ef6/users/f0a14aa4ab2241ea95b430653598c4be/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.003868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 789/1598] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:36 2022] PUT /identity/v3/projects/dd07e758e414493187ec1949d45f0828/users/d235e94611884b28b85b637ac54204f8/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:37.003868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f2bb7-2762-4e6b-b1b3-5c0028550f01 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:37.010761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af032a-a8a7-4254-a780-945ddbc01a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b050456e54af416c90e154e8e8210ef6, user_id=f0a14aa4ab2241ea95b430653598c4be, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:37.013704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af032a-a8a7-4254-a780-945ddbc01a95 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:37.068777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f2bb7-2762-4e6b-b1b3-5c0028550f01 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:37.074710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44c39c-bb59-4cf4-a93f-a2f75555500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:37.077764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c39c-bb59-4cf4-a93f-a2f75555500d admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.077764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c39c-bb59-4cf4-a93f-a2f75555500d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.077764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c39c-bb59-4cf4-a93f-a2f75555500d admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.077764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44c39c-bb59-4cf4-a93f-a2f75555500d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:37.078160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44c39c-bb59-4cf4-a93f-a2f75555500d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:37.083395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:37.088080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 790/1599] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:37.088831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44c39c-bb59-4cf4-a93f-a2f75555500d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:37.098195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44c39c-bb59-4cf4-a93f-a2f75555500d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:37.100492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 810/1600] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:36 2022] PUT /identity/v3/projects/b050456e54af416c90e154e8e8210ef6/users/f0a14aa4ab2241ea95b430653598c4be/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:37.104950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af032a-a8a7-4254-a780-945ddbc01a95 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:37.155956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b3f32-9179-458c-a97f-ac760c6f4918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:37.156665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3f32-9179-458c-a97f-ac760c6f4918 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.157092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3f32-9179-458c-a97f-ac760c6f4918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.157370 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3f32-9179-458c-a97f-ac760c6f4918 admin admin] PATH_INFO: `/v3/projects/d9321ea0106f4853a2c4f8f587062feb/users/ce39c87aac4e4df79efc1f80a07b3273/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.166714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:37.172726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af032a-a8a7-4254-a780-945ddbc01a95 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:37.175316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b3f32-9179-458c-a97f-ac760c6f4918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9321ea0106f4853a2c4f8f587062feb, user_id=ce39c87aac4e4df79efc1f80a07b3273, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:37.178177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b3f32-9179-458c-a97f-ac760c6f4918 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:37.178410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a907fe-0c72-42e7-8aae-1b7d877d092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:37.179170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a907fe-0c72-42e7-8aae-1b7d877d092b admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.179520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a907fe-0c72-42e7-8aae-1b7d877d092b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.179801 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a907fe-0c72-42e7-8aae-1b7d877d092b admin admin] PATH_INFO: `/v3/projects/1f468b866b794c3995d20736553a3e7d/users/baca2d55b1824b73beb2c887b79a83d4/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.196662 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a907fe-0c72-42e7-8aae-1b7d877d092b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f468b866b794c3995d20736553a3e7d, user_id=baca2d55b1824b73beb2c887b79a83d4, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:37.200190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a907fe-0c72-42e7-8aae-1b7d877d092b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:37.239549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 791/1601] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:37 2022] PUT /identity/v3/projects/d9321ea0106f4853a2c4f8f587062feb/users/ce39c87aac4e4df79efc1f80a07b3273/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:37.240365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b3f32-9179-458c-a97f-ac760c6f4918 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:37.273592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 811/1602] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:37 2022] PUT /identity/v3/projects/1f468b866b794c3995d20736553a3e7d/users/baca2d55b1824b73beb2c887b79a83d4/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:37.273592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a907fe-0c72-42e7-8aae-1b7d877d092b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:37.306314 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b3f32-9179-458c-a97f-ac760c6f4918 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:37.347592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a907fe-0c72-42e7-8aae-1b7d877d092b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:37.352428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b53e11-ed23-42a1-b6af-72fe227b84cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:37.353093 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b53e11-ed23-42a1-b6af-72fe227b84cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.353369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b53e11-ed23-42a1-b6af-72fe227b84cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.353696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b53e11-ed23-42a1-b6af-72fe227b84cc admin admin] PATH_INFO: `/v3/projects/c9b03154d7554316a85ffc1978a39845/users/bcafdd6ed7704aca9faab1b8aba3d114/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.370088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b53e11-ed23-42a1-b6af-72fe227b84cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b03154d7554316a85ffc1978a39845, user_id=bcafdd6ed7704aca9faab1b8aba3d114, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:37.371864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03477cc-9a6e-49c0-8113-9b93f6a6ef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:37.372526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03477cc-9a6e-49c0-8113-9b93f6a6ef33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.372797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03477cc-9a6e-49c0-8113-9b93f6a6ef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.372919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b53e11-ed23-42a1-b6af-72fe227b84cc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:37.373115 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03477cc-9a6e-49c0-8113-9b93f6a6ef33 admin admin] PATH_INFO: `/v3/projects/d5228d9e69f94e90b5e2c94fb85fe90d/users/a1d7a70ef16f41df946d008032871687/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.388190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03477cc-9a6e-49c0-8113-9b93f6a6ef33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5228d9e69f94e90b5e2c94fb85fe90d, user_id=a1d7a70ef16f41df946d008032871687, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:37.390919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03477cc-9a6e-49c0-8113-9b93f6a6ef33 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:37.445131 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 812/1603] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:37 2022] PUT /identity/v3/projects/c9b03154d7554316a85ffc1978a39845/users/bcafdd6ed7704aca9faab1b8aba3d114/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:37.454315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd940f24-658c-44e5-920f-746e2bb395a4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.454315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd940f24-658c-44e5-920f-746e2bb395a4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.454315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd940f24-658c-44e5-920f-746e2bb395a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.472583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fd940f24-658c-44e5-920f-746e2bb395a4 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:37.473943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fd940f24-658c-44e5-920f-746e2bb395a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:37.504322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 792/1604] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:37 2022] PUT /identity/v3/projects/d5228d9e69f94e90b5e2c94fb85fe90d/users/a1d7a70ef16f41df946d008032871687/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:37.504898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03477cc-9a6e-49c0-8113-9b93f6a6ef33 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:37.528444 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:37.555748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 813/1605] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:37.555748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8599437-f620-49ec-9eb4-65b25f9d5d82 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.555748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8599437-f620-49ec-9eb4-65b25f9d5d82 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.555748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8599437-f620-49ec-9eb4-65b25f9d5d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.576399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e8599437-f620-49ec-9eb4-65b25f9d5d82 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:37.579575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e8599437-f620-49ec-9eb4-65b25f9d5d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:37.582739 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03477cc-9a6e-49c0-8113-9b93f6a6ef33 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:37.585923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 814/1606] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:37.587160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeefc92-72d9-4467-92ca-424722d7da23 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.587443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeefc92-72d9-4467-92ca-424722d7da23 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.587725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeefc92-72d9-4467-92ca-424722d7da23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.590712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1a945-8211-4db1-af30-49a2bc9d0ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:37.591432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1a945-8211-4db1-af30-49a2bc9d0ede admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.591717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1a945-8211-4db1-af30-49a2bc9d0ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.591992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1a945-8211-4db1-af30-49a2bc9d0ede admin admin] PATH_INFO: `/v3/projects/e779edba2e1a49709df7b45bb51298ea/users/58efc51f0f044d2fb021144216ab2214/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.607508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5aeefc92-72d9-4467-92ca-424722d7da23 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:37.608731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5aeefc92-72d9-4467-92ca-424722d7da23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:37.608913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1a945-8211-4db1-af30-49a2bc9d0ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=e779edba2e1a49709df7b45bb51298ea, user_id=58efc51f0f044d2fb021144216ab2214, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:37.611683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1a945-8211-4db1-af30-49a2bc9d0ede admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:37.619038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 815/1607] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:37.620255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4a081-b68a-42ea-87ad-32cb73541dcb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.620536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4a081-b68a-42ea-87ad-32cb73541dcb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.620813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4a081-b68a-42ea-87ad-32cb73541dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.650045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1cf4a081-b68a-42ea-87ad-32cb73541dcb None None] MFA Rules not processed for user `baca2d55b1824b73beb2c887b79a83d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:37.651250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1cf4a081-b68a-42ea-87ad-32cb73541dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:37.695019 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:37.708845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 793/1608] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:37 2022] PUT /identity/v3/projects/e779edba2e1a49709df7b45bb51298ea/users/58efc51f0f044d2fb021144216ab2214/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:37.710575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa940a1-22dc-4663-b4d3-2236a2bc3e3c None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.710935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa940a1-22dc-4663-b4d3-2236a2bc3e3c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.711209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa940a1-22dc-4663-b4d3-2236a2bc3e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.727370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 816/1609] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:37.728858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dece6-03c5-471b-876e-79b39622259c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.729141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dece6-03c5-471b-876e-79b39622259c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.730176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dece6-03c5-471b-876e-79b39622259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.749527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-1fa940a1-22dc-4663-b4d3-2236a2bc3e3c None None] MFA Rules not processed for user `bcafdd6ed7704aca9faab1b8aba3d114`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:37.750925 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1fa940a1-22dc-4663-b4d3-2236a2bc3e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:37.761922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a95dece6-03c5-471b-876e-79b39622259c None None] MFA Rules not processed for user `a1d7a70ef16f41df946d008032871687`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:37.763209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a95dece6-03c5-471b-876e-79b39622259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:37.822826 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 794/1610] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:37.823670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa940a1-22dc-4663-b4d3-2236a2bc3e3c None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:37.836244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 817/1611] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:37.836244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dece6-03c5-471b-876e-79b39622259c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:37.892931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dece6-03c5-471b-876e-79b39622259c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:37.896666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42bd5c-292d-49e2-bac4-8688708f0c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:37.897007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa940a1-22dc-4663-b4d3-2236a2bc3e3c None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:37.897278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42bd5c-292d-49e2-bac4-8688708f0c9f service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.897553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42bd5c-292d-49e2-bac4-8688708f0c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.897821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42bd5c-292d-49e2-bac4-8688708f0c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.901718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c742ff3-4c74-4309-9f98-33c5883781af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:37.902588 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c742ff3-4c74-4309-9f98-33c5883781af service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.902927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c742ff3-4c74-4309-9f98-33c5883781af service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.903717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c742ff3-4c74-4309-9f98-33c5883781af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.957969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:37.969360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42bd5c-292d-49e2-bac4-8688708f0c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:37.970965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42bd5c-292d-49e2-bac4-8688708f0c9f service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:37.978714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c742ff3-4c74-4309-9f98-33c5883781af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:37.980174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c742ff3-4c74-4309-9f98-33c5883781af service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:37.980932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 818/1612] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:37.981745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42bd5c-292d-49e2-bac4-8688708f0c9f service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:37.990201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42bd5c-292d-49e2-bac4-8688708f0c9f service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:37.990744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 795/1613] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:37.992495 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0b8d-6f20-4a1b-8a55-2c6c1293f4d6 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.993087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0b8d-6f20-4a1b-8a55-2c6c1293f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.993453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0b8d-6f20-4a1b-8a55-2c6c1293f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:37.994716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf451a-1dfe-4dc2-8fea-d118cea5af0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:37.995323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf451a-1dfe-4dc2-8fea-d118cea5af0c service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:37.996084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf451a-1dfe-4dc2-8fea-d118cea5af0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:37.996084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf451a-1dfe-4dc2-8fea-d118cea5af0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:38.006217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf451a-1dfe-4dc2-8fea-d118cea5af0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:38.007545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf451a-1dfe-4dc2-8fea-d118cea5af0c service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:38.024007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 819/1614] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:38.025758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf451a-1dfe-4dc2-8fea-d118cea5af0c service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:38.028125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-09bd0b8d-6f20-4a1b-8a55-2c6c1293f4d6 None None] MFA Rules not processed for user `58efc51f0f044d2fb021144216ab2214`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:38.029464 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-09bd0b8d-6f20-4a1b-8a55-2c6c1293f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:38.036311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf451a-1dfe-4dc2-8fea-d118cea5af0c service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:38.041463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b354f-f908-49bb-a68a-5fad03aea8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:38.042065 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b354f-f908-49bb-a68a-5fad03aea8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:38.042375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b354f-f908-49bb-a68a-5fad03aea8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:38.042626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b354f-f908-49bb-a68a-5fad03aea8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:38.043296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b354f-f908-49bb-a68a-5fad03aea8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:38.045226 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b354f-f908-49bb-a68a-5fad03aea8d4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:38.049917 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:38.096653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 796/1615] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:38.097555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd0b8d-6f20-4a1b-8a55-2c6c1293f4d6 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:38.107955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd0b8d-6f20-4a1b-8a55-2c6c1293f4d6 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:38.112687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358efc08-9f32-49cb-892b-af3e070651d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:38.113283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358efc08-9f32-49cb-892b-af3e070651d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:38.113560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358efc08-9f32-49cb-892b-af3e070651d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:38.113830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358efc08-9f32-49cb-892b-af3e070651d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:38.114460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358efc08-9f32-49cb-892b-af3e070651d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:38.116485 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358efc08-9f32-49cb-892b-af3e070651d9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:38.192692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 820/1616] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:38 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:38.192692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89658be-bca2-4043-af79-ca7a1eed27d1 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:38.192692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89658be-bca2-4043-af79-ca7a1eed27d1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:38.192692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89658be-bca2-4043-af79-ca7a1eed27d1 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:38.193646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 821/1617] 10.222.0.23 () {54 vars in 962 bytes} [Thu Sep 8 16:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:17:38.194130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89658be-bca2-4043-af79-ca7a1eed27d1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:38.267523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 797/1618] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:38 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:38.267523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358efc08-9f32-49cb-892b-af3e070651d9 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:38.307774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89658be-bca2-4043-af79-ca7a1eed27d1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:38.338867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358efc08-9f32-49cb-892b-af3e070651d9 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:38.346055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd901234-1546-4b11-9c5e-079419173229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:38.346805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd901234-1546-4b11-9c5e-079419173229 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:38.347255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd901234-1546-4b11-9c5e-079419173229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:38.347635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd901234-1546-4b11-9c5e-079419173229 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:38.348557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd901234-1546-4b11-9c5e-079419173229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:38.351591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd901234-1546-4b11-9c5e-079419173229 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:38.424222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f122bf-442e-4435-8244-33820e2d99c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:38.426489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f122bf-442e-4435-8244-33820e2d99c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:38.427372 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f122bf-442e-4435-8244-33820e2d99c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:38.428364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f122bf-442e-4435-8244-33820e2d99c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:38.429183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f122bf-442e-4435-8244-33820e2d99c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:38.431373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f122bf-442e-4435-8244-33820e2d99c1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:38.483910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 798/1619] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:38 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:38.483910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2bf73-93f0-4f8d-aa53-190292e1c9aa None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:38.483910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2bf73-93f0-4f8d-aa53-190292e1c9aa None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:38.483910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2bf73-93f0-4f8d-aa53-190292e1c9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:38.576614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 822/1620] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:38 2022] POST /identity/v3/projects => generated 367 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:38.591261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f122bf-442e-4435-8244-33820e2d99c1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:38.615679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-7fa2bf73-93f0-4f8d-aa53-190292e1c9aa None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:38.617200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7fa2bf73-93f0-4f8d-aa53-190292e1c9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:38.707648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f122bf-442e-4435-8244-33820e2d99c1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:38.714584 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abc80a-a627-474c-ab76-96c00d3eb766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:38.715457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc80a-a627-474c-ab76-96c00d3eb766 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:38.716296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc80a-a627-474c-ab76-96c00d3eb766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:38.716296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc80a-a627-474c-ab76-96c00d3eb766 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:38.716903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abc80a-a627-474c-ab76-96c00d3eb766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:38.719881 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abc80a-a627-474c-ab76-96c00d3eb766 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:38.737611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:38.743831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 799/1621] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Sep 8 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:38.745432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2bf73-93f0-4f8d-aa53-190292e1c9aa None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:38.757836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2bf73-93f0-4f8d-aa53-190292e1c9aa None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:38.768165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c01b4-2445-4154-8cc6-ff36b5ac76ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:38.769121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c01b4-2445-4154-8cc6-ff36b5ac76ba admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:38.770095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c01b4-2445-4154-8cc6-ff36b5ac76ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:38.770225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c01b4-2445-4154-8cc6-ff36b5ac76ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:38.770960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c01b4-2445-4154-8cc6-ff36b5ac76ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:38.779926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c01b4-2445-4154-8cc6-ff36b5ac76ba admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:38.786635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 800/1622] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:38.787927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c01b4-2445-4154-8cc6-ff36b5ac76ba admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:38.800802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c01b4-2445-4154-8cc6-ff36b5ac76ba admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:38.810372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a5aa7-20ab-4c6b-8acb-a97cec5cf983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:38.810372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a5aa7-20ab-4c6b-8acb-a97cec5cf983 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:38.810372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a5aa7-20ab-4c6b-8acb-a97cec5cf983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:38.810372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a5aa7-20ab-4c6b-8acb-a97cec5cf983 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:38.810782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a5aa7-20ab-4c6b-8acb-a97cec5cf983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:38.811944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a5aa7-20ab-4c6b-8acb-a97cec5cf983 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:38.845432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 823/1623] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:38 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:38.845432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abc80a-a627-474c-ab76-96c00d3eb766 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:38.868138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abc80a-a627-474c-ab76-96c00d3eb766 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:38.874196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86751efd-b715-47da-a2df-df087bd0ca6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:38.874941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751efd-b715-47da-a2df-df087bd0ca6b service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:38.875300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751efd-b715-47da-a2df-df087bd0ca6b service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:38.876081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751efd-b715-47da-a2df-df087bd0ca6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:38.884388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:38.938973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 801/1624] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:38 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:38.941028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a5aa7-20ab-4c6b-8acb-a97cec5cf983 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:38.975631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a5aa7-20ab-4c6b-8acb-a97cec5cf983 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:38.991116 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fd279-989c-4c52-a1fa-0229d22bdfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:38.991852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd279-989c-4c52-a1fa-0229d22bdfbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:38.993095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd279-989c-4c52-a1fa-0229d22bdfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:38.993095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd279-989c-4c52-a1fa-0229d22bdfbf admin admin] PATH_INFO: `/v3/projects/0dab50206a6643c3ab82608469b658c5/users/7f24c3e5a78242e6be083aedf5a938a1/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.013997 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86751efd-b715-47da-a2df-df087bd0ca6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:39.015730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86751efd-b715-47da-a2df-df087bd0ca6b service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:39.024817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fd279-989c-4c52-a1fa-0229d22bdfbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dab50206a6643c3ab82608469b658c5, user_id=7f24c3e5a78242e6be083aedf5a938a1, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:39.028652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fd279-989c-4c52-a1fa-0229d22bdfbf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:39.054377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 824/1625] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:39.056569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86751efd-b715-47da-a2df-df087bd0ca6b service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:39.084465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86751efd-b715-47da-a2df-df087bd0ca6b service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:39.094847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7cfca-3fc3-47ca-9e00-1ebe7c1bda63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:39.095496 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cfca-3fc3-47ca-9e00-1ebe7c1bda63 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.095773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cfca-3fc3-47ca-9e00-1ebe7c1bda63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.096043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cfca-3fc3-47ca-9e00-1ebe7c1bda63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.096691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7cfca-3fc3-47ca-9e00-1ebe7c1bda63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:39.103006 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7cfca-3fc3-47ca-9e00-1ebe7c1bda63 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:39.117712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 802/1626] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:38 2022] PUT /identity/v3/projects/0dab50206a6643c3ab82608469b658c5/users/7f24c3e5a78242e6be083aedf5a938a1/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:39.119754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fd279-989c-4c52-a1fa-0229d22bdfbf admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:39.150454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 825/1627] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:39.159902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7cfca-3fc3-47ca-9e00-1ebe7c1bda63 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:39.188074 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7cfca-3fc3-47ca-9e00-1ebe7c1bda63 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:39.280117 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fd279-989c-4c52-a1fa-0229d22bdfbf admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:39.287706 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a12515-3bc0-47ec-9e71-94fe22c06010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:39.289640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a12515-3bc0-47ec-9e71-94fe22c06010 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.290138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a12515-3bc0-47ec-9e71-94fe22c06010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.290650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a12515-3bc0-47ec-9e71-94fe22c06010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.293098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a12515-3bc0-47ec-9e71-94fe22c06010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:39.296065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a12515-3bc0-47ec-9e71-94fe22c06010 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:39.309101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 803/1628] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:39.310035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a12515-3bc0-47ec-9e71-94fe22c06010 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:39.318074 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9b518-85c6-45e6-9cc4-ee85676e103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:39.318727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9b518-85c6-45e6-9cc4-ee85676e103c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.319005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9b518-85c6-45e6-9cc4-ee85676e103c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.319276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9b518-85c6-45e6-9cc4-ee85676e103c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.319936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9b518-85c6-45e6-9cc4-ee85676e103c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:39.321832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9b518-85c6-45e6-9cc4-ee85676e103c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:39.341382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 826/1629] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:39.341382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9b518-85c6-45e6-9cc4-ee85676e103c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:39.349799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9b518-85c6-45e6-9cc4-ee85676e103c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:39.350189 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a12515-3bc0-47ec-9e71-94fe22c06010 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:39.355437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491ea91-1f86-41ae-b701-c3d52bfe8cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:39.356262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491ea91-1f86-41ae-b701-c3d52bfe8cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.356821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491ea91-1f86-41ae-b701-c3d52bfe8cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.357256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491ea91-1f86-41ae-b701-c3d52bfe8cb7 admin admin] PATH_INFO: `/v3/projects/0eea80c58b9d47a0854bf69b8a20fd7d/users/beb09921c0784c63aed929c6e08a8e1b/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.367528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c585f-d593-4584-b7d4-3fa3641b93ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:39.374705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c585f-d593-4584-b7d4-3fa3641b93ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.375775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c585f-d593-4584-b7d4-3fa3641b93ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.375775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c585f-d593-4584-b7d4-3fa3641b93ed admin admin] PATH_INFO: `/v3/projects/975372ce8e26401d93bf0492dfbecbe6/users/01d4844746c442689612a9ab7cb147fb/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.380172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491ea91-1f86-41ae-b701-c3d52bfe8cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eea80c58b9d47a0854bf69b8a20fd7d, user_id=beb09921c0784c63aed929c6e08a8e1b, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:39.383716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491ea91-1f86-41ae-b701-c3d52bfe8cb7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:39.435128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c585f-d593-4584-b7d4-3fa3641b93ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=975372ce8e26401d93bf0492dfbecbe6, user_id=01d4844746c442689612a9ab7cb147fb, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:39.443513 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c585f-d593-4584-b7d4-3fa3641b93ed admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:39.498195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 827/1630] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:39 2022] PUT /identity/v3/projects/0eea80c58b9d47a0854bf69b8a20fd7d/users/beb09921c0784c63aed929c6e08a8e1b/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:39.499172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491ea91-1f86-41ae-b701-c3d52bfe8cb7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:39.520918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 804/1631] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:39 2022] PUT /identity/v3/projects/975372ce8e26401d93bf0492dfbecbe6/users/01d4844746c442689612a9ab7cb147fb/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:39.521794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c585f-d593-4584-b7d4-3fa3641b93ed admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:39.590572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:39.626467 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491ea91-1f86-41ae-b701-c3d52bfe8cb7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:39.653013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c585f-d593-4584-b7d4-3fa3641b93ed admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:39.659238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccc2b2-c1f9-44f7-acc7-dfe31fa169b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:39.660031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccc2b2-c1f9-44f7-acc7-dfe31fa169b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.660370 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccc2b2-c1f9-44f7-acc7-dfe31fa169b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.660687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccc2b2-c1f9-44f7-acc7-dfe31fa169b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.661346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccc2b2-c1f9-44f7-acc7-dfe31fa169b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:39.663556 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccc2b2-c1f9-44f7-acc7-dfe31fa169b2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:39.677962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:39.684197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 805/1632] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:39.685188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccc2b2-c1f9-44f7-acc7-dfe31fa169b2 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:39.790776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccc2b2-c1f9-44f7-acc7-dfe31fa169b2 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:39.790776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef1d36-a388-497c-b28b-6756dcd79721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:39.790776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef1d36-a388-497c-b28b-6756dcd79721 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.790776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef1d36-a388-497c-b28b-6756dcd79721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.791929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef1d36-a388-497c-b28b-6756dcd79721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.791929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef1d36-a388-497c-b28b-6756dcd79721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:39.791929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef1d36-a388-497c-b28b-6756dcd79721 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:39.791929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 806/1633] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:39.791929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688824-168b-43d9-8fcf-9791f4847026 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.791929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688824-168b-43d9-8fcf-9791f4847026 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.792571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688824-168b-43d9-8fcf-9791f4847026 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.792571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 807/1634] 10.222.0.23 () {54 vars in 912 bytes} [Thu Sep 8 16:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:17:39.792571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1688824-168b-43d9-8fcf-9791f4847026 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:39.796925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b6d3e-100a-470a-b84f-823ce4f7621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:39.797994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6d3e-100a-470a-b84f-823ce4f7621c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.797994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6d3e-100a-470a-b84f-823ce4f7621c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.798207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6d3e-100a-470a-b84f-823ce4f7621c admin admin] PATH_INFO: `/v3/projects/0dab50206a6643c3ab82608469b658c5/users/7f24c3e5a78242e6be083aedf5a938a1/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.801874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1688824-168b-43d9-8fcf-9791f4847026 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:39.803757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b6d3e-100a-470a-b84f-823ce4f7621c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dab50206a6643c3ab82608469b658c5, user_id=7f24c3e5a78242e6be083aedf5a938a1, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:39.807566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b6d3e-100a-470a-b84f-823ce4f7621c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:39.811525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb24d7a-ae2a-436f-86c7-aad9e5526eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:39.813358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24d7a-ae2a-436f-86c7-aad9e5526eed admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.813638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24d7a-ae2a-436f-86c7-aad9e5526eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.813911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb24d7a-ae2a-436f-86c7-aad9e5526eed admin admin] PATH_INFO: `/v3/projects/0eea80c58b9d47a0854bf69b8a20fd7d/users/beb09921c0784c63aed929c6e08a8e1b/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.824894 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb24d7a-ae2a-436f-86c7-aad9e5526eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eea80c58b9d47a0854bf69b8a20fd7d, user_id=beb09921c0784c63aed929c6e08a8e1b, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:39.825088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 828/1635] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:39 2022] PUT /identity/v3/projects/0dab50206a6643c3ab82608469b658c5/users/7f24c3e5a78242e6be083aedf5a938a1/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:39.826021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b6d3e-100a-470a-b84f-823ce4f7621c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:39.828824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb24d7a-ae2a-436f-86c7-aad9e5526eed admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:39.849354 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 808/1636] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:39 2022] PUT /identity/v3/projects/0eea80c58b9d47a0854bf69b8a20fd7d/users/beb09921c0784c63aed929c6e08a8e1b/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:39.850986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b6656-f85e-42b5-8c24-beb72f101593 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.851346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b6656-f85e-42b5-8c24-beb72f101593 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.851631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b6656-f85e-42b5-8c24-beb72f101593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:39.876674 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-687b6656-f85e-42b5-8c24-beb72f101593 None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:39.877966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-687b6656-f85e-42b5-8c24-beb72f101593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:39.932454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b6d3e-100a-470a-b84f-823ce4f7621c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:39.991796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 809/1637] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:17:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:39.993098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2e32-226b-4e7c-9e62-216ca0027e6e None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:39.993821 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2e32-226b-4e7c-9e62-216ca0027e6e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:39.993821 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2e32-226b-4e7c-9e62-216ca0027e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:40.039238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c1bd2e32-226b-4e7c-9e62-216ca0027e6e None None] MFA Rules not processed for user `7f24c3e5a78242e6be083aedf5a938a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:40.040601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c1bd2e32-226b-4e7c-9e62-216ca0027e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:40.075681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a5a5e-4b54-4757-86e8-5a5a61ad4ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:40.077078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5a5e-4b54-4757-86e8-5a5a61ad4ced admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:40.077078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5a5e-4b54-4757-86e8-5a5a61ad4ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:40.077078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5a5e-4b54-4757-86e8-5a5a61ad4ced admin admin] PATH_INFO: `/v3/projects/975372ce8e26401d93bf0492dfbecbe6/users/01d4844746c442689612a9ab7cb147fb/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:40.079047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a5a5e-4b54-4757-86e8-5a5a61ad4ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=975372ce8e26401d93bf0492dfbecbe6, user_id=01d4844746c442689612a9ab7cb147fb, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:40.081958 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a5a5e-4b54-4757-86e8-5a5a61ad4ced admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:40.114590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 829/1638] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:39 2022] PUT /identity/v3/projects/975372ce8e26401d93bf0492dfbecbe6/users/01d4844746c442689612a9ab7cb147fb/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:40.116294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a6c6c-9a14-4c41-a999-81aa0e2f2096 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:40.116609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a6c6c-9a14-4c41-a999-81aa0e2f2096 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:40.116859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a6c6c-9a14-4c41-a999-81aa0e2f2096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:40.157616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0a3a6c6c-9a14-4c41-a999-81aa0e2f2096 None None] MFA Rules not processed for user `beb09921c0784c63aed929c6e08a8e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:40.159202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0a3a6c6c-9a14-4c41-a999-81aa0e2f2096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:40.196644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 810/1639] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:40.197797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd2e32-226b-4e7c-9e62-216ca0027e6e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:40.507266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd2e32-226b-4e7c-9e62-216ca0027e6e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:40.507882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 830/1640] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:40.507882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc39b-a331-4216-abeb-638eac0b0960 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:40.507882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc39b-a331-4216-abeb-638eac0b0960 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:40.507882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcc39b-a331-4216-abeb-638eac0b0960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:40.509849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dccda-bf0e-446c-b3a8-295f59d40795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:40.509849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dccda-bf0e-446c-b3a8-295f59d40795 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:40.509849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dccda-bf0e-446c-b3a8-295f59d40795 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:40.509849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dccda-bf0e-446c-b3a8-295f59d40795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:40.510444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-60dcc39b-a331-4216-abeb-638eac0b0960 None None] MFA Rules not processed for user `01d4844746c442689612a9ab7cb147fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:40.510444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-60dcc39b-a331-4216-abeb-638eac0b0960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:40.510713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dccda-bf0e-446c-b3a8-295f59d40795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:40.512873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dccda-bf0e-446c-b3a8-295f59d40795 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:40.535969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 811/1641] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:40.537758 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dccda-bf0e-446c-b3a8-295f59d40795 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:40.556104 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dccda-bf0e-446c-b3a8-295f59d40795 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:40.561411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3d604-8c27-493e-b060-753183374d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:40.562435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3d604-8c27-493e-b060-753183374d5a service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:40.562951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3d604-8c27-493e-b060-753183374d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:40.563305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3d604-8c27-493e-b060-753183374d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:40.662823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3d604-8c27-493e-b060-753183374d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:40.665907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3d604-8c27-493e-b060-753183374d5a service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:40.683809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 831/1642] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:40.685751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 812/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:40.872235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcc39b-a331-4216-abeb-638eac0b0960 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:40.885345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcc39b-a331-4216-abeb-638eac0b0960 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:40.896650 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07411a2-a1aa-498a-907d-7e60d8bf2d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:40.897286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07411a2-a1aa-498a-907d-7e60d8bf2d8d service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:40.897565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07411a2-a1aa-498a-907d-7e60d8bf2d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:40.897838 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07411a2-a1aa-498a-907d-7e60d8bf2d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:40.919272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07411a2-a1aa-498a-907d-7e60d8bf2d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:40.920759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07411a2-a1aa-498a-907d-7e60d8bf2d8d service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:40.943375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 832/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:41.143197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3d604-8c27-493e-b060-753183374d5a service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:41.152375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3d604-8c27-493e-b060-753183374d5a service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:41.159032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd346a-7afc-4c76-b509-df4b7572f164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:41.159935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd346a-7afc-4c76-b509-df4b7572f164 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:41.162707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd346a-7afc-4c76-b509-df4b7572f164 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:41.162707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd346a-7afc-4c76-b509-df4b7572f164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:41.173748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd346a-7afc-4c76-b509-df4b7572f164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:41.175485 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd346a-7afc-4c76-b509-df4b7572f164 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:41.201043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 813/1645] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:41.365454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:41.494265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07411a2-a1aa-498a-907d-7e60d8bf2d8d service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:41.507760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07411a2-a1aa-498a-907d-7e60d8bf2d8d service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:41.521283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f98917-d5c5-4af8-af92-79e3af5ce6bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:41.522701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f98917-d5c5-4af8-af92-79e3af5ce6bc service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:41.522701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f98917-d5c5-4af8-af92-79e3af5ce6bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:41.522701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f98917-d5c5-4af8-af92-79e3af5ce6bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:41.645084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:41.697565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f98917-d5c5-4af8-af92-79e3af5ce6bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:41.700282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f98917-d5c5-4af8-af92-79e3af5ce6bc service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:41.728535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 833/1646] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:42.392745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd346a-7afc-4c76-b509-df4b7572f164 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:42.406361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd346a-7afc-4c76-b509-df4b7572f164 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:42.414994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9b088-1104-4576-9885-2277560ab918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:42.415849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b088-1104-4576-9885-2277560ab918 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:42.416279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b088-1104-4576-9885-2277560ab918 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:42.416723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9b088-1104-4576-9885-2277560ab918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:42.517151 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:42.590552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9b088-1104-4576-9885-2277560ab918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:42.591978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9b088-1104-4576-9885-2277560ab918 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:42.610541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 814/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:42.882754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab952965-1241-4f10-9110-10d5e82b3e08 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:42.882754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab952965-1241-4f10-9110-10d5e82b3e08 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:42.883354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab952965-1241-4f10-9110-10d5e82b3e08 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:42.885568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 834/1648] 10.222.0.23 () {54 vars in 962 bytes} [Thu Sep 8 16:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:17:42.894121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067db54-480b-4a0c-b77f-585c4b9e4265 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:42.894481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067db54-480b-4a0c-b77f-585c4b9e4265 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:42.894777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067db54-480b-4a0c-b77f-585c4b9e4265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:42.933325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-5067db54-480b-4a0c-b77f-585c4b9e4265 None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:42.934596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5067db54-480b-4a0c-b77f-585c4b9e4265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:42.958113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 815/1649] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Sep 8 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:42.959130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef20a5-5bbe-4178-aba2-c0b0e2ac8f37 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:42.959417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef20a5-5bbe-4178-aba2-c0b0e2ac8f37 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:42.959696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef20a5-5bbe-4178-aba2-c0b0e2ac8f37 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:42.961375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 835/1650] 10.222.0.23 () {54 vars in 912 bytes} [Thu Sep 8 16:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:17:42.967858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe44d2a-3bca-4fe9-9616-f451c2a6c0b1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:42.968324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe44d2a-3bca-4fe9-9616-f451c2a6c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:42.969152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe44d2a-3bca-4fe9-9616-f451c2a6c0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:43.029061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-dfe44d2a-3bca-4fe9-9616-f451c2a6c0b1 None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:43.034202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dfe44d2a-3bca-4fe9-9616-f451c2a6c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:43.080032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 816/1651] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:43.152922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef20a5-5bbe-4178-aba2-c0b0e2ac8f37 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:43.171423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef20a5-5bbe-4178-aba2-c0b0e2ac8f37 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:43.188031 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68348f-8504-4869-a293-02203d18d523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:43.191616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68348f-8504-4869-a293-02203d18d523 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:43.191616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68348f-8504-4869-a293-02203d18d523 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:43.191616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68348f-8504-4869-a293-02203d18d523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:43.218837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68348f-8504-4869-a293-02203d18d523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:43.220327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68348f-8504-4869-a293-02203d18d523 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:43.251797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 836/1652] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:44.481934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe44d2a-3bca-4fe9-9616-f451c2a6c0b1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:44.751192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe44d2a-3bca-4fe9-9616-f451c2a6c0b1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:44.771433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188eb48-75e4-4514-b3a4-1a1962ed873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:44.772091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188eb48-75e4-4514-b3a4-1a1962ed873f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:44.772368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188eb48-75e4-4514-b3a4-1a1962ed873f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:44.772636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188eb48-75e4-4514-b3a4-1a1962ed873f admin admin] PATH_INFO: `/v3/users/baca2d55b1824b73beb2c887b79a83d4` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:44.773905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188eb48-75e4-4514-b3a4-1a1962ed873f admin admin] RBAC: Authorizing `identity:delete_user(user_id=baca2d55b1824b73beb2c887b79a83d4)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:44.777466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188eb48-75e4-4514-b3a4-1a1962ed873f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:44.891790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27834b-d549-4be9-b6d8-30eea93ebf31 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:44.892282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27834b-d549-4be9-b6d8-30eea93ebf31 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:44.894462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27834b-d549-4be9-b6d8-30eea93ebf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:44.957194 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5f27834b-d549-4be9-b6d8-30eea93ebf31 None None] MFA Rules not processed for user `73f357cb7b2d4214bde8d5d0d212c91f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:44.958647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5f27834b-d549-4be9-b6d8-30eea93ebf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:44.994390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:45.018391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-0188eb48-75e4-4514-b3a4-1a1962ed873f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baca2d55b1824b73beb2c887b79a83d4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:45.023216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-0188eb48-75e4-4514-b3a4-1a1962ed873f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baca2d55b1824b73beb2c887b79a83d4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:45.100887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 837/1653] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:45.123181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27834b-d549-4be9-b6d8-30eea93ebf31 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:45.129937 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-0188eb48-75e4-4514-b3a4-1a1962ed873f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baca2d55b1824b73beb2c887b79a83d4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:45.130607 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-0188eb48-75e4-4514-b3a4-1a1962ed873f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baca2d55b1824b73beb2c887b79a83d4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:45.144726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-0188eb48-75e4-4514-b3a4-1a1962ed873f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baca2d55b1824b73beb2c887b79a83d4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:45.170402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27834b-d549-4be9-b6d8-30eea93ebf31 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:45.201163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6f374-06b8-41e1-9577-79171a02975c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:45.202061 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f374-06b8-41e1-9577-79171a02975c service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:45.205822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 817/1654] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:17:44 2022] DELETE /identity/v3/users/baca2d55b1824b73beb2c887b79a83d4 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:17:45.206749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f374-06b8-41e1-9577-79171a02975c service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:45.207261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f374-06b8-41e1-9577-79171a02975c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:45.210866 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a6ff3-0e7d-4fab-80a4-dc5c1368ce48 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:45.211158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a6ff3-0e7d-4fab-80a4-dc5c1368ce48 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:45.211438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a6ff3-0e7d-4fab-80a4-dc5c1368ce48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:45.228682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:45.237718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-10a6f374-06b8-41e1-9577-79171a02975c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:45.286746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-aa3a6ff3-0e7d-4fab-80a4-dc5c1368ce48 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:45.289032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-aa3a6ff3-0e7d-4fab-80a4-dc5c1368ce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:45.300394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6f374-06b8-41e1-9577-79171a02975c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:45.302089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6f374-06b8-41e1-9577-79171a02975c service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:45.318946 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 838/1655] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:45.511288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 818/1656] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:45.549519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6f374-06b8-41e1-9577-79171a02975c service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:45.560747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-10a6f374-06b8-41e1-9577-79171a02975c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:45.713545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6f374-06b8-41e1-9577-79171a02975c service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:45.869700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188227f-cfe3-4861-bcb2-a02a93f1e9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:45.869700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188227f-cfe3-4861-bcb2-a02a93f1e9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:45.869700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188227f-cfe3-4861-bcb2-a02a93f1e9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:45.869700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188227f-cfe3-4861-bcb2-a02a93f1e9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:45.884480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188227f-cfe3-4861-bcb2-a02a93f1e9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:45.896706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188227f-cfe3-4861-bcb2-a02a93f1e9d8 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:45.922178 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 839/1657] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:46.854319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a6ff3-0e7d-4fab-80a4-dc5c1368ce48 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:46.855882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-aa3a6ff3-0e7d-4fab-80a4-dc5c1368ce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:46.882695 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a6ff3-0e7d-4fab-80a4-dc5c1368ce48 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:46.901324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:46.901987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:46.902267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:46.902545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] PATH_INFO: `/v3/projects/1f468b866b794c3995d20736553a3e7d` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:46.903764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f468b866b794c3995d20736553a3e7d)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:46.904814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: WARNING py.warnings [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:17:46.904814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: warnings.warn(msg) Sep 08 16:17:46.904814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: Sep 08 16:17:46.906763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:47.113350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f468b866b794c3995d20736553a3e7d', 'request_id': 'req-2755d270-bef5-4510-847f-3fab1e0c7db4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:47.133382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f468b866b794c3995d20736553a3e7d', 'request_id': 'req-2755d270-bef5-4510-847f-3fab1e0c7db4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:47.185770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f468b866b794c3995d20736553a3e7d', 'request_id': 'req-2755d270-bef5-4510-847f-3fab1e0c7db4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:47.333303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] The token cache is being invalidate because project 1f468b866b794c3995d20736553a3e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:17:47.333823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:47.336080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:47.348088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 819/1658] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:17:46 2022] DELETE /identity/v3/projects/1f468b866b794c3995d20736553a3e7d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:47.349000 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188227f-cfe3-4861-bcb2-a02a93f1e9d8 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:47.361797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188227f-cfe3-4861-bcb2-a02a93f1e9d8 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:47.523577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:47.524450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:47.524860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:47.525332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] PATH_INFO: `/v3/users/7f24c3e5a78242e6be083aedf5a938a1` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:47.527391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f24c3e5a78242e6be083aedf5a938a1)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:47.528708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:17:47.528708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Sep 08 16:17:47.528708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: Sep 08 16:17:47.530418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:47.542795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:47.857839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f24c3e5a78242e6be083aedf5a938a1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:47.859078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f24c3e5a78242e6be083aedf5a938a1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:47.975575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f24c3e5a78242e6be083aedf5a938a1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:47.979196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f24c3e5a78242e6be083aedf5a938a1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:48.010298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d93d778d-07e2-4e4a-b5bd-9777e41c43d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f24c3e5a78242e6be083aedf5a938a1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:48.064967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 840/1659] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:17:47 2022] DELETE /identity/v3/users/7f24c3e5a78242e6be083aedf5a938a1 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:48.657354 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:48.659775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:48.695874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755d270-bef5-4510-847f-3fab1e0c7db4 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:48.830304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:48.831401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:48.831929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:48.832481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] PATH_INFO: `/v3/users/a1d7a70ef16f41df946d008032871687` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:48.833952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d7a70ef16f41df946d008032871687)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:48.836325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:48.953045 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:49.065527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d7a70ef16f41df946d008032871687'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:49.066592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d7a70ef16f41df946d008032871687'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:49.166906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d7a70ef16f41df946d008032871687'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:49.174982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d7a70ef16f41df946d008032871687'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:49.180333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d7a70ef16f41df946d008032871687'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:49.245724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 820/1660] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:17:48 2022] DELETE /identity/v3/users/a1d7a70ef16f41df946d008032871687 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:49.250400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee1d8-05fd-4d13-beae-fa6301c59710 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:49.251355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee1d8-05fd-4d13-beae-fa6301c59710 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:49.251792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee1d8-05fd-4d13-beae-fa6301c59710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:49.289404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fb7ee1d8-05fd-4d13-beae-fa6301c59710 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:49.290970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fb7ee1d8-05fd-4d13-beae-fa6301c59710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:49.439620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 841/1661] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:49.453975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:49.455476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:49.475776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ee1d8-05fd-4d13-beae-fa6301c59710 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:49.477220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fb7ee1d8-05fd-4d13-beae-fa6301c59710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:49.486787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a9f6-21aa-4f35-ba5a-6e7135025977 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:49.510077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:49.510756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:49.511043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:49.513062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] PATH_INFO: `/v3/users/58efc51f0f044d2fb021144216ab2214` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:49.515583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58efc51f0f044d2fb021144216ab2214)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:49.522967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:49.595372 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ee1d8-05fd-4d13-beae-fa6301c59710 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:49.600458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfedd74-5d65-4200-a869-e45663469d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:49.601146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedd74-5d65-4200-a869-e45663469d8c service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:49.601493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedd74-5d65-4200-a869-e45663469d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:49.601837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedd74-5d65-4200-a869-e45663469d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:49.620452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfedd74-5d65-4200-a869-e45663469d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:49.622221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfedd74-5d65-4200-a869-e45663469d8c service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:49.646692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 842/1662] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:49.752890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58efc51f0f044d2fb021144216ab2214'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:49.755371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58efc51f0f044d2fb021144216ab2214'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:49.832994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58efc51f0f044d2fb021144216ab2214'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:49.833699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58efc51f0f044d2fb021144216ab2214'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:49.851248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58efc51f0f044d2fb021144216ab2214'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:49.878232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 821/1663] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:17:49 2022] DELETE /identity/v3/users/58efc51f0f044d2fb021144216ab2214 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:49.883342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54895fda-1907-4295-abbe-24bb93152172 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:49.883909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54895fda-1907-4295-abbe-24bb93152172 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:49.884400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54895fda-1907-4295-abbe-24bb93152172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:49.918703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-54895fda-1907-4295-abbe-24bb93152172 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:49.922890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-54895fda-1907-4295-abbe-24bb93152172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:49.986717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:50.099563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 843/1664] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:50.136149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:50.136149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:50.207281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54895fda-1907-4295-abbe-24bb93152172 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:50.209134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-54895fda-1907-4295-abbe-24bb93152172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:50.246316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54895fda-1907-4295-abbe-24bb93152172 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:50.273849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:50.274472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:50.274558 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:50.276225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] PATH_INFO: `/v3/projects/0dab50206a6643c3ab82608469b658c5` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:50.278748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dab50206a6643c3ab82608469b658c5)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:50.285693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:50.332379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625abd6-6d10-4ec0-9dfa-9d3001e5fb03 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:50.342518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14378d0-d6f4-4063-ba94-eb4911ba8c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:50.343799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14378d0-d6f4-4063-ba94-eb4911ba8c7f service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:50.344077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14378d0-d6f4-4063-ba94-eb4911ba8c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:50.344355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14378d0-d6f4-4063-ba94-eb4911ba8c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:50.380455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14378d0-d6f4-4063-ba94-eb4911ba8c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:50.381941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14378d0-d6f4-4063-ba94-eb4911ba8c7f service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:50.415983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 822/1665] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:50.418555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14378d0-d6f4-4063-ba94-eb4911ba8c7f service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:50.421403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d14378d0-d6f4-4063-ba94-eb4911ba8c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:50.457196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14378d0-d6f4-4063-ba94-eb4911ba8c7f service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:50.464848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d93f3-cfbe-486c-8715-70ca66e8e5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:50.466612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d93f3-cfbe-486c-8715-70ca66e8e5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:50.467107 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d93f3-cfbe-486c-8715-70ca66e8e5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:50.467600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d93f3-cfbe-486c-8715-70ca66e8e5fd admin admin] PATH_INFO: `/v3/users/bcafdd6ed7704aca9faab1b8aba3d114` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:50.469693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d93f3-cfbe-486c-8715-70ca66e8e5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcafdd6ed7704aca9faab1b8aba3d114)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:50.473770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d93f3-cfbe-486c-8715-70ca66e8e5fd admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:50.512286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dab50206a6643c3ab82608469b658c5', 'request_id': 'req-23565f33-0e86-48b7-91c6-eb3371253e9e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:50.527163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dab50206a6643c3ab82608469b658c5', 'request_id': 'req-23565f33-0e86-48b7-91c6-eb3371253e9e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:50.539938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dab50206a6643c3ab82608469b658c5', 'request_id': 'req-23565f33-0e86-48b7-91c6-eb3371253e9e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:50.629980 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] The token cache is being invalidate because project 0dab50206a6643c3ab82608469b658c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:17:50.630281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:50.631098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-23565f33-0e86-48b7-91c6-eb3371253e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:50.637905 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 844/1666] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:17:50 2022] DELETE /identity/v3/projects/0dab50206a6643c3ab82608469b658c5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:50.643700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b164c5-1494-4308-84fa-25dd38077cc2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:50.643859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b164c5-1494-4308-84fa-25dd38077cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:50.644139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b164c5-1494-4308-84fa-25dd38077cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:50.701282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d9b164c5-1494-4308-84fa-25dd38077cc2 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:50.704283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d9b164c5-1494-4308-84fa-25dd38077cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:50.717499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d59d93f3-cfbe-486c-8715-70ca66e8e5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcafdd6ed7704aca9faab1b8aba3d114'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:50.718644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d59d93f3-cfbe-486c-8715-70ca66e8e5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcafdd6ed7704aca9faab1b8aba3d114'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:50.809997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d59d93f3-cfbe-486c-8715-70ca66e8e5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcafdd6ed7704aca9faab1b8aba3d114'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:50.811412 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d59d93f3-cfbe-486c-8715-70ca66e8e5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcafdd6ed7704aca9faab1b8aba3d114'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:50.823820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d59d93f3-cfbe-486c-8715-70ca66e8e5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcafdd6ed7704aca9faab1b8aba3d114'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:50.847287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 845/1667] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:50.848841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f352b-3a8e-4cc4-9f4b-c984e28bcded None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:50.849184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f352b-3a8e-4cc4-9f4b-c984e28bcded None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:50.855993 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f352b-3a8e-4cc4-9f4b-c984e28bcded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:50.889057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 823/1668] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:17:50 2022] DELETE /identity/v3/users/bcafdd6ed7704aca9faab1b8aba3d114 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:50.891135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb314c2-2b60-48ce-99ef-f2309946d4fc None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:50.891427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb314c2-2b60-48ce-99ef-f2309946d4fc None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:50.891705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb314c2-2b60-48ce-99ef-f2309946d4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:50.906451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ee8f352b-3a8e-4cc4-9f4b-c984e28bcded None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:50.907737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ee8f352b-3a8e-4cc4-9f4b-c984e28bcded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:50.933121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-1cb314c2-2b60-48ce-99ef-f2309946d4fc None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:50.934895 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1cb314c2-2b60-48ce-99ef-f2309946d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:51.005880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 846/1669] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:51.010624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f352b-3a8e-4cc4-9f4b-c984e28bcded None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:51.012227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ee8f352b-3a8e-4cc4-9f4b-c984e28bcded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:51.026825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f352b-3a8e-4cc4-9f4b-c984e28bcded None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:51.033005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:51.033998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:51.034398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:51.034938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] PATH_INFO: `/v3/projects/d5228d9e69f94e90b5e2c94fb85fe90d` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:51.036448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5228d9e69f94e90b5e2c94fb85fe90d)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:51.039406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:51.087687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 824/1670] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:51.089068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb314c2-2b60-48ce-99ef-f2309946d4fc None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:51.100282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb314c2-2b60-48ce-99ef-f2309946d4fc None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:51.105793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41396dd2-fdd5-4d0e-8ad7-e9f6430102ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:51.106589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41396dd2-fdd5-4d0e-8ad7-e9f6430102ed admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:51.107017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41396dd2-fdd5-4d0e-8ad7-e9f6430102ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:51.107781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41396dd2-fdd5-4d0e-8ad7-e9f6430102ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:51.109394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41396dd2-fdd5-4d0e-8ad7-e9f6430102ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:51.109394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41396dd2-fdd5-4d0e-8ad7-e9f6430102ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:51.111525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41396dd2-fdd5-4d0e-8ad7-e9f6430102ed admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:51.131170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 825/1671] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:51.132550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41396dd2-fdd5-4d0e-8ad7-e9f6430102ed admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:51.134705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-41396dd2-fdd5-4d0e-8ad7-e9f6430102ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:51.199838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:51.215489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5228d9e69f94e90b5e2c94fb85fe90d', 'request_id': 'req-d5a72083-add1-41d3-8737-795acc8ae2ac'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:51.236010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5228d9e69f94e90b5e2c94fb85fe90d', 'request_id': 'req-d5a72083-add1-41d3-8737-795acc8ae2ac'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:51.252049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5228d9e69f94e90b5e2c94fb85fe90d', 'request_id': 'req-d5a72083-add1-41d3-8737-795acc8ae2ac'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:51.276339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41396dd2-fdd5-4d0e-8ad7-e9f6430102ed admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:51.371513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] The token cache is being invalidate because project d5228d9e69f94e90b5e2c94fb85fe90d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:17:51.374771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:51.374771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:51.376398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 847/1672] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:17:51 2022] DELETE /identity/v3/projects/d5228d9e69f94e90b5e2c94fb85fe90d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:51.379939 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:51.384229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:51.385853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719f7fe-f378-4a88-b5cc-9e243c8014e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:51.386581 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f7fe-f378-4a88-b5cc-9e243c8014e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:51.393344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f7fe-f378-4a88-b5cc-9e243c8014e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:51.394464 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f7fe-f378-4a88-b5cc-9e243c8014e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:51.395939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7719f7fe-f378-4a88-b5cc-9e243c8014e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:51.506206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719f7fe-f378-4a88-b5cc-9e243c8014e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:51.508384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719f7fe-f378-4a88-b5cc-9e243c8014e3 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:51.530017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a72083-add1-41d3-8737-795acc8ae2ac admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:51.532828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 826/1673] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:51.534452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719f7fe-f378-4a88-b5cc-9e243c8014e3 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:51.537755 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740b325-a523-498f-a8f3-83833348caea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:51.537921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7719f7fe-f378-4a88-b5cc-9e243c8014e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:51.538915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740b325-a523-498f-a8f3-83833348caea admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:51.539280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740b325-a523-498f-a8f3-83833348caea admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:51.539775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740b325-a523-498f-a8f3-83833348caea admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:51.540337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740b325-a523-498f-a8f3-83833348caea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:51.542652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740b325-a523-498f-a8f3-83833348caea admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:51.567435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719f7fe-f378-4a88-b5cc-9e243c8014e3 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:51.575358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:51.577317 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:51.577608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:51.578147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] PATH_INFO: `/v3/users/01d4844746c442689612a9ab7cb147fb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:51.579484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d4844746c442689612a9ab7cb147fb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:51.581753 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:51.632503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 848/1674] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:51 2022] POST /identity/v3/projects => generated 363 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:51.640034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740b325-a523-498f-a8f3-83833348caea admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:51.750381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740b325-a523-498f-a8f3-83833348caea admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:51.756833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1aa7c-6746-41f1-b47a-b9f9c53dcc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:51.757627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1aa7c-6746-41f1-b47a-b9f9c53dcc75 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:51.757890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1aa7c-6746-41f1-b47a-b9f9c53dcc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:51.758221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1aa7c-6746-41f1-b47a-b9f9c53dcc75 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:51.759176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1aa7c-6746-41f1-b47a-b9f9c53dcc75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:51.762141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1aa7c-6746-41f1-b47a-b9f9c53dcc75 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:51.818207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d4844746c442689612a9ab7cb147fb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:51.819046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d4844746c442689612a9ab7cb147fb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:51.879171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 849/1675] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:51 2022] POST /identity/v3/users => generated 282 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:17:51.884027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1aa7c-6746-41f1-b47a-b9f9c53dcc75 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:51.895986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d4844746c442689612a9ab7cb147fb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:51.896900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d4844746c442689612a9ab7cb147fb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:51.913021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d4844746c442689612a9ab7cb147fb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:51.921661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1aa7c-6746-41f1-b47a-b9f9c53dcc75 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:51.937623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbd23c-7f48-4c18-bb93-8dfbf6bbaa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:51.954488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbd23c-7f48-4c18-bb93-8dfbf6bbaa53 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:51.956058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbd23c-7f48-4c18-bb93-8dfbf6bbaa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:51.956058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbd23c-7f48-4c18-bb93-8dfbf6bbaa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:51.957725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbd23c-7f48-4c18-bb93-8dfbf6bbaa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:51.961251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbd23c-7f48-4c18-bb93-8dfbf6bbaa53 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:52.019610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 827/1676] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:17:51 2022] DELETE /identity/v3/users/01d4844746c442689612a9ab7cb147fb => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:52.020553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:52.021451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 850/1677] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:17:52.023654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0d68a-f679-42ca-ac2e-8de527ca0f33 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:52.024108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0d68a-f679-42ca-ac2e-8de527ca0f33 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:52.024396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0d68a-f679-42ca-ac2e-8de527ca0f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:52.028723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:52.078452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-09e0d68a-f679-42ca-ac2e-8de527ca0f33 None None] MFA Rules not processed for user `73f357cb7b2d4214bde8d5d0d212c91f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:52.083326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-09e0d68a-f679-42ca-ac2e-8de527ca0f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:52.118646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:52.210433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d340a-5e31-42ae-a664-6149d1193015 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:52.210598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 851/1678] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:52.218569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0d68a-f679-42ca-ac2e-8de527ca0f33 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:52.222156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:52.222862 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:52.223292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:52.223572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] PATH_INFO: `/v3/projects/e779edba2e1a49709df7b45bb51298ea` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:52.224721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-09e0d68a-f679-42ca-ac2e-8de527ca0f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:52.230359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e779edba2e1a49709df7b45bb51298ea)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:52.230359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:52.251037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0d68a-f679-42ca-ac2e-8de527ca0f33 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:52.256366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8fb36-726b-49ad-8335-17226ecbd912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:52.257238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8fb36-726b-49ad-8335-17226ecbd912 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:52.262151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8fb36-726b-49ad-8335-17226ecbd912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:52.262151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8fb36-726b-49ad-8335-17226ecbd912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:52.262151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8fb36-726b-49ad-8335-17226ecbd912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:52.262151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8fb36-726b-49ad-8335-17226ecbd912 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:52.278127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 852/1679] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:52.281999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8fb36-726b-49ad-8335-17226ecbd912 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:52.292654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8fb36-726b-49ad-8335-17226ecbd912 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:52.307674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbcb39-9ae6-44e5-a1ce-d113f8a6aaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:52.308873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcb39-9ae6-44e5-a1ce-d113f8a6aaba admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:52.309395 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcb39-9ae6-44e5-a1ce-d113f8a6aaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:52.310002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcb39-9ae6-44e5-a1ce-d113f8a6aaba admin admin] PATH_INFO: `/v3/projects/362069d0a430431a9db21c279762c4fc/users/9dc59ea917b84184951d652fc43ed9d5/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:52.356685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbcb39-9ae6-44e5-a1ce-d113f8a6aaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=362069d0a430431a9db21c279762c4fc, user_id=9dc59ea917b84184951d652fc43ed9d5, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:52.360011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbcb39-9ae6-44e5-a1ce-d113f8a6aaba admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:52.450401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 853/1680] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:52 2022] PUT /identity/v3/projects/362069d0a430431a9db21c279762c4fc/users/9dc59ea917b84184951d652fc43ed9d5/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:52.465803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e356a6-e949-48e7-adc5-42a10c1dcd4f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:52.466934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e356a6-e949-48e7-adc5-42a10c1dcd4f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:52.469012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e356a6-e949-48e7-adc5-42a10c1dcd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:52.469329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e779edba2e1a49709df7b45bb51298ea', 'request_id': 'req-7bde591b-8b4d-4651-addc-5d0581790cf4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:52.496481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e779edba2e1a49709df7b45bb51298ea', 'request_id': 'req-7bde591b-8b4d-4651-addc-5d0581790cf4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:52.537960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e779edba2e1a49709df7b45bb51298ea', 'request_id': 'req-7bde591b-8b4d-4651-addc-5d0581790cf4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:52.569266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d5e356a6-e949-48e7-adc5-42a10c1dcd4f None None] MFA Rules not processed for user `9dc59ea917b84184951d652fc43ed9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:52.570827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d5e356a6-e949-48e7-adc5-42a10c1dcd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:52.622970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] The token cache is being invalidate because project e779edba2e1a49709df7b45bb51298ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:17:52.623308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:52.624632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:52.630199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 828/1681] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:17:52 2022] DELETE /identity/v3/projects/e779edba2e1a49709df7b45bb51298ea => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:52.631317 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:52.633077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:52.664973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 854/1682] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:52.670053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e356a6-e949-48e7-adc5-42a10c1dcd4f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:52.672134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d5e356a6-e949-48e7-adc5-42a10c1dcd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:52.747630 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde591b-8b4d-4651-addc-5d0581790cf4 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:52.805015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e356a6-e949-48e7-adc5-42a10c1dcd4f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:52.816218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07928bef-a7f1-437d-998b-397204814f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:52.816855 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07928bef-a7f1-437d-998b-397204814f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:52.817948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07928bef-a7f1-437d-998b-397204814f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:52.818442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07928bef-a7f1-437d-998b-397204814f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:52.820612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07928bef-a7f1-437d-998b-397204814f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:52.823539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07928bef-a7f1-437d-998b-397204814f49 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:52.828656 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:52.873004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:52.874583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:52.874583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:52.874918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] PATH_INFO: `/v3/users/beb09921c0784c63aed929c6e08a8e1b` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:52.876542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb09921c0784c63aed929c6e08a8e1b)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:52.879699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:52.951197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 855/1683] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:52 2022] POST /identity/v3/projects => generated 365 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:52.960721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07928bef-a7f1-437d-998b-397204814f49 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:53.128587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb09921c0784c63aed929c6e08a8e1b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:53.130014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb09921c0784c63aed929c6e08a8e1b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:53.192675 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07928bef-a7f1-437d-998b-397204814f49 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:53.201760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336edda-6e5a-434b-8b71-356295d4a109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:53.202774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336edda-6e5a-434b-8b71-356295d4a109 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:53.203213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336edda-6e5a-434b-8b71-356295d4a109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:53.203645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336edda-6e5a-434b-8b71-356295d4a109 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:53.204436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336edda-6e5a-434b-8b71-356295d4a109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:53.208233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336edda-6e5a-434b-8b71-356295d4a109 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:53.221564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb09921c0784c63aed929c6e08a8e1b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:53.222811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb09921c0784c63aed929c6e08a8e1b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:53.236842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb09921c0784c63aed929c6e08a8e1b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:53.272146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 829/1684] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:17:52 2022] DELETE /identity/v3/users/beb09921c0784c63aed929c6e08a8e1b => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:53.327999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 856/1685] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:52 2022] POST /identity/v3/users => generated 289 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:53.331953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:53.333750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:53.475023 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e78268-54db-43c9-8b0b-b61cdcf9f156 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:53.493763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0cf9d-c2d3-4dcb-a2e0-f36da19ac92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:53.494530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0cf9d-c2d3-4dcb-a2e0-f36da19ac92c admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:53.494853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0cf9d-c2d3-4dcb-a2e0-f36da19ac92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:53.495171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0cf9d-c2d3-4dcb-a2e0-f36da19ac92c admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:53.496881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0cf9d-c2d3-4dcb-a2e0-f36da19ac92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:53.498705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0cf9d-c2d3-4dcb-a2e0-f36da19ac92c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:53.560304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 830/1686] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:53.564531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336edda-6e5a-434b-8b71-356295d4a109 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:53.576878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336edda-6e5a-434b-8b71-356295d4a109 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:53.595869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faba227-51d0-4749-9980-6e4b24548a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:53.596563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faba227-51d0-4749-9980-6e4b24548a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:53.596838 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faba227-51d0-4749-9980-6e4b24548a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:53.597108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faba227-51d0-4749-9980-6e4b24548a94 admin admin] PATH_INFO: `/v3/projects/2ea156a84a2b47ce9d5134f3148ef6eb/users/9b34bfce433a400f9e0def56dc27ac8b/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:53.618652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faba227-51d0-4749-9980-6e4b24548a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea156a84a2b47ce9d5134f3148ef6eb, user_id=9b34bfce433a400f9e0def56dc27ac8b, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:53.625776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faba227-51d0-4749-9980-6e4b24548a94 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:53.776273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0cf9d-c2d3-4dcb-a2e0-f36da19ac92c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:53.781616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 857/1687] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:53 2022] PUT /identity/v3/projects/2ea156a84a2b47ce9d5134f3148ef6eb/users/9b34bfce433a400f9e0def56dc27ac8b/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:53.794313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faba227-51d0-4749-9980-6e4b24548a94 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:53.799183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7faba227-51d0-4749-9980-6e4b24548a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:53.800793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0cf9d-c2d3-4dcb-a2e0-f36da19ac92c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:53.963512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bc048-a215-497c-aa16-81f45b597af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:53.969709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bc048-a215-497c-aa16-81f45b597af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:53.969709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bc048-a215-497c-aa16-81f45b597af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:53.969709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bc048-a215-497c-aa16-81f45b597af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:53.969709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bc048-a215-497c-aa16-81f45b597af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:53.969709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bc048-a215-497c-aa16-81f45b597af7 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:53.988981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:53.992786 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 831/1688] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:53.994008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bc048-a215-497c-aa16-81f45b597af7 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:53.998385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5f4bc048-a215-497c-aa16-81f45b597af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:54.025758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faba227-51d0-4749-9980-6e4b24548a94 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:54.037395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bc048-a215-497c-aa16-81f45b597af7 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:54.044806 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:54.045473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:54.045800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:54.046081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] PATH_INFO: `/v3/projects/c9b03154d7554316a85ffc1978a39845` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:54.049631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:54.051344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:54.051526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b03154d7554316a85ffc1978a39845)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:54.051946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:54.054158 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:54.054289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] PATH_INFO: `/v3/projects/975372ce8e26401d93bf0492dfbecbe6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:54.055281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=975372ce8e26401d93bf0492dfbecbe6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:54.061982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:54.311138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975372ce8e26401d93bf0492dfbecbe6', 'request_id': 'req-3afd8aac-fb52-46cd-bc5c-91b8f378b033'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:54.346461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b03154d7554316a85ffc1978a39845', 'request_id': 'req-7a9178ac-d6cc-4199-ab85-12c821f1f692'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:54.353489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975372ce8e26401d93bf0492dfbecbe6', 'request_id': 'req-3afd8aac-fb52-46cd-bc5c-91b8f378b033'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:54.364794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b03154d7554316a85ffc1978a39845', 'request_id': 'req-7a9178ac-d6cc-4199-ab85-12c821f1f692'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:54.381070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b03154d7554316a85ffc1978a39845', 'request_id': 'req-7a9178ac-d6cc-4199-ab85-12c821f1f692'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:54.394214 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975372ce8e26401d93bf0492dfbecbe6', 'request_id': 'req-3afd8aac-fb52-46cd-bc5c-91b8f378b033'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:54.482161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] The token cache is being invalidate because project c9b03154d7554316a85ffc1978a39845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:17:54.482161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:54.483085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a9178ac-d6cc-4199-ab85-12c821f1f692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:54.487619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 858/1689] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:17:53 2022] DELETE /identity/v3/projects/c9b03154d7554316a85ffc1978a39845 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:54.489148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47068fec-0072-484b-afd9-c8fde440bbb8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:54.489570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47068fec-0072-484b-afd9-c8fde440bbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:54.489979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47068fec-0072-484b-afd9-c8fde440bbb8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:54.497076 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 859/1690] 10.222.0.23 () {54 vars in 912 bytes} [Thu Sep 8 16:17:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:17:54.505098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47068fec-0072-484b-afd9-c8fde440bbb8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:54.516316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-47068fec-0072-484b-afd9-c8fde440bbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:54.535524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] The token cache is being invalidate because project 975372ce8e26401d93bf0492dfbecbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:17:54.535824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:54.536858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3afd8aac-fb52-46cd-bc5c-91b8f378b033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:54.544577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 832/1691] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:17:53 2022] DELETE /identity/v3/projects/975372ce8e26401d93bf0492dfbecbe6 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:54.548613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd3e6-c91a-4cad-a82d-cdcc6a238730 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:54.548899 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd3e6-c91a-4cad-a82d-cdcc6a238730 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:54.549179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd3e6-c91a-4cad-a82d-cdcc6a238730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:54.554533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:54.640500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b51dd3e6-c91a-4cad-a82d-cdcc6a238730 None None] MFA Rules not processed for user `d235e94611884b28b85b637ac54204f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:54.646605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b51dd3e6-c91a-4cad-a82d-cdcc6a238730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:54.747557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47068fec-0072-484b-afd9-c8fde440bbb8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:54.770642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f219186-0873-432c-889e-5b3c0998ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:54.771375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f219186-0873-432c-889e-5b3c0998ee38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:54.771646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f219186-0873-432c-889e-5b3c0998ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:54.771914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f219186-0873-432c-889e-5b3c0998ee38 admin admin] PATH_INFO: `/v3/projects/2ea156a84a2b47ce9d5134f3148ef6eb/users/9b34bfce433a400f9e0def56dc27ac8b/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:54.775545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f219186-0873-432c-889e-5b3c0998ee38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea156a84a2b47ce9d5134f3148ef6eb, user_id=9b34bfce433a400f9e0def56dc27ac8b, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:54.778238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f219186-0873-432c-889e-5b3c0998ee38 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:54.833823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 833/1692] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:54.836012 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6dcf2-81ef-4e7d-971e-8fc0e0753e58 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:54.836522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6dcf2-81ef-4e7d-971e-8fc0e0753e58 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:54.836799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6dcf2-81ef-4e7d-971e-8fc0e0753e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:54.846184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 860/1693] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:54 2022] PUT /identity/v3/projects/2ea156a84a2b47ce9d5134f3148ef6eb/users/9b34bfce433a400f9e0def56dc27ac8b/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:54.846184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d00d7-daeb-4258-afbf-aacdb54b6506 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:54.846184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d00d7-daeb-4258-afbf-aacdb54b6506 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:54.846184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d00d7-daeb-4258-afbf-aacdb54b6506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:54.886188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-aaf6dcf2-81ef-4e7d-971e-8fc0e0753e58 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:54.903371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-aaf6dcf2-81ef-4e7d-971e-8fc0e0753e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:54.948925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-637d00d7-daeb-4258-afbf-aacdb54b6506 None None] MFA Rules not processed for user `e08c9de660c04ed98f6100be2d687ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:54.950161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-637d00d7-daeb-4258-afbf-aacdb54b6506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.032086 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 834/1694] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:55.033596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b70107-1e33-43d5-88a9-fe4f049eb9f5 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.033953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b70107-1e33-43d5-88a9-fe4f049eb9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.034588 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b70107-1e33-43d5-88a9-fe4f049eb9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.044428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 861/1695] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:55.046199 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72681e-8a08-4b54-9a6b-f7e103f58e39 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.046488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72681e-8a08-4b54-9a6b-f7e103f58e39 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.046846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72681e-8a08-4b54-9a6b-f7e103f58e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.077856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-63b70107-1e33-43d5-88a9-fe4f049eb9f5 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:55.079235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-63b70107-1e33-43d5-88a9-fe4f049eb9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.087622 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0f72681e-8a08-4b54-9a6b-f7e103f58e39 None None] MFA Rules not processed for user `ce39c87aac4e4df79efc1f80a07b3273`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:55.089630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0f72681e-8a08-4b54-9a6b-f7e103f58e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.103834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 835/1696] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:55.105004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b70107-1e33-43d5-88a9-fe4f049eb9f5 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:55.106396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-63b70107-1e33-43d5-88a9-fe4f049eb9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.142583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b70107-1e33-43d5-88a9-fe4f049eb9f5 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:55.156110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:55.158492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.158806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.159113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] PATH_INFO: `/v3/projects/0eea80c58b9d47a0854bf69b8a20fd7d` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.165883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eea80c58b9d47a0854bf69b8a20fd7d)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:55.168098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:55.230704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 862/1697] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:55.230704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72681e-8a08-4b54-9a6b-f7e103f58e39 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:55.230704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0f72681e-8a08-4b54-9a6b-f7e103f58e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.284488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:55.312464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72681e-8a08-4b54-9a6b-f7e103f58e39 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:55.318609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da853a-df64-4c69-8d5e-3f102fb149d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:55.319332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da853a-df64-4c69-8d5e-3f102fb149d9 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.319616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da853a-df64-4c69-8d5e-3f102fb149d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.319944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da853a-df64-4c69-8d5e-3f102fb149d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.384892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eea80c58b9d47a0854bf69b8a20fd7d', 'request_id': 'req-5b7c36f3-a569-42c5-9ece-7f7354787bd4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:55.400969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eea80c58b9d47a0854bf69b8a20fd7d', 'request_id': 'req-5b7c36f3-a569-42c5-9ece-7f7354787bd4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:55.406044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da853a-df64-4c69-8d5e-3f102fb149d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:55.407907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da853a-df64-4c69-8d5e-3f102fb149d9 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:55.419433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eea80c58b9d47a0854bf69b8a20fd7d', 'request_id': 'req-5b7c36f3-a569-42c5-9ece-7f7354787bd4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:55.433716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 863/1698] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:55.435209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae2e43-704f-4472-8cfd-e6b4d55c238f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.435562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae2e43-704f-4472-8cfd-e6b4d55c238f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.435923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae2e43-704f-4472-8cfd-e6b4d55c238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.487527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9dae2e43-704f-4472-8cfd-e6b4d55c238f None None] MFA Rules not processed for user `9b34bfce433a400f9e0def56dc27ac8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:55.492273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9dae2e43-704f-4472-8cfd-e6b4d55c238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.534496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] The token cache is being invalidate because project 0eea80c58b9d47a0854bf69b8a20fd7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:17:55.534839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:55.535553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5b7c36f3-a569-42c5-9ece-7f7354787bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:17:55.537382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 836/1699] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:17:55 2022] DELETE /identity/v3/projects/0eea80c58b9d47a0854bf69b8a20fd7d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:55.540609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5902e-4806-42a2-b9f7-c3f88921135a None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.542321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5902e-4806-42a2-b9f7-c3f88921135a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.542321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5902e-4806-42a2-b9f7-c3f88921135a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.562804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-d7b5902e-4806-42a2-b9f7-c3f88921135a None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:55.564136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d7b5902e-4806-42a2-b9f7-c3f88921135a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.589045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 864/1700] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:55.593348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae2e43-704f-4472-8cfd-e6b4d55c238f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:55.602850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9dae2e43-704f-4472-8cfd-e6b4d55c238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.658370 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 837/1701] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:55.659691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9cf71-8e4a-449c-9356-dd8c85ecff06 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.659982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9cf71-8e4a-449c-9356-dd8c85ecff06 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.660251 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9cf71-8e4a-449c-9356-dd8c85ecff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.681174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-96b9cf71-8e4a-449c-9356-dd8c85ecff06 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:55.681584 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae2e43-704f-4472-8cfd-e6b4d55c238f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:55.682381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-96b9cf71-8e4a-449c-9356-dd8c85ecff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.685197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e322d-f0c8-43d9-ab2e-92a049ad78e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:55.687132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e322d-f0c8-43d9-ab2e-92a049ad78e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.687132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e322d-f0c8-43d9-ab2e-92a049ad78e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.687132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e322d-f0c8-43d9-ab2e-92a049ad78e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.688681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b87e322d-f0c8-43d9-ab2e-92a049ad78e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.690944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 838/1702] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:55.692265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f28c2-1b61-4601-bf30-a9eba02ea837 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.692561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f28c2-1b61-4601-bf30-a9eba02ea837 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.692910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f28c2-1b61-4601-bf30-a9eba02ea837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.698135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e322d-f0c8-43d9-ab2e-92a049ad78e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:55.700049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e322d-f0c8-43d9-ab2e-92a049ad78e0 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:55.708213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 865/1703] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:55.709445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08ffa2-97de-4a8a-8b68-45d81e63f121 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.709726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08ffa2-97de-4a8a-8b68-45d81e63f121 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.710022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08ffa2-97de-4a8a-8b68-45d81e63f121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.722251 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b73f28c2-1b61-4601-bf30-a9eba02ea837 None None] MFA Rules not processed for user `f0a14aa4ab2241ea95b430653598c4be`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:55.723486 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b73f28c2-1b61-4601-bf30-a9eba02ea837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.735737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0a08ffa2-97de-4a8a-8b68-45d81e63f121 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:55.737369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0a08ffa2-97de-4a8a-8b68-45d81e63f121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.763618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 866/1704] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:55.763618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08ffa2-97de-4a8a-8b68-45d81e63f121 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:55.763618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0a08ffa2-97de-4a8a-8b68-45d81e63f121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.826577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 839/1705] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:55.827653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f28c2-1b61-4601-bf30-a9eba02ea837 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:55.829475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b73f28c2-1b61-4601-bf30-a9eba02ea837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.894531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08ffa2-97de-4a8a-8b68-45d81e63f121 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:55.902507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436334dd-d183-427c-bd76-255d802c6aaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:55.903292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436334dd-d183-427c-bd76-255d802c6aaf service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.903660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436334dd-d183-427c-bd76-255d802c6aaf service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.904026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436334dd-d183-427c-bd76-255d802c6aaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.906295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-436334dd-d183-427c-bd76-255d802c6aaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:55.918761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f28c2-1b61-4601-bf30-a9eba02ea837 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:55.924427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ac54d-3f76-4749-b57e-6271dc7d4fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:55.925103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac54d-3f76-4749-b57e-6271dc7d4fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:55.925389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac54d-3f76-4749-b57e-6271dc7d4fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:55.926201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac54d-3f76-4749-b57e-6271dc7d4fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:55.939508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:55.948060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ac54d-3f76-4749-b57e-6271dc7d4fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:55.948716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ac54d-3f76-4749-b57e-6271dc7d4fa1 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:55.976239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 840/1706] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:55.977506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ac54d-3f76-4749-b57e-6271dc7d4fa1 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:56.000207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ac54d-3f76-4749-b57e-6271dc7d4fa1 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:56.007390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436334dd-d183-427c-bd76-255d802c6aaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:56.009263 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436334dd-d183-427c-bd76-255d802c6aaf service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:56.013341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07d3a6-4cb7-4601-87fb-6fb2ad8cebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:56.013971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07d3a6-4cb7-4601-87fb-6fb2ad8cebed admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.014249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07d3a6-4cb7-4601-87fb-6fb2ad8cebed admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.014646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07d3a6-4cb7-4601-87fb-6fb2ad8cebed admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.015306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07d3a6-4cb7-4601-87fb-6fb2ad8cebed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:56.015560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07d3a6-4cb7-4601-87fb-6fb2ad8cebed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:56.017121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07d3a6-4cb7-4601-87fb-6fb2ad8cebed admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:56.021645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 867/1707] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:56.021933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436334dd-d183-427c-bd76-255d802c6aaf service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:56.034436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 841/1708] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:56.035734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad171-9b32-4c6b-bae3-388be3cf38e9 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.035954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad171-9b32-4c6b-bae3-388be3cf38e9 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.036196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fad171-9b32-4c6b-bae3-388be3cf38e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.043273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436334dd-d183-427c-bd76-255d802c6aaf service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:56.061525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de294f5-3f08-4fce-8f6e-d80dfff4cbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:56.063078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de294f5-3f08-4fce-8f6e-d80dfff4cbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.063185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-98fad171-9b32-4c6b-bae3-388be3cf38e9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:56.063266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de294f5-3f08-4fce-8f6e-d80dfff4cbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.063266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de294f5-3f08-4fce-8f6e-d80dfff4cbe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.063384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de294f5-3f08-4fce-8f6e-d80dfff4cbe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:56.063758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de294f5-3f08-4fce-8f6e-d80dfff4cbe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:56.063858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-98fad171-9b32-4c6b-bae3-388be3cf38e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:56.065291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de294f5-3f08-4fce-8f6e-d80dfff4cbe4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:56.077987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 842/1709] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:56.079613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07f5f8-d167-448e-8f62-c99fb325299c None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.079901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07f5f8-d167-448e-8f62-c99fb325299c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.080182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07f5f8-d167-448e-8f62-c99fb325299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.082565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 868/1710] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:56.083500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de294f5-3f08-4fce-8f6e-d80dfff4cbe4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:56.100084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de294f5-3f08-4fce-8f6e-d80dfff4cbe4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:56.127540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbb20c-d71f-438c-bdd5-ba263d81d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:56.129266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbb20c-d71f-438c-bdd5-ba263d81d3cb admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.129561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbb20c-d71f-438c-bdd5-ba263d81d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.134885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbb20c-d71f-438c-bdd5-ba263d81d3cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.135909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbb20c-d71f-438c-bdd5-ba263d81d3cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:56.139184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbb20c-d71f-438c-bdd5-ba263d81d3cb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:56.145309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-6a07f5f8-d167-448e-8f62-c99fb325299c None None] MFA Rules not processed for user `f0a14aa4ab2241ea95b430653598c4be`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:56.147301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6a07f5f8-d167-448e-8f62-c99fb325299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:56.165987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 843/1711] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:56.167049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07f5f8-d167-448e-8f62-c99fb325299c None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:56.179269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07f5f8-d167-448e-8f62-c99fb325299c None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:56.184157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83af4c-fd2f-4f7c-b94b-9d2dfe2f5fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:56.184791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83af4c-fd2f-4f7c-b94b-9d2dfe2f5fea admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.185067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83af4c-fd2f-4f7c-b94b-9d2dfe2f5fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.185336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83af4c-fd2f-4f7c-b94b-9d2dfe2f5fea admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.185981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83af4c-fd2f-4f7c-b94b-9d2dfe2f5fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:17:56.186309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83af4c-fd2f-4f7c-b94b-9d2dfe2f5fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:56.187940 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83af4c-fd2f-4f7c-b94b-9d2dfe2f5fea admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:56.199515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 844/1712] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:17:56.200217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83af4c-fd2f-4f7c-b94b-9d2dfe2f5fea admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:56.209686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83af4c-fd2f-4f7c-b94b-9d2dfe2f5fea admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:56.214338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142759e-7824-480b-a324-7ef90197d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:56.214959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142759e-7824-480b-a324-7ef90197d7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.215234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142759e-7824-480b-a324-7ef90197d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.215506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142759e-7824-480b-a324-7ef90197d7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.219705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142759e-7824-480b-a324-7ef90197d7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:56.219705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142759e-7824-480b-a324-7ef90197d7dd admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:56.364511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 845/1714] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:56 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:56.364771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 869/1714] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:56 2022] POST /identity/v3/projects => generated 365 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:56.366506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142759e-7824-480b-a324-7ef90197d7dd admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:56.366897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbb20c-d71f-438c-bdd5-ba263d81d3cb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:56.536688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbb20c-d71f-438c-bdd5-ba263d81d3cb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:56.579748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:56.600475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142759e-7824-480b-a324-7ef90197d7dd admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:56.611583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cd2d1-76ce-4972-993c-d48bf2e68898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:56.612303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd2d1-76ce-4972-993c-d48bf2e68898 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.613441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd2d1-76ce-4972-993c-d48bf2e68898 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.613441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd2d1-76ce-4972-993c-d48bf2e68898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.650361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0ff73-7d78-4514-a534-2c55dd411480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:56.651101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0ff73-7d78-4514-a534-2c55dd411480 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.651378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0ff73-7d78-4514-a534-2c55dd411480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.651706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0ff73-7d78-4514-a534-2c55dd411480 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.652343 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0ff73-7d78-4514-a534-2c55dd411480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:56.654538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0ff73-7d78-4514-a534-2c55dd411480 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:56.679595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cd2d1-76ce-4972-993c-d48bf2e68898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:56.681196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cd2d1-76ce-4972-993c-d48bf2e68898 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:56.690548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 846/1715] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:56.691511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cd2d1-76ce-4972-993c-d48bf2e68898 service nova] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:56.756937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 870/1716] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:56 2022] POST /identity/v3/projects => generated 393 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:56.757845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0ff73-7d78-4514-a534-2c55dd411480 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:56.794474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cd2d1-76ce-4972-993c-d48bf2e68898 service nova] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:56.865694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0ff73-7d78-4514-a534-2c55dd411480 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:56.871355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e73b3-61bb-44a4-93a3-067af93d2520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:56.872030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e73b3-61bb-44a4-93a3-067af93d2520 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.872311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e73b3-61bb-44a4-93a3-067af93d2520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.872584 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e73b3-61bb-44a4-93a3-067af93d2520 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.873436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e73b3-61bb-44a4-93a3-067af93d2520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:56.876896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e73b3-61bb-44a4-93a3-067af93d2520 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:56.878847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a13c-5451-4825-bce8-686c8364a58d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:56.879971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a13c-5451-4825-bce8-686c8364a58d service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.880422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a13c-5451-4825-bce8-686c8364a58d service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.880964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a13c-5451-4825-bce8-686c8364a58d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.883253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b413a13c-5451-4825-bce8-686c8364a58d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:56.972790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 871/1717] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:56 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:56.972957 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a13c-5451-4825-bce8-686c8364a58d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:56.973033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e73b3-61bb-44a4-93a3-067af93d2520 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:56.973113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a13c-5451-4825-bce8-686c8364a58d service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:56.984558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 847/1718] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:56.984762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e73b3-61bb-44a4-93a3-067af93d2520 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:56.986759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a13c-5451-4825-bce8-686c8364a58d service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:56.988211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b413a13c-5451-4825-bce8-686c8364a58d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:56.989396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb08f9-c78c-4bef-9af8-68b2463e8048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:56.990129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb08f9-c78c-4bef-9af8-68b2463e8048 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:56.990927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb08f9-c78c-4bef-9af8-68b2463e8048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:56.990927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb08f9-c78c-4bef-9af8-68b2463e8048 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:56.991467 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb08f9-c78c-4bef-9af8-68b2463e8048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:56.994532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb08f9-c78c-4bef-9af8-68b2463e8048 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.092788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 872/1719] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:56 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:57.094167 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb08f9-c78c-4bef-9af8-68b2463e8048 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:57.108679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb08f9-c78c-4bef-9af8-68b2463e8048 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.115532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f646c94-62c7-43a0-9556-e8eb7258ed59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.119523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f646c94-62c7-43a0-9556-e8eb7258ed59 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.119772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f646c94-62c7-43a0-9556-e8eb7258ed59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.120048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f646c94-62c7-43a0-9556-e8eb7258ed59 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.121122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f646c94-62c7-43a0-9556-e8eb7258ed59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.122094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a13c-5451-4825-bce8-686c8364a58d service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.123421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f646c94-62c7-43a0-9556-e8eb7258ed59 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.138791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced7825-34c8-4948-bea3-7ec4c8cfbffb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.140810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced7825-34c8-4948-bea3-7ec4c8cfbffb service placement] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.140810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced7825-34c8-4948-bea3-7ec4c8cfbffb service placement] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.140810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced7825-34c8-4948-bea3-7ec4c8cfbffb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.144250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4ced7825-34c8-4948-bea3-7ec4c8cfbffb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:57.170028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced7825-34c8-4948-bea3-7ec4c8cfbffb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.170028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced7825-34c8-4948-bea3-7ec4c8cfbffb service placement] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.184709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 848/1720] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:57.187965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced7825-34c8-4948-bea3-7ec4c8cfbffb service placement] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:57.200467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced7825-34c8-4948-bea3-7ec4c8cfbffb service placement] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.206477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f9d5c-5361-4f71-9c9a-111274b0736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.207718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f9d5c-5361-4f71-9c9a-111274b0736c admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.208460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f9d5c-5361-4f71-9c9a-111274b0736c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.209321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f9d5c-5361-4f71-9c9a-111274b0736c admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.210246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f9d5c-5361-4f71-9c9a-111274b0736c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.212209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f9d5c-5361-4f71-9c9a-111274b0736c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.229261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 849/1721] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:57.230419 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f9d5c-5361-4f71-9c9a-111274b0736c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:57.254321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f9d5c-5361-4f71-9c9a-111274b0736c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.268110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff06f8a-1caf-4863-ab22-11dd063a6844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.269171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff06f8a-1caf-4863-ab22-11dd063a6844 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.270070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff06f8a-1caf-4863-ab22-11dd063a6844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.270581 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff06f8a-1caf-4863-ab22-11dd063a6844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.271475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff06f8a-1caf-4863-ab22-11dd063a6844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.273001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 873/1722] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:57 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:57.273989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff06f8a-1caf-4863-ab22-11dd063a6844 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.282455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99556af-cbbf-4c31-9f24-3ca813e67a12 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.283697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99556af-cbbf-4c31-9f24-3ca813e67a12 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.284068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99556af-cbbf-4c31-9f24-3ca813e67a12 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.289306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 874/1723] 10.222.0.23 () {54 vars in 912 bytes} [Thu Sep 8 16:17:57 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:17:57.291854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 850/1724] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:57.292951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff06f8a-1caf-4863-ab22-11dd063a6844 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:57.294587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99556af-cbbf-4c31-9f24-3ca813e67a12 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:57.316543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff06f8a-1caf-4863-ab22-11dd063a6844 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.318576 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99556af-cbbf-4c31-9f24-3ca813e67a12 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.324510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1273663-48c3-4d08-9aa4-a2dad4dad5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.325151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273663-48c3-4d08-9aa4-a2dad4dad5ca admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.325549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273663-48c3-4d08-9aa4-a2dad4dad5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.325831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1273663-48c3-4d08-9aa4-a2dad4dad5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.326536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1273663-48c3-4d08-9aa4-a2dad4dad5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.328834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1273663-48c3-4d08-9aa4-a2dad4dad5ca admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.339501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ebb18-e76e-4b90-9231-59bc31176ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.340264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ebb18-e76e-4b90-9231-59bc31176ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.358799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ebb18-e76e-4b90-9231-59bc31176ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.363793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 875/1725] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:57.363793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7cb79-7957-4382-840d-919c6df7033a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.363793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7cb79-7957-4382-840d-919c6df7033a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.363793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7cb79-7957-4382-840d-919c6df7033a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.364103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ebb18-e76e-4b90-9231-59bc31176ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.364637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ebb18-e76e-4b90-9231-59bc31176ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.366558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ebb18-e76e-4b90-9231-59bc31176ebe admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.390501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d7f7cb79-7957-4382-840d-919c6df7033a None None] MFA Rules not processed for user `e08c9de660c04ed98f6100be2d687ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:57.392445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d7f7cb79-7957-4382-840d-919c6df7033a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:57.393553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 851/1726] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:57.397261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ebb18-e76e-4b90-9231-59bc31176ebe admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:57.424960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ebb18-e76e-4b90-9231-59bc31176ebe admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.435196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5dc16-db3c-4774-916f-24b040ba0fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.436038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5dc16-db3c-4774-916f-24b040ba0fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.437020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5dc16-db3c-4774-916f-24b040ba0fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.443752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5dc16-db3c-4774-916f-24b040ba0fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.443752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5dc16-db3c-4774-916f-24b040ba0fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.443752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5dc16-db3c-4774-916f-24b040ba0fa6 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.475324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 852/1727] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:57.476545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5dc16-db3c-4774-916f-24b040ba0fa6 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:57.507450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5dc16-db3c-4774-916f-24b040ba0fa6 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.521102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f442be-7424-488e-a9bc-2a8d580aae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.522702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f442be-7424-488e-a9bc-2a8d580aae60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.523627 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f442be-7424-488e-a9bc-2a8d580aae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.524168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f442be-7424-488e-a9bc-2a8d580aae60 admin admin] PATH_INFO: `/v3/projects/719d45dae7d541bbba91ee0aaaa54741/users/73c344359b834b9faa3cb779fd96bf4f/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.541605 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 876/1728] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:57.543409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7cb79-7957-4382-840d-919c6df7033a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:57.563223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f442be-7424-488e-a9bc-2a8d580aae60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719d45dae7d541bbba91ee0aaaa54741, user_id=73c344359b834b9faa3cb779fd96bf4f, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.571127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f442be-7424-488e-a9bc-2a8d580aae60 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.587289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7cb79-7957-4382-840d-919c6df7033a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.597751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f5e88-6717-40ed-956c-99f32245bc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.598465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f5e88-6717-40ed-956c-99f32245bc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.598775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f5e88-6717-40ed-956c-99f32245bc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.599198 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f5e88-6717-40ed-956c-99f32245bc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.599863 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f5e88-6717-40ed-956c-99f32245bc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.615330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f5e88-6717-40ed-956c-99f32245bc93 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.640679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 877/1729] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:57.641609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f5e88-6717-40ed-956c-99f32245bc93 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:57.659839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f5e88-6717-40ed-956c-99f32245bc93 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.671514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac108ef-1144-4f1b-9be8-8907f10b6d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.672474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac108ef-1144-4f1b-9be8-8907f10b6d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.672957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac108ef-1144-4f1b-9be8-8907f10b6d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.673405 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac108ef-1144-4f1b-9be8-8907f10b6d07 admin admin] PATH_INFO: `/v3/projects/37a02e7662304494b17d9f7f7aad7b4c/users/9e13263e10574e1d953545b6a06a4690/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.701400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 853/1730] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:57 2022] PUT /identity/v3/projects/719d45dae7d541bbba91ee0aaaa54741/users/73c344359b834b9faa3cb779fd96bf4f/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:57.702297 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f442be-7424-488e-a9bc-2a8d580aae60 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:57.713024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac108ef-1144-4f1b-9be8-8907f10b6d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a02e7662304494b17d9f7f7aad7b4c, user_id=9e13263e10574e1d953545b6a06a4690, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.713337 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-44f442be-7424-488e-a9bc-2a8d580aae60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:57.719190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac108ef-1144-4f1b-9be8-8907f10b6d07 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.822312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 878/1731] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:57 2022] PUT /identity/v3/projects/37a02e7662304494b17d9f7f7aad7b4c/users/9e13263e10574e1d953545b6a06a4690/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:57.823331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac108ef-1144-4f1b-9be8-8907f10b6d07 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:57.845138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f442be-7424-488e-a9bc-2a8d580aae60 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.916238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:57.935882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac108ef-1144-4f1b-9be8-8907f10b6d07 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:57.942427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b7a2b-b044-4cd1-a8f6-51346cbf44bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.943557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b7a2b-b044-4cd1-a8f6-51346cbf44bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.944016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b7a2b-b044-4cd1-a8f6-51346cbf44bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.944469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b7a2b-b044-4cd1-a8f6-51346cbf44bc admin admin] PATH_INFO: `/v3/projects/2ab789b5a75b4744bdba1890abfddb8a/users/7fb20944034440208cad5a7a80f20fa4/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.963881 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b7a2b-b044-4cd1-a8f6-51346cbf44bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab789b5a75b4744bdba1890abfddb8a, user_id=7fb20944034440208cad5a7a80f20fa4, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.967202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b7a2b-b044-4cd1-a8f6-51346cbf44bc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.979623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b31ca7-06fc-4b13-8be5-5ae91704ce5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:57.980254 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b31ca7-06fc-4b13-8be5-5ae91704ce5f service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.980541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b31ca7-06fc-4b13-8be5-5ae91704ce5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.980815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b31ca7-06fc-4b13-8be5-5ae91704ce5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:57.988475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b31ca7-06fc-4b13-8be5-5ae91704ce5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:57.989954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b31ca7-06fc-4b13-8be5-5ae91704ce5f service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:57.997878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 854/1732] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:57.999310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ed4ab-301c-47ec-8da3-baa82868597c None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:57.999616 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ed4ab-301c-47ec-8da3-baa82868597c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:57.999880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ed4ab-301c-47ec-8da3-baa82868597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:58.040320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-920ed4ab-301c-47ec-8da3-baa82868597c None None] MFA Rules not processed for user `73c344359b834b9faa3cb779fd96bf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:58.041586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-920ed4ab-301c-47ec-8da3-baa82868597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:58.071177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 879/1733] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:57 2022] PUT /identity/v3/projects/2ab789b5a75b4744bdba1890abfddb8a/users/7fb20944034440208cad5a7a80f20fa4/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:58.073232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae915-c76f-49d2-a26f-429b5263a22e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:58.073736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae915-c76f-49d2-a26f-429b5263a22e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:58.074170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae915-c76f-49d2-a26f-429b5263a22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:58.123852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 855/1734] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:58.127660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2b3f9-92ec-490d-91e3-fe020a23eee4 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:58.127660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2b3f9-92ec-490d-91e3-fe020a23eee4 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:58.127660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2b3f9-92ec-490d-91e3-fe020a23eee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:58.138804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cceae915-c76f-49d2-a26f-429b5263a22e None None] MFA Rules not processed for user `9e13263e10574e1d953545b6a06a4690`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:58.140571 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cceae915-c76f-49d2-a26f-429b5263a22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:58.189469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b9a2b3f9-92ec-490d-91e3-fe020a23eee4 None None] MFA Rules not processed for user `7fb20944034440208cad5a7a80f20fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:17:58.190778 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b9a2b3f9-92ec-490d-91e3-fe020a23eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:17:58.314784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 880/1735] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:58.322107 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceae915-c76f-49d2-a26f-429b5263a22e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:58.379189 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 856/1736] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:17:58.380320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2b3f9-92ec-490d-91e3-fe020a23eee4 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:58.434019 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:58.548034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2b3f9-92ec-490d-91e3-fe020a23eee4 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:58.574908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f320ce6-fd41-48e6-ad10-7453a7b2cda2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:58.586986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f320ce6-fd41-48e6-ad10-7453a7b2cda2 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:58.587270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f320ce6-fd41-48e6-ad10-7453a7b2cda2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:58.587545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f320ce6-fd41-48e6-ad10-7453a7b2cda2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:58.646467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f320ce6-fd41-48e6-ad10-7453a7b2cda2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:58.647954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f320ce6-fd41-48e6-ad10-7453a7b2cda2 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:58.675698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceae915-c76f-49d2-a26f-429b5263a22e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:58.691279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 857/1737] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:17:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:17:58.712017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f7dbc-a850-486c-9f91-9d4d00324498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:58.713775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f320ce6-fd41-48e6-ad10-7453a7b2cda2 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:58.717497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f7dbc-a850-486c-9f91-9d4d00324498 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:58.718189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f7dbc-a850-486c-9f91-9d4d00324498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:58.718189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f7dbc-a850-486c-9f91-9d4d00324498 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:58.719016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f7dbc-a850-486c-9f91-9d4d00324498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:58.725429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f7dbc-a850-486c-9f91-9d4d00324498 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:58.752102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f320ce6-fd41-48e6-ad10-7453a7b2cda2 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:58.774113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f10922-f5a5-4fbe-9edb-1c7a4dff5f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:58.775421 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f10922-f5a5-4fbe-9edb-1c7a4dff5f71 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:58.775702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f10922-f5a5-4fbe-9edb-1c7a4dff5f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:58.775975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f10922-f5a5-4fbe-9edb-1c7a4dff5f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:58.776626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f10922-f5a5-4fbe-9edb-1c7a4dff5f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:58.779765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f10922-f5a5-4fbe-9edb-1c7a4dff5f71 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:58.883392 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 881/1738] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:58 2022] POST /identity/v3/projects => generated 377 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:58.888393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f7dbc-a850-486c-9f91-9d4d00324498 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:59.000615 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 858/1739] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:17:58 2022] POST /identity/v3/projects => generated 393 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:59.001827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f10922-f5a5-4fbe-9edb-1c7a4dff5f71 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:59.105036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f7dbc-a850-486c-9f91-9d4d00324498 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:59.231733 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2874b01-8337-458e-afdf-dfc8baf6fd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:59.232367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2874b01-8337-458e-afdf-dfc8baf6fd48 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:59.232631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2874b01-8337-458e-afdf-dfc8baf6fd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:59.232908 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2874b01-8337-458e-afdf-dfc8baf6fd48 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:59.236903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2874b01-8337-458e-afdf-dfc8baf6fd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:59.241369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2874b01-8337-458e-afdf-dfc8baf6fd48 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:59.266041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f10922-f5a5-4fbe-9edb-1c7a4dff5f71 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:59.305446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa8c1f-58e3-464d-a45a-57cc1149625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:59.306600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8c1f-58e3-464d-a45a-57cc1149625c admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:59.316967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8c1f-58e3-464d-a45a-57cc1149625c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:59.316967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa8c1f-58e3-464d-a45a-57cc1149625c admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:59.316967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa8c1f-58e3-464d-a45a-57cc1149625c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:59.319760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa8c1f-58e3-464d-a45a-57cc1149625c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:59.379089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 882/1740] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:58 2022] POST /identity/v3/users => generated 295 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:59.382713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2874b01-8337-458e-afdf-dfc8baf6fd48 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:59.413919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2874b01-8337-458e-afdf-dfc8baf6fd48 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:59.442050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b443a-5d80-465a-864f-15da1b9c9795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:59.442050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b443a-5d80-465a-864f-15da1b9c9795 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:59.442050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b443a-5d80-465a-864f-15da1b9c9795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:59.442050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b443a-5d80-465a-864f-15da1b9c9795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:59.442546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b443a-5d80-465a-864f-15da1b9c9795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:59.454704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b443a-5d80-465a-864f-15da1b9c9795 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:59.484715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 859/1741] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:17:59 2022] POST /identity/v3/users => generated 303 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:17:59.486216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa8c1f-58e3-464d-a45a-57cc1149625c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:59.488345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 883/1742] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:17:59.491676 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b443a-5d80-465a-864f-15da1b9c9795 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:59.512451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b443a-5d80-465a-864f-15da1b9c9795 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:59.513096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa8c1f-58e3-464d-a45a-57cc1149625c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:59.518812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b9b6-91b5-4d5d-9f3c-cfabf35862c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:59.519796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b9b6-91b5-4d5d-9f3c-cfabf35862c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:59.520223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b9b6-91b5-4d5d-9f3c-cfabf35862c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:59.520642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b9b6-91b5-4d5d-9f3c-cfabf35862c2 admin admin] PATH_INFO: `/v3/projects/b745a9f3e44d4050b33fd8dfccbb139a/users/af95bf8e77b4417d9313d5b47920e989/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:59.522446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898d378-0032-4b7f-9119-ea4bf9db8b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:59.523572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d378-0032-4b7f-9119-ea4bf9db8b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:59.523952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d378-0032-4b7f-9119-ea4bf9db8b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:59.524452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898d378-0032-4b7f-9119-ea4bf9db8b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:59.526397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898d378-0032-4b7f-9119-ea4bf9db8b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:59.528876 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898d378-0032-4b7f-9119-ea4bf9db8b8e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:59.543449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b9b6-91b5-4d5d-9f3c-cfabf35862c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b745a9f3e44d4050b33fd8dfccbb139a, user_id=af95bf8e77b4417d9313d5b47920e989, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:59.546497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b9b6-91b5-4d5d-9f3c-cfabf35862c2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:59.549702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 860/1743] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:59.562498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898d378-0032-4b7f-9119-ea4bf9db8b8e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:59.578091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898d378-0032-4b7f-9119-ea4bf9db8b8e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:59.587048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42cc31-30ec-409d-8b7f-eb403ba3343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:59.588120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42cc31-30ec-409d-8b7f-eb403ba3343b admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:59.588498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42cc31-30ec-409d-8b7f-eb403ba3343b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:59.588953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42cc31-30ec-409d-8b7f-eb403ba3343b admin admin] PATH_INFO: `/v3/projects/0ef3268d059a4744b02cbd34fb78400d/users/7a6cd6c0570a47ed9feac99f498b1098/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:59.621267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42cc31-30ec-409d-8b7f-eb403ba3343b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef3268d059a4744b02cbd34fb78400d, user_id=7a6cd6c0570a47ed9feac99f498b1098, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:59.625558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42cc31-30ec-409d-8b7f-eb403ba3343b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:59.656740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 884/1744] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:59 2022] PUT /identity/v3/projects/b745a9f3e44d4050b33fd8dfccbb139a/users/af95bf8e77b4417d9313d5b47920e989/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:17:59.660973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b9b6-91b5-4d5d-9f3c-cfabf35862c2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:59.744361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 861/1745] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:59 2022] PUT /identity/v3/projects/0ef3268d059a4744b02cbd34fb78400d/users/7a6cd6c0570a47ed9feac99f498b1098/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:17:59.747224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42cc31-30ec-409d-8b7f-eb403ba3343b admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:59.881705 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b9b6-91b5-4d5d-9f3c-cfabf35862c2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:59.907483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac1fe1-30e3-4217-bd32-075f527aff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:59.907483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac1fe1-30e3-4217-bd32-075f527aff28 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:59.907483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac1fe1-30e3-4217-bd32-075f527aff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:59.909062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac1fe1-30e3-4217-bd32-075f527aff28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:59.910591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac1fe1-30e3-4217-bd32-075f527aff28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:59.914816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac1fe1-30e3-4217-bd32-075f527aff28 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:59.915905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42cc31-30ec-409d-8b7f-eb403ba3343b admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:17:59.921257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:59.930155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff28578-a4e9-4501-ace8-ada20e85f36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:17:59.930805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff28578-a4e9-4501-ace8-ada20e85f36c admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:17:59.931196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff28578-a4e9-4501-ace8-ada20e85f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:17:59.931628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff28578-a4e9-4501-ace8-ada20e85f36c admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:17:59.932401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff28578-a4e9-4501-ace8-ada20e85f36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:17:59.941356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff28578-a4e9-4501-ace8-ada20e85f36c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:17:59.941535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 885/1746] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:59.942774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac1fe1-30e3-4217-bd32-075f527aff28 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:59.999065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 862/1747] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:17:59.999065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff28578-a4e9-4501-ace8-ada20e85f36c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:17:59.999438 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac1fe1-30e3-4217-bd32-075f527aff28 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:00.016438 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460da60-2bfb-4b43-823c-8ab66c97fc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:00.017147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460da60-2bfb-4b43-823c-8ab66c97fc1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:00.020163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460da60-2bfb-4b43-823c-8ab66c97fc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:00.020478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460da60-2bfb-4b43-823c-8ab66c97fc1c admin admin] PATH_INFO: `/v3/projects/b745a9f3e44d4050b33fd8dfccbb139a/users/af95bf8e77b4417d9313d5b47920e989/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:00.024273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460da60-2bfb-4b43-823c-8ab66c97fc1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b745a9f3e44d4050b33fd8dfccbb139a, user_id=af95bf8e77b4417d9313d5b47920e989, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:00.027986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460da60-2bfb-4b43-823c-8ab66c97fc1c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:00.030539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff28578-a4e9-4501-ace8-ada20e85f36c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:00.042256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5f798-c869-406d-bf57-dcf9d0d6224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:00.044226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f798-c869-406d-bf57-dcf9d0d6224d admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:00.044590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f798-c869-406d-bf57-dcf9d0d6224d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:00.045999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f798-c869-406d-bf57-dcf9d0d6224d admin admin] PATH_INFO: `/v3/projects/0ef3268d059a4744b02cbd34fb78400d/users/7a6cd6c0570a47ed9feac99f498b1098/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:00.051254 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f798-c869-406d-bf57-dcf9d0d6224d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef3268d059a4744b02cbd34fb78400d, user_id=7a6cd6c0570a47ed9feac99f498b1098, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:00.064602 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 886/1748] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:59 2022] PUT /identity/v3/projects/b745a9f3e44d4050b33fd8dfccbb139a/users/af95bf8e77b4417d9313d5b47920e989/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:00.073939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f798-c869-406d-bf57-dcf9d0d6224d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:00.079774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ab95-0a39-4381-9d5e-a7577b4113b1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:00.080919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ab95-0a39-4381-9d5e-a7577b4113b1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:00.083412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ab95-0a39-4381-9d5e-a7577b4113b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:00.107255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 863/1749] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:17:59 2022] PUT /identity/v3/projects/0ef3268d059a4744b02cbd34fb78400d/users/7a6cd6c0570a47ed9feac99f498b1098/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:00.111364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309006-5435-4b82-aa36-659fa8998e67 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:00.111657 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309006-5435-4b82-aa36-659fa8998e67 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:00.111941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309006-5435-4b82-aa36-659fa8998e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:00.154523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d2d4ab95-0a39-4381-9d5e-a7577b4113b1 None None] MFA Rules not processed for user `af95bf8e77b4417d9313d5b47920e989`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:00.158524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d2d4ab95-0a39-4381-9d5e-a7577b4113b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:00.182165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-46309006-5435-4b82-aa36-659fa8998e67 None None] MFA Rules not processed for user `d235e94611884b28b85b637ac54204f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:00.183554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-46309006-5435-4b82-aa36-659fa8998e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:00.330805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 887/1750] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:00.336737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b951bda-3b16-4371-ae80-20b97bd188bb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:00.336937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b951bda-3b16-4371-ae80-20b97bd188bb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:00.337354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b951bda-3b16-4371-ae80-20b97bd188bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:00.398339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4b951bda-3b16-4371-ae80-20b97bd188bb None None] MFA Rules not processed for user `7a6cd6c0570a47ed9feac99f498b1098`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:00.399892 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4b951bda-3b16-4371-ae80-20b97bd188bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:00.444997 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:00.458490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 864/1751] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:00.464959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46309006-5435-4b82-aa36-659fa8998e67 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:00.598694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46309006-5435-4b82-aa36-659fa8998e67 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:00.606096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b11def-35c0-4ba0-987a-aa854c2eb78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:00.607051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11def-35c0-4ba0-987a-aa854c2eb78a service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:00.609062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11def-35c0-4ba0-987a-aa854c2eb78a service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:00.613504 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11def-35c0-4ba0-987a-aa854c2eb78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:00.678474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 888/1752] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:00.693508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b951bda-3b16-4371-ae80-20b97bd188bb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:00.695185 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4b951bda-3b16-4371-ae80-20b97bd188bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:00.716755 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b951bda-3b16-4371-ae80-20b97bd188bb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:00.731460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477de190-8139-47bd-bec7-ab2dd08a5e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:00.732367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de190-8139-47bd-bec7-ab2dd08a5e1b service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:00.732883 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de190-8139-47bd-bec7-ab2dd08a5e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:00.733985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477de190-8139-47bd-bec7-ab2dd08a5e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:00.758398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477de190-8139-47bd-bec7-ab2dd08a5e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:00.763564 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477de190-8139-47bd-bec7-ab2dd08a5e1b service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:00.800561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b11def-35c0-4ba0-987a-aa854c2eb78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:00.802241 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b11def-35c0-4ba0-987a-aa854c2eb78a service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:00.821287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 889/1753] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:00 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:00.869269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 865/1754] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:00.984680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477de190-8139-47bd-bec7-ab2dd08a5e1b service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:01.005593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477de190-8139-47bd-bec7-ab2dd08a5e1b service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:01.022260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481f051-abf4-412a-8d1a-b7375fb8d56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:01.022933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f051-abf4-412a-8d1a-b7375fb8d56b service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:01.023216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f051-abf4-412a-8d1a-b7375fb8d56b service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:01.023494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481f051-abf4-412a-8d1a-b7375fb8d56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:01.068378 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657c0f8-5d1b-4fe1-98c1-bef5dc6efdff None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:01.068788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657c0f8-5d1b-4fe1-98c1-bef5dc6efdff None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:01.069136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657c0f8-5d1b-4fe1-98c1-bef5dc6efdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:01.090690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-5657c0f8-5d1b-4fe1-98c1-bef5dc6efdff None None] MFA Rules not processed for user `ce39c87aac4e4df79efc1f80a07b3273`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:01.092016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5657c0f8-5d1b-4fe1-98c1-bef5dc6efdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:01.104719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481f051-abf4-412a-8d1a-b7375fb8d56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:01.106218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481f051-abf4-412a-8d1a-b7375fb8d56b service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:01.116058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 890/1755] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:01.183088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 866/1756] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:01.490284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:03.058999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf229e-a05d-435a-a49c-a8a3f12a5916 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:03.059580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf229e-a05d-435a-a49c-a8a3f12a5916 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:03.059580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf229e-a05d-435a-a49c-a8a3f12a5916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:03.170102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:03.291041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-31bf229e-a05d-435a-a49c-a8a3f12a5916 None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:03.299215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-31bf229e-a05d-435a-a49c-a8a3f12a5916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:03.645434 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 891/1757] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:18:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 587 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:03.675203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:04.089446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657c0f8-5d1b-4fe1-98c1-bef5dc6efdff None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:04.091313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5657c0f8-5d1b-4fe1-98c1-bef5dc6efdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:04.349217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657c0f8-5d1b-4fe1-98c1-bef5dc6efdff None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:04.371700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a61ce8-6fd1-42fb-bde6-bca563617aeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:04.374136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a61ce8-6fd1-42fb-bde6-bca563617aeb service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:04.376471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a61ce8-6fd1-42fb-bde6-bca563617aeb service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:04.376919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a61ce8-6fd1-42fb-bde6-bca563617aeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:04.455849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a61ce8-6fd1-42fb-bde6-bca563617aeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:04.457658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a61ce8-6fd1-42fb-bde6-bca563617aeb service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:04.490608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 867/1758] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:18:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:18:05.273890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944c4b5-5109-4006-858f-d5c464bc90ea None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:05.274404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944c4b5-5109-4006-858f-d5c464bc90ea None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:05.274920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944c4b5-5109-4006-858f-d5c464bc90ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:05.399548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4944c4b5-5109-4006-858f-d5c464bc90ea None None] MFA Rules not processed for user `e08c9de660c04ed98f6100be2d687ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:05.400826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4944c4b5-5109-4006-858f-d5c464bc90ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:05.537034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:05.594487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 892/1759] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Sep 8 16:18:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:05.689688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a61ce8-6fd1-42fb-bde6-bca563617aeb service swift] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:05.716824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a61ce8-6fd1-42fb-bde6-bca563617aeb service swift] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:05.733254 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31de5a-c8a2-4202-b8e2-17c822c1e420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:05.735685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31de5a-c8a2-4202-b8e2-17c822c1e420 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:05.737893 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31de5a-c8a2-4202-b8e2-17c822c1e420 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:05.741404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31de5a-c8a2-4202-b8e2-17c822c1e420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:05.773100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31de5a-c8a2-4202-b8e2-17c822c1e420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:05.777260 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31de5a-c8a2-4202-b8e2-17c822c1e420 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:05.805613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 868/1760] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:06.395130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:07.101996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944c4b5-5109-4006-858f-d5c464bc90ea None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:07.114970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944c4b5-5109-4006-858f-d5c464bc90ea None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:07.122328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24072f18-3b3f-4ad8-8775-deeca712c413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:07.123505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24072f18-3b3f-4ad8-8775-deeca712c413 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:07.125828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24072f18-3b3f-4ad8-8775-deeca712c413 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:07.127203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24072f18-3b3f-4ad8-8775-deeca712c413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:07.146949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24072f18-3b3f-4ad8-8775-deeca712c413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:07.151251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24072f18-3b3f-4ad8-8775-deeca712c413 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:07.168077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 893/1761] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:08.077355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:08.937411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:10.266131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:10.648038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:10.690049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31de5a-c8a2-4202-b8e2-17c822c1e420 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:10.833211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31de5a-c8a2-4202-b8e2-17c822c1e420 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:10.878253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a44963-7c38-44db-be2a-2af104ff4e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:10.879086 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a44963-7c38-44db-be2a-2af104ff4e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:10.879478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a44963-7c38-44db-be2a-2af104ff4e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:10.881035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a44963-7c38-44db-be2a-2af104ff4e25 admin admin] PATH_INFO: `/v3/users/7fb20944034440208cad5a7a80f20fa4` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:10.889410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a44963-7c38-44db-be2a-2af104ff4e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb20944034440208cad5a7a80f20fa4)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:10.896814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a44963-7c38-44db-be2a-2af104ff4e25 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:10.913421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e88319-73f9-42bc-8935-0e4754b64dfb None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:10.913734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e88319-73f9-42bc-8935-0e4754b64dfb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:10.914009 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e88319-73f9-42bc-8935-0e4754b64dfb None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:10.918032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 894/1762] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:18:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:18:10.925716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435266f3-d5fc-43a3-80bf-36dcdee6f57c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:10.926290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435266f3-d5fc-43a3-80bf-36dcdee6f57c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:10.926742 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435266f3-d5fc-43a3-80bf-36dcdee6f57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:10.968265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-435266f3-d5fc-43a3-80bf-36dcdee6f57c None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:10.969684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-435266f3-d5fc-43a3-80bf-36dcdee6f57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:11.136693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 895/1763] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:18:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:11.136693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f871c4-4cc0-4e0d-b15b-fc0a45aed4e4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:11.136693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f871c4-4cc0-4e0d-b15b-fc0a45aed4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:11.136693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f871c4-4cc0-4e0d-b15b-fc0a45aed4e4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:11.136693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 896/1764] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:18:11.147283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-60a44963-7c38-44db-be2a-2af104ff4e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb20944034440208cad5a7a80f20fa4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:11.148413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-60a44963-7c38-44db-be2a-2af104ff4e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb20944034440208cad5a7a80f20fa4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:11.209123 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372b02-a4ea-477f-a026-811e9ed23a5c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:11.209590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372b02-a4ea-477f-a026-811e9ed23a5c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:11.209712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372b02-a4ea-477f-a026-811e9ed23a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:11.248813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-60a44963-7c38-44db-be2a-2af104ff4e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb20944034440208cad5a7a80f20fa4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:11.249810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-60a44963-7c38-44db-be2a-2af104ff4e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb20944034440208cad5a7a80f20fa4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:11.280569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-60a44963-7c38-44db-be2a-2af104ff4e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb20944034440208cad5a7a80f20fa4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:11.310029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8f372b02-a4ea-477f-a026-811e9ed23a5c None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:11.315205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8f372b02-a4ea-477f-a026-811e9ed23a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:11.334857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 869/1765] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:10 2022] DELETE /identity/v3/users/7fb20944034440208cad5a7a80f20fa4 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:11.336803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851465f-7429-4e8a-b658-eef0fc80d672 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:11.337228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851465f-7429-4e8a-b658-eef0fc80d672 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:11.337600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851465f-7429-4e8a-b658-eef0fc80d672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:11.368069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 897/1766] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:11.412577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-9851465f-7429-4e8a-b658-eef0fc80d672 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:11.414446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9851465f-7429-4e8a-b658-eef0fc80d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:11.560318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 870/1767] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:11.632935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f372b02-a4ea-477f-a026-811e9ed23a5c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:11.634863 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8f372b02-a4ea-477f-a026-811e9ed23a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:11.648260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f372b02-a4ea-477f-a026-811e9ed23a5c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:11.777734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851465f-7429-4e8a-b658-eef0fc80d672 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:11.780580 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9851465f-7429-4e8a-b658-eef0fc80d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:11.787237 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e09be-f39c-4985-9d4a-f4ee32c89ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:11.791229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e09be-f39c-4985-9d4a-f4ee32c89ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:11.791229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e09be-f39c-4985-9d4a-f4ee32c89ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:11.791229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e09be-f39c-4985-9d4a-f4ee32c89ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:11.803607 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e09be-f39c-4985-9d4a-f4ee32c89ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:11.805297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e09be-f39c-4985-9d4a-f4ee32c89ec8 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:11.820634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 898/1768] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:11.900091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:11.925164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851465f-7429-4e8a-b658-eef0fc80d672 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:11.955822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1632f7b-a9e0-4e19-825a-eb60fb013895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:11.956717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1632f7b-a9e0-4e19-825a-eb60fb013895 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:11.957076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1632f7b-a9e0-4e19-825a-eb60fb013895 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:11.957423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1632f7b-a9e0-4e19-825a-eb60fb013895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:11.959618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f1632f7b-a9e0-4e19-825a-eb60fb013895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:11.979708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1632f7b-a9e0-4e19-825a-eb60fb013895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:11.982099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1632f7b-a9e0-4e19-825a-eb60fb013895 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:11.999672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 871/1769] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:12.021903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e09be-f39c-4985-9d4a-f4ee32c89ec8 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:12.024221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0e2e09be-f39c-4985-9d4a-f4ee32c89ec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:12.046225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e09be-f39c-4985-9d4a-f4ee32c89ec8 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:12.063164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:12.063879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:12.064159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:12.064430 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] PATH_INFO: `/v3/users/9dc59ea917b84184951d652fc43ed9d5` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:12.070203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc59ea917b84184951d652fc43ed9d5)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:12.072360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:12.212106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1632f7b-a9e0-4e19-825a-eb60fb013895 service nova] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:12.224855 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1632f7b-a9e0-4e19-825a-eb60fb013895 service nova] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:12.244342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbe78d-636f-44fa-9177-bb31c4655600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:12.244342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbe78d-636f-44fa-9177-bb31c4655600 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:12.244342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbe78d-636f-44fa-9177-bb31c4655600 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:12.244342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbe78d-636f-44fa-9177-bb31c4655600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:12.265794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbe78d-636f-44fa-9177-bb31c4655600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:12.274136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbe78d-636f-44fa-9177-bb31c4655600 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:12.297569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 872/1770] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:12.329599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:12.391055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc59ea917b84184951d652fc43ed9d5'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:12.392094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc59ea917b84184951d652fc43ed9d5'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:12.637194 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc59ea917b84184951d652fc43ed9d5'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:12.658621 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc59ea917b84184951d652fc43ed9d5'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:12.658621 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc59ea917b84184951d652fc43ed9d5'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:12.671808 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 899/1771] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:12 2022] DELETE /identity/v3/users/9dc59ea917b84184951d652fc43ed9d5 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:12.677762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc6bf-042d-4866-a757-4a81d5ec308e None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:12.678688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc6bf-042d-4866-a757-4a81d5ec308e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:12.679259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc6bf-042d-4866-a757-4a81d5ec308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:12.718800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-81ccc6bf-042d-4866-a757-4a81d5ec308e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:12.720153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-81ccc6bf-042d-4866-a757-4a81d5ec308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:12.943983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 873/1772] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:12.963583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:12.969965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:13.125289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86613c36-c3a3-4d41-95b3-0fa51579034f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:13.133295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346392d-d28e-43c4-b337-b0eecb8891eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:13.138182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346392d-d28e-43c4-b337-b0eecb8891eb service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:13.138182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346392d-d28e-43c4-b337-b0eecb8891eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:13.138182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346392d-d28e-43c4-b337-b0eecb8891eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:13.150052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346392d-d28e-43c4-b337-b0eecb8891eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:13.152959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346392d-d28e-43c4-b337-b0eecb8891eb service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:13.175107 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 900/1773] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:13.676018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:14.293009 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:14.938512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc6bf-042d-4866-a757-4a81d5ec308e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:14.940679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-81ccc6bf-042d-4866-a757-4a81d5ec308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:14.944709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346392d-d28e-43c4-b337-b0eecb8891eb service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:14.946435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a346392d-d28e-43c4-b337-b0eecb8891eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:14.964704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc6bf-042d-4866-a757-4a81d5ec308e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:14.970837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:14.971043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346392d-d28e-43c4-b337-b0eecb8891eb service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:14.972250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:14.972717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:14.973390 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] PATH_INFO: `/v3/projects/2ab789b5a75b4744bdba1890abfddb8a` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:14.975887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab789b5a75b4744bdba1890abfddb8a)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:14.976732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:14.977628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:14.978116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:14.978712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] PATH_INFO: `/v3/projects/362069d0a430431a9db21c279762c4fc` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:14.979610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:14.980395 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] RBAC: Authorizing `identity:delete_project(project_id=362069d0a430431a9db21c279762c4fc)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:14.983165 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:15.149580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362069d0a430431a9db21c279762c4fc', 'request_id': 'req-0e69f361-8a56-4075-a058-934eeab8578f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:15.160519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362069d0a430431a9db21c279762c4fc', 'request_id': 'req-0e69f361-8a56-4075-a058-934eeab8578f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:15.172351 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362069d0a430431a9db21c279762c4fc', 'request_id': 'req-0e69f361-8a56-4075-a058-934eeab8578f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:15.173428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab789b5a75b4744bdba1890abfddb8a', 'request_id': 'req-4a1491b5-fdac-40c1-94ac-451e736e38c7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:15.182942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab789b5a75b4744bdba1890abfddb8a', 'request_id': 'req-4a1491b5-fdac-40c1-94ac-451e736e38c7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:15.193077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab789b5a75b4744bdba1890abfddb8a', 'request_id': 'req-4a1491b5-fdac-40c1-94ac-451e736e38c7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:15.291642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] The token cache is being invalidate because project 362069d0a430431a9db21c279762c4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:15.302064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:15.302064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:15.302064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 901/1774] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:14 2022] DELETE /identity/v3/projects/362069d0a430431a9db21c279762c4fc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:15.302064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:15.302064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:15.368168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] The token cache is being invalidate because project 2ab789b5a75b4744bdba1890abfddb8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:15.373007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:15.373007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:15.377845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 874/1775] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:14 2022] DELETE /identity/v3/projects/2ab789b5a75b4744bdba1890abfddb8a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:15.381313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:15.390064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:15.495902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69f361-8a56-4075-a058-934eeab8578f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:15.533177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1491b5-fdac-40c1-94ac-451e736e38c7 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:15.541748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:15.543634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:15.549136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:15.549136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] PATH_INFO: `/v3/users/7a6cd6c0570a47ed9feac99f498b1098` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:15.549136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a6cd6c0570a47ed9feac99f498b1098)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:15.549136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:15.680841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:15.681952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:15.682401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:15.682703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] PATH_INFO: `/v3/users/9b34bfce433a400f9e0def56dc27ac8b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:15.691513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b34bfce433a400f9e0def56dc27ac8b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:15.696670 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:15.863826 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a6cd6c0570a47ed9feac99f498b1098'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:15.880061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a6cd6c0570a47ed9feac99f498b1098'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:16.010498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b34bfce433a400f9e0def56dc27ac8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:16.010498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b34bfce433a400f9e0def56dc27ac8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:16.015298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a6cd6c0570a47ed9feac99f498b1098'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:16.016427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a6cd6c0570a47ed9feac99f498b1098'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:16.029626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a6cd6c0570a47ed9feac99f498b1098'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:16.062207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b34bfce433a400f9e0def56dc27ac8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:16.062925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b34bfce433a400f9e0def56dc27ac8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:16.067222 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 875/1776] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:15 2022] DELETE /identity/v3/users/7a6cd6c0570a47ed9feac99f498b1098 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:16.085368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b34bfce433a400f9e0def56dc27ac8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:16.121552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 902/1777] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:15 2022] DELETE /identity/v3/users/9b34bfce433a400f9e0def56dc27ac8b => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:16.187162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:16.823003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:16.824582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:16.998897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:17.024233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dd68d-37f4-4ce9-a341-80aebe20d797 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:17.164060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:17.164863 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:17.165150 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:17.165466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] PATH_INFO: `/v3/projects/2ea156a84a2b47ce9d5134f3148ef6eb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:17.167901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea156a84a2b47ce9d5134f3148ef6eb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:17.170872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:17.273757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:17.275684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:17.301398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321596ed-1258-4955-b696-a7b79fbbd4ea admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:17.315282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8745000-2050-490b-93e2-83f59b4cc924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:17.317199 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8745000-2050-490b-93e2-83f59b4cc924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:17.317700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8745000-2050-490b-93e2-83f59b4cc924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:17.318179 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8745000-2050-490b-93e2-83f59b4cc924 admin admin] PATH_INFO: `/v3/users/9e13263e10574e1d953545b6a06a4690` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:17.319662 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8745000-2050-490b-93e2-83f59b4cc924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e13263e10574e1d953545b6a06a4690)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:17.321875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8745000-2050-490b-93e2-83f59b4cc924 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:17.341768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea156a84a2b47ce9d5134f3148ef6eb', 'request_id': 'req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:17.362192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea156a84a2b47ce9d5134f3148ef6eb', 'request_id': 'req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:17.379695 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea156a84a2b47ce9d5134f3148ef6eb', 'request_id': 'req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:17.507191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] The token cache is being invalidate because project 2ea156a84a2b47ce9d5134f3148ef6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:17.507429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:17.513106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4223e60e-c9ce-4885-8b19-bac9e3de1cd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:17.516447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 876/1778] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:16 2022] DELETE /identity/v3/projects/2ea156a84a2b47ce9d5134f3148ef6eb => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:17.520977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4356205-e342-4f6a-b135-1be9513d0d49 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:17.521260 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4356205-e342-4f6a-b135-1be9513d0d49 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:17.521779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4356205-e342-4f6a-b135-1be9513d0d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:17.548119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-e4356205-e342-4f6a-b135-1be9513d0d49 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:17.549780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e4356205-e342-4f6a-b135-1be9513d0d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:17.586110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e8745000-2050-490b-93e2-83f59b4cc924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e13263e10574e1d953545b6a06a4690'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:17.586826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e8745000-2050-490b-93e2-83f59b4cc924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e13263e10574e1d953545b6a06a4690'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:17.624149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 877/1779] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:17.632221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e099a-18dc-43d0-9c82-4db409da8e2b None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:17.632567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e099a-18dc-43d0-9c82-4db409da8e2b None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:17.632857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e099a-18dc-43d0-9c82-4db409da8e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:17.657760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-874e099a-18dc-43d0-9c82-4db409da8e2b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:17.658993 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-874e099a-18dc-43d0-9c82-4db409da8e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:17.667047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 878/1780] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:17.671661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e099a-18dc-43d0-9c82-4db409da8e2b None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:17.680681 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e099a-18dc-43d0-9c82-4db409da8e2b None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:17.686049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24344f-59e7-44c1-9a6f-9533dccdcb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:17.686756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24344f-59e7-44c1-9a6f-9533dccdcb45 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:17.687090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24344f-59e7-44c1-9a6f-9533dccdcb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:17.687363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24344f-59e7-44c1-9a6f-9533dccdcb45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:17.687995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24344f-59e7-44c1-9a6f-9533dccdcb45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:17.688294 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24344f-59e7-44c1-9a6f-9533dccdcb45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:17.689880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24344f-59e7-44c1-9a6f-9533dccdcb45 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:17.701195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 879/1781] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:18:17.704891 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e8745000-2050-490b-93e2-83f59b4cc924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e13263e10574e1d953545b6a06a4690'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:17.705533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e8745000-2050-490b-93e2-83f59b4cc924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e13263e10574e1d953545b6a06a4690'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:17.705645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24344f-59e7-44c1-9a6f-9533dccdcb45 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:17.707262 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9c24344f-59e7-44c1-9a6f-9533dccdcb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:17.712857 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e8745000-2050-490b-93e2-83f59b4cc924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e13263e10574e1d953545b6a06a4690'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:17.720441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24344f-59e7-44c1-9a6f-9533dccdcb45 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:17.725226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97767187-3dbe-4b0d-bd4c-bfcab03abfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:17.725825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97767187-3dbe-4b0d-bd4c-bfcab03abfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:17.726103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97767187-3dbe-4b0d-bd4c-bfcab03abfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:17.726379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97767187-3dbe-4b0d-bd4c-bfcab03abfe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:17.727137 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97767187-3dbe-4b0d-bd4c-bfcab03abfe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:17.729042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97767187-3dbe-4b0d-bd4c-bfcab03abfe8 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:17.731572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 903/1782] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:17 2022] DELETE /identity/v3/users/9e13263e10574e1d953545b6a06a4690 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:17.747404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49044e-6ac8-4099-9c34-b050616b0e27 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:17.747727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49044e-6ac8-4099-9c34-b050616b0e27 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:17.748013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49044e-6ac8-4099-9c34-b050616b0e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:17.787038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0b49044e-6ac8-4099-9c34-b050616b0e27 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:17.788439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0b49044e-6ac8-4099-9c34-b050616b0e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:17.824980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:17.848519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 904/1783] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:17.849381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49044e-6ac8-4099-9c34-b050616b0e27 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:17.850698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0b49044e-6ac8-4099-9c34-b050616b0e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:17.864983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 880/1784] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:17 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:17.864983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97767187-3dbe-4b0d-bd4c-bfcab03abfe8 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:17.865244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49044e-6ac8-4099-9c34-b050616b0e27 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:17.866445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-97767187-3dbe-4b0d-bd4c-bfcab03abfe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:17.928510 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97767187-3dbe-4b0d-bd4c-bfcab03abfe8 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:17.929034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:17.929749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:17.930093 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:17.930419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] PATH_INFO: `/v3/projects/0ef3268d059a4744b02cbd34fb78400d` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:17.931620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef3268d059a4744b02cbd34fb78400d)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:17.932466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022eee3-bb61-4d03-a126-489c1769863c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:17.933071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022eee3-bb61-4d03-a126-489c1769863c service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:17.933353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022eee3-bb61-4d03-a126-489c1769863c service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:17.933626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022eee3-bb61-4d03-a126-489c1769863c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:17.933831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:17.942797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022eee3-bb61-4d03-a126-489c1769863c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:17.944361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022eee3-bb61-4d03-a126-489c1769863c service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:17.954124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 881/1785] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:17.954826 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022eee3-bb61-4d03-a126-489c1769863c service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:17.964126 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022eee3-bb61-4d03-a126-489c1769863c service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:17.969475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac08d7-e765-48ab-a57b-b25b1ab829d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:17.969985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac08d7-e765-48ab-a57b-b25b1ab829d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:17.970264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac08d7-e765-48ab-a57b-b25b1ab829d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:17.970536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac08d7-e765-48ab-a57b-b25b1ab829d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:17.971275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac08d7-e765-48ab-a57b-b25b1ab829d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:17.973222 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac08d7-e765-48ab-a57b-b25b1ab829d2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:18.072402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef3268d059a4744b02cbd34fb78400d', 'request_id': 'req-31d80d27-ce11-4c57-b096-f0e9bde6db0b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:18.079090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef3268d059a4744b02cbd34fb78400d', 'request_id': 'req-31d80d27-ce11-4c57-b096-f0e9bde6db0b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:18.084174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 882/1786] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:17 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:18.085386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef3268d059a4744b02cbd34fb78400d', 'request_id': 'req-31d80d27-ce11-4c57-b096-f0e9bde6db0b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:18.088197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac08d7-e765-48ab-a57b-b25b1ab829d2 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:18.097869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac08d7-e765-48ab-a57b-b25b1ab829d2 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:18.158225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] The token cache is being invalidate because project 0ef3268d059a4744b02cbd34fb78400d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:18.158613 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:18.159750 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-31d80d27-ce11-4c57-b096-f0e9bde6db0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:18.161615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 905/1787] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:17 2022] DELETE /identity/v3/projects/0ef3268d059a4744b02cbd34fb78400d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:18.163975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8413cb-f233-4ab0-8aac-a07cefaf1636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:18.164662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8413cb-f233-4ab0-8aac-a07cefaf1636 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.164944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8413cb-f233-4ab0-8aac-a07cefaf1636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.165231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8413cb-f233-4ab0-8aac-a07cefaf1636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.167382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c2d6a-58f5-4d5b-b274-ab7b4cc98d1c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.167382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c2d6a-58f5-4d5b-b274-ab7b4cc98d1c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.167554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c2d6a-58f5-4d5b-b274-ab7b4cc98d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.173858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8413cb-f233-4ab0-8aac-a07cefaf1636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:18.176202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8413cb-f233-4ab0-8aac-a07cefaf1636 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:18.194582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 883/1788] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:18.195695 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8413cb-f233-4ab0-8aac-a07cefaf1636 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:18.197776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ab8413cb-f233-4ab0-8aac-a07cefaf1636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:18.197997 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9f0c2d6a-58f5-4d5b-b274-ab7b4cc98d1c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:18.200879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9f0c2d6a-58f5-4d5b-b274-ab7b4cc98d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:18.218785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 906/1789] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:18.218995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8413cb-f233-4ab0-8aac-a07cefaf1636 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:18.225211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9fc6-2d34-4973-a1bc-ff443cd00a9a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.225553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9fc6-2d34-4973-a1bc-ff443cd00a9a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.226097 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9fc6-2d34-4973-a1bc-ff443cd00a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.231414 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5b4a-5773-4459-82d4-937f886d3eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:18.232803 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5b4a-5773-4459-82d4-937f886d3eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.233221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5b4a-5773-4459-82d4-937f886d3eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.233647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5b4a-5773-4459-82d4-937f886d3eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.234466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f5b4a-5773-4459-82d4-937f886d3eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:18.237406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f5b4a-5773-4459-82d4-937f886d3eb2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:18.252129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-640e9fc6-2d34-4973-a1bc-ff443cd00a9a None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:18.253684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-640e9fc6-2d34-4973-a1bc-ff443cd00a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:18.259052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 884/1790] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:18.266253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5b4a-5773-4459-82d4-937f886d3eb2 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:18.270433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 907/1791] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:18.276320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e9fc6-2d34-4973-a1bc-ff443cd00a9a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:18.278694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5b4a-5773-4459-82d4-937f886d3eb2 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:18.283913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908eb2-763b-4515-908b-3c04c84fc0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:18.284479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908eb2-763b-4515-908b-3c04c84fc0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.289856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908eb2-763b-4515-908b-3c04c84fc0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.289856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908eb2-763b-4515-908b-3c04c84fc0f9 admin admin] PATH_INFO: `/v3/projects/0bb22f6fd7d14ded80ccf53ae5cc4040/users/607b54ba93634afbb1b6b5fbd283be5e/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.290532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e9fc6-2d34-4973-a1bc-ff443cd00a9a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:18.296507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7456cb-9dec-4cb9-87e6-5dbf8cb4805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:18.297303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7456cb-9dec-4cb9-87e6-5dbf8cb4805d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.297747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7456cb-9dec-4cb9-87e6-5dbf8cb4805d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.298021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7456cb-9dec-4cb9-87e6-5dbf8cb4805d admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.298826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7456cb-9dec-4cb9-87e6-5dbf8cb4805d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:18.299287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7456cb-9dec-4cb9-87e6-5dbf8cb4805d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:18.301037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7456cb-9dec-4cb9-87e6-5dbf8cb4805d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:18.303812 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f908eb2-763b-4515-908b-3c04c84fc0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bb22f6fd7d14ded80ccf53ae5cc4040, user_id=607b54ba93634afbb1b6b5fbd283be5e, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:18.307059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f908eb2-763b-4515-908b-3c04c84fc0f9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:18.316420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 908/1792] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:18.320683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7456cb-9dec-4cb9-87e6-5dbf8cb4805d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:18.331661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7456cb-9dec-4cb9-87e6-5dbf8cb4805d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:18.338062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3e0c-dd65-4c76-9e1c-6220ada9db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:18.338062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3e0c-dd65-4c76-9e1c-6220ada9db6c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.338062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3e0c-dd65-4c76-9e1c-6220ada9db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.338062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3e0c-dd65-4c76-9e1c-6220ada9db6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.338378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f3e0c-dd65-4c76-9e1c-6220ada9db6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:18.340455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f3e0c-dd65-4c76-9e1c-6220ada9db6c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:18.420234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 885/1793] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:18 2022] PUT /identity/v3/projects/0bb22f6fd7d14ded80ccf53ae5cc4040/users/607b54ba93634afbb1b6b5fbd283be5e/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:18.433446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258d4c-da2c-4bf3-bf0f-2ee89cf285f0 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.433446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258d4c-da2c-4bf3-bf0f-2ee89cf285f0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.433446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258d4c-da2c-4bf3-bf0f-2ee89cf285f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.454387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 909/1794] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:18 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:18.456129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3e0c-dd65-4c76-9e1c-6220ada9db6c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:18.460497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-259f3e0c-dd65-4c76-9e1c-6220ada9db6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:18.472091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-4c258d4c-da2c-4bf3-bf0f-2ee89cf285f0 None None] MFA Rules not processed for user `607b54ba93634afbb1b6b5fbd283be5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:18.473319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4c258d4c-da2c-4bf3-bf0f-2ee89cf285f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:18.535254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3e0c-dd65-4c76-9e1c-6220ada9db6c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:18.540387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:18.541032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.541311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.541585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] PATH_INFO: `/v3/projects/37a02e7662304494b17d9f7f7aad7b4c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.542804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a02e7662304494b17d9f7f7aad7b4c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:18.545272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:18.571990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 886/1795] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:18.575661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c258d4c-da2c-4bf3-bf0f-2ee89cf285f0 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:18.586907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c258d4c-da2c-4bf3-bf0f-2ee89cf285f0 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:18.592779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558882-0590-42f8-bacb-8599b8ea7a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:18.593563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558882-0590-42f8-bacb-8599b8ea7a02 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.594041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558882-0590-42f8-bacb-8599b8ea7a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.594168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558882-0590-42f8-bacb-8599b8ea7a02 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.594965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00558882-0590-42f8-bacb-8599b8ea7a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:18.600261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00558882-0590-42f8-bacb-8599b8ea7a02 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:18.666365 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a02e7662304494b17d9f7f7aad7b4c', 'request_id': 'req-6c5c23f0-8207-4d69-910c-cae6d11deb9a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:18.673058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a02e7662304494b17d9f7f7aad7b4c', 'request_id': 'req-6c5c23f0-8207-4d69-910c-cae6d11deb9a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:18.679346 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a02e7662304494b17d9f7f7aad7b4c', 'request_id': 'req-6c5c23f0-8207-4d69-910c-cae6d11deb9a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:18.711054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 887/1796] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:18 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:18.712100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558882-0590-42f8-bacb-8599b8ea7a02 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:18.723333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558882-0590-42f8-bacb-8599b8ea7a02 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:18.777095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] The token cache is being invalidate because project 37a02e7662304494b17d9f7f7aad7b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:18.777463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:18.778594 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:18.780777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 910/1797] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:18 2022] DELETE /identity/v3/projects/37a02e7662304494b17d9f7f7aad7b4c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:18.782176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:18.785151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:18.810554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd0d70-3069-48de-bc3a-0a922be1460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:18.811097 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0d70-3069-48de-bc3a-0a922be1460c admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.811371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0d70-3069-48de-bc3a-0a922be1460c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.811643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0d70-3069-48de-bc3a-0a922be1460c admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.812288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd0d70-3069-48de-bc3a-0a922be1460c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:18.814388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd0d70-3069-48de-bc3a-0a922be1460c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:18.865484 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c23f0-8207-4d69-910c-cae6d11deb9a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:18.868836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585284-7e26-4898-98b7-22a57c4bd108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:18.869448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585284-7e26-4898-98b7-22a57c4bd108 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.869725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585284-7e26-4898-98b7-22a57c4bd108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.869995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585284-7e26-4898-98b7-22a57c4bd108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.870637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5585284-7e26-4898-98b7-22a57c4bd108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:18.872245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5585284-7e26-4898-98b7-22a57c4bd108 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:18.882141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 911/1798] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:18.883142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b83e7-593e-4e1a-a29f-7fdde4a8ef92 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:18.883421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b83e7-593e-4e1a-a29f-7fdde4a8ef92 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:18.883694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b83e7-593e-4e1a-a29f-7fdde4a8ef92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:18.908507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e87b83e7-593e-4e1a-a29f-7fdde4a8ef92 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:18.910639 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:18.911722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e87b83e7-593e-4e1a-a29f-7fdde4a8ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:18.914423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 888/1799] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:18 2022] POST /identity/v3/projects => generated 387 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:18.915393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd0d70-3069-48de-bc3a-0a922be1460c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:18.987949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 912/1800] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:18.989187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b83e7-593e-4e1a-a29f-7fdde4a8ef92 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:18.991891 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e87b83e7-593e-4e1a-a29f-7fdde4a8ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:18.994658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd0d70-3069-48de-bc3a-0a922be1460c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:18.999527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdb6c3-2aef-4fec-b743-65253702ea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.000277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdb6c3-2aef-4fec-b743-65253702ea37 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.000568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdb6c3-2aef-4fec-b743-65253702ea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.000879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdb6c3-2aef-4fec-b743-65253702ea37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.002222 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdb6c3-2aef-4fec-b743-65253702ea37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.003342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdb6c3-2aef-4fec-b743-65253702ea37 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.008894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b83e7-593e-4e1a-a29f-7fdde4a8ef92 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.014492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 889/1801] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:19.015783 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e31f44-9b02-4ea2-a5da-a314c016bf16 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.015910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb56b1-1fda-4b87-af21-733952690de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.016093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e31f44-9b02-4ea2-a5da-a314c016bf16 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.016333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e31f44-9b02-4ea2-a5da-a314c016bf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.016718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb56b1-1fda-4b87-af21-733952690de7 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.017064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb56b1-1fda-4b87-af21-733952690de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.017423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb56b1-1fda-4b87-af21-733952690de7 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.018444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb56b1-1fda-4b87-af21-733952690de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.021327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb56b1-1fda-4b87-af21-733952690de7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.036825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-f9e31f44-9b02-4ea2-a5da-a314c016bf16 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:19.038111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f9e31f44-9b02-4ea2-a5da-a314c016bf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:19.047247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 890/1802] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:19.048109 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e31f44-9b02-4ea2-a5da-a314c016bf16 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.057847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e31f44-9b02-4ea2-a5da-a314c016bf16 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.062780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599296f8-0ed8-40fc-92c1-5dd109ad6e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.063440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599296f8-0ed8-40fc-92c1-5dd109ad6e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.063712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599296f8-0ed8-40fc-92c1-5dd109ad6e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.063984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599296f8-0ed8-40fc-92c1-5dd109ad6e11 admin admin] PATH_INFO: `/v3/projects/d37c1e85c4914145bd853cf80093526a/users/08376f8a89974dfa994372462d3e3b2b/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.080180 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599296f8-0ed8-40fc-92c1-5dd109ad6e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37c1e85c4914145bd853cf80093526a, user_id=08376f8a89974dfa994372462d3e3b2b, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.083294 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599296f8-0ed8-40fc-92c1-5dd109ad6e11 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.095574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 913/1803] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:18 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:19.098245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb56b1-1fda-4b87-af21-733952690de7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.106122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb56b1-1fda-4b87-af21-733952690de7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.110944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a2296-3e96-44c8-b931-6b9c24561e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.111548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a2296-3e96-44c8-b931-6b9c24561e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.111823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a2296-3e96-44c8-b931-6b9c24561e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.112092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a2296-3e96-44c8-b931-6b9c24561e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.112764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a2296-3e96-44c8-b931-6b9c24561e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:19.113070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a2296-3e96-44c8-b931-6b9c24561e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.114634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a2296-3e96-44c8-b931-6b9c24561e33 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.127202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 914/1804] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:19.128018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a2296-3e96-44c8-b931-6b9c24561e33 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.137606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a2296-3e96-44c8-b931-6b9c24561e33 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.142994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226751f-d216-45b9-8928-9dfe3c6b1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.143582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226751f-d216-45b9-8928-9dfe3c6b1b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.143859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226751f-d216-45b9-8928-9dfe3c6b1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.144138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226751f-d216-45b9-8928-9dfe3c6b1b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.144767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226751f-d216-45b9-8928-9dfe3c6b1b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.146335 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226751f-d216-45b9-8928-9dfe3c6b1b13 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.156809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 915/1805] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:19.157634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226751f-d216-45b9-8928-9dfe3c6b1b13 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.167682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226751f-d216-45b9-8928-9dfe3c6b1b13 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.172436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4811b8e-8391-4f8d-a6b9-4f8652f77d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.173044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811b8e-8391-4f8d-a6b9-4f8652f77d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.173331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811b8e-8391-4f8d-a6b9-4f8652f77d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.173614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4811b8e-8391-4f8d-a6b9-4f8652f77d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.174222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4811b8e-8391-4f8d-a6b9-4f8652f77d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.176373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4811b8e-8391-4f8d-a6b9-4f8652f77d37 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.182151 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 891/1806] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:19 2022] PUT /identity/v3/projects/d37c1e85c4914145bd853cf80093526a/users/08376f8a89974dfa994372462d3e3b2b/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:19.183056 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599296f8-0ed8-40fc-92c1-5dd109ad6e11 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.244425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599296f8-0ed8-40fc-92c1-5dd109ad6e11 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.249770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946cfa3-51b3-4b52-b016-8aae9b91d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.250391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946cfa3-51b3-4b52-b016-8aae9b91d5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.250697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946cfa3-51b3-4b52-b016-8aae9b91d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.250965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946cfa3-51b3-4b52-b016-8aae9b91d5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.251617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946cfa3-51b3-4b52-b016-8aae9b91d5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.253234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946cfa3-51b3-4b52-b016-8aae9b91d5f9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.260218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 916/1807] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:19 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:19.260218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76822-1d11-457f-8cf7-768e9b0046e9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.260218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76822-1d11-457f-8cf7-768e9b0046e9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.260218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76822-1d11-457f-8cf7-768e9b0046e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.267077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 892/1808] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:19.267077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946cfa3-51b3-4b52-b016-8aae9b91d5f9 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.276052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946cfa3-51b3-4b52-b016-8aae9b91d5f9 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.291035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-18d76822-1d11-457f-8cf7-768e9b0046e9 None None] MFA Rules not processed for user `08376f8a89974dfa994372462d3e3b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:19.292369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-18d76822-1d11-457f-8cf7-768e9b0046e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:19.333427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d811c4-5bff-4513-b123-224e6f55501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.334194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d811c4-5bff-4513-b123-224e6f55501f admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.334470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d811c4-5bff-4513-b123-224e6f55501f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.334770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d811c4-5bff-4513-b123-224e6f55501f admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.335396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d811c4-5bff-4513-b123-224e6f55501f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.337335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d811c4-5bff-4513-b123-224e6f55501f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.356727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 917/1809] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:19.357579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d76822-1d11-457f-8cf7-768e9b0046e9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.367605 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d76822-1d11-457f-8cf7-768e9b0046e9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.372185 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cd950-2eb0-4893-854f-f83f1eac738b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.373393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cd950-2eb0-4893-854f-f83f1eac738b admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.375393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cd950-2eb0-4893-854f-f83f1eac738b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.375393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cd950-2eb0-4893-854f-f83f1eac738b admin admin] PATH_INFO: `/v3/projects/48291e868ccf43fd82879933f3834808/users/8a964a1b3ecd4b42b7878b6ab490f3f7/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.390960 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cd950-2eb0-4893-854f-f83f1eac738b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48291e868ccf43fd82879933f3834808, user_id=8a964a1b3ecd4b42b7878b6ab490f3f7, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.393680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cd950-2eb0-4893-854f-f83f1eac738b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.424678 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 893/1810] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:19 2022] POST /identity/v3/users => generated 303 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:19.424678 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d811c4-5bff-4513-b123-224e6f55501f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.432932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d811c4-5bff-4513-b123-224e6f55501f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.439145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9d3d3-ebb5-4f2d-95a6-58ad3459dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.440208 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9d3d3-ebb5-4f2d-95a6-58ad3459dbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.440678 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9d3d3-ebb5-4f2d-95a6-58ad3459dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.441051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9d3d3-ebb5-4f2d-95a6-58ad3459dbf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.441734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9d3d3-ebb5-4f2d-95a6-58ad3459dbf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.443741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9d3d3-ebb5-4f2d-95a6-58ad3459dbf2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.496348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 918/1811] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:19 2022] PUT /identity/v3/projects/48291e868ccf43fd82879933f3834808/users/8a964a1b3ecd4b42b7878b6ab490f3f7/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:19.497467 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cd950-2eb0-4893-854f-f83f1eac738b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.526008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 894/1812] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:19 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:19.527984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a28c2-d089-4e2b-a9b5-9e664d294f33 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.528267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a28c2-d089-4e2b-a9b5-9e664d294f33 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.528540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a28c2-d089-4e2b-a9b5-9e664d294f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.562360 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-536a28c2-d089-4e2b-a9b5-9e664d294f33 None None] MFA Rules not processed for user `8a964a1b3ecd4b42b7878b6ab490f3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:19.563614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-536a28c2-d089-4e2b-a9b5-9e664d294f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:19.570687 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cd950-2eb0-4893-854f-f83f1eac738b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.635651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5437e9e-f80a-403f-b5c8-a0098a5ed0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.636476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5437e9e-f80a-403f-b5c8-a0098a5ed0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.637104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5437e9e-f80a-403f-b5c8-a0098a5ed0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.637449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5437e9e-f80a-403f-b5c8-a0098a5ed0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.638193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5437e9e-f80a-403f-b5c8-a0098a5ed0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.641926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 895/1813] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:19.641926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a28c2-d089-4e2b-a9b5-9e664d294f33 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.642165 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5437e9e-f80a-403f-b5c8-a0098a5ed0c9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.659275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 919/1814] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:19.660389 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5437e9e-f80a-403f-b5c8-a0098a5ed0c9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.662565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a28c2-d089-4e2b-a9b5-9e664d294f33 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.669358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a96a9-4c70-46d7-a537-74829eefa5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.671014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a96a9-4c70-46d7-a537-74829eefa5da admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.671572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a96a9-4c70-46d7-a537-74829eefa5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.672004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a96a9-4c70-46d7-a537-74829eefa5da admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.672832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a96a9-4c70-46d7-a537-74829eefa5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.675258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a96a9-4c70-46d7-a537-74829eefa5da admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.681079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5437e9e-f80a-403f-b5c8-a0098a5ed0c9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.686692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6054c7-1dee-4e44-8eb6-566927441402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.687400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6054c7-1dee-4e44-8eb6-566927441402 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.688078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6054c7-1dee-4e44-8eb6-566927441402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.688532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6054c7-1dee-4e44-8eb6-566927441402 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.689877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6054c7-1dee-4e44-8eb6-566927441402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.692759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6054c7-1dee-4e44-8eb6-566927441402 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.803933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 896/1815] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:19 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:19.804746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a96a9-4c70-46d7-a537-74829eefa5da admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.815609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a96a9-4c70-46d7-a537-74829eefa5da admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.820731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55435660-f865-44b8-85fc-e9c778c7bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.822600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55435660-f865-44b8-85fc-e9c778c7bcbb admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.822600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55435660-f865-44b8-85fc-e9c778c7bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.822600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55435660-f865-44b8-85fc-e9c778c7bcbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.823021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55435660-f865-44b8-85fc-e9c778c7bcbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.825687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55435660-f865-44b8-85fc-e9c778c7bcbb admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.838586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 897/1816] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:19.839536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55435660-f865-44b8-85fc-e9c778c7bcbb admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.852704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 920/1817] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:19 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:19.854795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6054c7-1dee-4e44-8eb6-566927441402 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:19.868677 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55435660-f865-44b8-85fc-e9c778c7bcbb admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.971250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da2201-0a97-4867-b90a-995f634b7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:19.971900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2201-0a97-4867-b90a-995f634b7d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:19.972184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2201-0a97-4867-b90a-995f634b7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:19.972448 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2201-0a97-4867-b90a-995f634b7d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:19.973295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da2201-0a97-4867-b90a-995f634b7d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:19.974908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da2201-0a97-4867-b90a-995f634b7d84 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:19.991872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6054c7-1dee-4e44-8eb6-566927441402 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:19.994781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 898/1818] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:19.995894 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da2201-0a97-4867-b90a-995f634b7d84 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.002176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d396ef-c972-4409-aa56-f9e6c8df0d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.002563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d396ef-c972-4409-aa56-f9e6c8df0d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.002942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d396ef-c972-4409-aa56-f9e6c8df0d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.003620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d396ef-c972-4409-aa56-f9e6c8df0d1a admin admin] PATH_INFO: `/v3/projects/1d7142ef1b194da3abcb8ac25a6b8a11/users/c51a1cd0795d4675a0180ada9a825db8/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.008830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da2201-0a97-4867-b90a-995f634b7d84 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.014468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de00e-ad5d-4d36-80b1-4244da869023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.015287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de00e-ad5d-4d36-80b1-4244da869023 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.015723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de00e-ad5d-4d36-80b1-4244da869023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.016135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de00e-ad5d-4d36-80b1-4244da869023 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.016900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435de00e-ad5d-4d36-80b1-4244da869023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.019358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435de00e-ad5d-4d36-80b1-4244da869023 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.033091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d396ef-c972-4409-aa56-f9e6c8df0d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7142ef1b194da3abcb8ac25a6b8a11, user_id=c51a1cd0795d4675a0180ada9a825db8, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.035873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d396ef-c972-4409-aa56-f9e6c8df0d1a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.113618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 899/1819] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:19 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:20.117518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de00e-ad5d-4d36-80b1-4244da869023 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.129220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de00e-ad5d-4d36-80b1-4244da869023 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.134088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74facc-58f1-4178-8185-d5f26268ead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.134798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74facc-58f1-4178-8185-d5f26268ead3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.135097 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74facc-58f1-4178-8185-d5f26268ead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.135369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74facc-58f1-4178-8185-d5f26268ead3 admin admin] PATH_INFO: `/v3/projects/a56ea00367634baba7368be4d72e893b/users/6663021e6c9a4216a2f6de8d0ef162ce/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.145381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 921/1820] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:19 2022] PUT /identity/v3/projects/1d7142ef1b194da3abcb8ac25a6b8a11/users/c51a1cd0795d4675a0180ada9a825db8/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:20.152500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74facc-58f1-4178-8185-d5f26268ead3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56ea00367634baba7368be4d72e893b, user_id=6663021e6c9a4216a2f6de8d0ef162ce, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.156341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74facc-58f1-4178-8185-d5f26268ead3 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.159666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d396ef-c972-4409-aa56-f9e6c8df0d1a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.214877 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:20.231524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d396ef-c972-4409-aa56-f9e6c8df0d1a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.238630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6dcb1-e7c5-43cc-892b-0670e921fb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.239449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6dcb1-e7c5-43cc-892b-0670e921fb96 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.239725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6dcb1-e7c5-43cc-892b-0670e921fb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.239993 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6dcb1-e7c5-43cc-892b-0670e921fb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.241104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6dcb1-e7c5-43cc-892b-0670e921fb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.242785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6dcb1-e7c5-43cc-892b-0670e921fb96 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.243960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 900/1821] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:20 2022] PUT /identity/v3/projects/a56ea00367634baba7368be4d72e893b/users/6663021e6c9a4216a2f6de8d0ef162ce/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:20.245232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efeeeb-e528-4c71-8a11-e0306cc91128 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.245671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efeeeb-e528-4c71-8a11-e0306cc91128 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.245950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efeeeb-e528-4c71-8a11-e0306cc91128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.262086 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 922/1822] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:20.262086 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6dcb1-e7c5-43cc-892b-0670e921fb96 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.274553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6dcb1-e7c5-43cc-892b-0670e921fb96 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.294096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-61efeeeb-e528-4c71-8a11-e0306cc91128 None None] MFA Rules not processed for user `c51a1cd0795d4675a0180ada9a825db8`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:20.296555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-61efeeeb-e528-4c71-8a11-e0306cc91128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:20.355027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221df90a-2630-4ca8-aedd-790bcfbba855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.355632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221df90a-2630-4ca8-aedd-790bcfbba855 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.355902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221df90a-2630-4ca8-aedd-790bcfbba855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.356243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221df90a-2630-4ca8-aedd-790bcfbba855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.356812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221df90a-2630-4ca8-aedd-790bcfbba855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.358419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221df90a-2630-4ca8-aedd-790bcfbba855 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.371744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 923/1823] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:20.371744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221df90a-2630-4ca8-aedd-790bcfbba855 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.373420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 901/1824] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:20.374161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efeeeb-e528-4c71-8a11-e0306cc91128 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.384996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efeeeb-e528-4c71-8a11-e0306cc91128 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.385158 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221df90a-2630-4ca8-aedd-790bcfbba855 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.390253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abc975-0326-4d4e-a9f5-faa58411fadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.390604 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c0829-7486-4a8d-8bf0-32cfb0b0527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.390966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abc975-0326-4d4e-a9f5-faa58411fadd admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.391246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abc975-0326-4d4e-a9f5-faa58411fadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.391368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0829-7486-4a8d-8bf0-32cfb0b0527d admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.391513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abc975-0326-4d4e-a9f5-faa58411fadd admin admin] PATH_INFO: `/v3/projects/ea64efda5d6f45d7b11ec8ff5010d304/users/4bbdebcc32954e2ca6959d814a8e6479/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.391644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0829-7486-4a8d-8bf0-32cfb0b0527d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.391913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0829-7486-4a8d-8bf0-32cfb0b0527d admin admin] PATH_INFO: `/v3/projects/a56ea00367634baba7368be4d72e893b/users/6663021e6c9a4216a2f6de8d0ef162ce/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.394026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c0829-7486-4a8d-8bf0-32cfb0b0527d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56ea00367634baba7368be4d72e893b, user_id=6663021e6c9a4216a2f6de8d0ef162ce, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.396699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c0829-7486-4a8d-8bf0-32cfb0b0527d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.406487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abc975-0326-4d4e-a9f5-faa58411fadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea64efda5d6f45d7b11ec8ff5010d304, user_id=4bbdebcc32954e2ca6959d814a8e6479, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.407684 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 902/1825] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:20 2022] PUT /identity/v3/projects/a56ea00367634baba7368be4d72e893b/users/6663021e6c9a4216a2f6de8d0ef162ce/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:20.411450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c0829-7486-4a8d-8bf0-32cfb0b0527d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.411579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abc975-0326-4d4e-a9f5-faa58411fadd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.475851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 924/1826] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:20 2022] PUT /identity/v3/projects/ea64efda5d6f45d7b11ec8ff5010d304/users/4bbdebcc32954e2ca6959d814a8e6479/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:20.477304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8476c-a1d8-42f3-a4b9-d72dfd8c5266 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.477588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8476c-a1d8-42f3-a4b9-d72dfd8c5266 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.477912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8476c-a1d8-42f3-a4b9-d72dfd8c5266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.482870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c0829-7486-4a8d-8bf0-32cfb0b0527d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.513981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-35c8476c-a1d8-42f3-a4b9-d72dfd8c5266 None None] MFA Rules not processed for user `6663021e6c9a4216a2f6de8d0ef162ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:20.514569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-35c8476c-a1d8-42f3-a4b9-d72dfd8c5266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:20.544339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d095f82-5ee7-4eca-bd4f-599e73a0f2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.544984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d095f82-5ee7-4eca-bd4f-599e73a0f2bf admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.545259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d095f82-5ee7-4eca-bd4f-599e73a0f2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.545529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d095f82-5ee7-4eca-bd4f-599e73a0f2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.546155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d095f82-5ee7-4eca-bd4f-599e73a0f2bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.548093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d095f82-5ee7-4eca-bd4f-599e73a0f2bf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.584423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 925/1827] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:20.585272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8476c-a1d8-42f3-a4b9-d72dfd8c5266 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.596008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8476c-a1d8-42f3-a4b9-d72dfd8c5266 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.600753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7c8eb-2493-49be-9ac7-de440644863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.601346 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7c8eb-2493-49be-9ac7-de440644863c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.601750 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7c8eb-2493-49be-9ac7-de440644863c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.601924 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7c8eb-2493-49be-9ac7-de440644863c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.602541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7c8eb-2493-49be-9ac7-de440644863c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.604161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7c8eb-2493-49be-9ac7-de440644863c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.614088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 926/1828] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:20.617297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7c8eb-2493-49be-9ac7-de440644863c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.617297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d8c7c8eb-2493-49be-9ac7-de440644863c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:20.643766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 903/1829] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:20 2022] POST /identity/v3/projects => generated 403 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:20.643766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d095f82-5ee7-4eca-bd4f-599e73a0f2bf admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.679270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7c8eb-2493-49be-9ac7-de440644863c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.707575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d095f82-5ee7-4eca-bd4f-599e73a0f2bf admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.713560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6484e-9b22-4876-b330-f7157cc92c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.714206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6484e-9b22-4876-b330-f7157cc92c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.714597 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6484e-9b22-4876-b330-f7157cc92c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.714913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6484e-9b22-4876-b330-f7157cc92c8e admin admin] PATH_INFO: `/v3/projects/ea64efda5d6f45d7b11ec8ff5010d304/users/4bbdebcc32954e2ca6959d814a8e6479/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.717057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6484e-9b22-4876-b330-f7157cc92c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea64efda5d6f45d7b11ec8ff5010d304, user_id=4bbdebcc32954e2ca6959d814a8e6479, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.720067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6484e-9b22-4876-b330-f7157cc92c8e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.739889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 904/1830] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:20 2022] PUT /identity/v3/projects/ea64efda5d6f45d7b11ec8ff5010d304/users/4bbdebcc32954e2ca6959d814a8e6479/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:20.739889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6484e-9b22-4876-b330-f7157cc92c8e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.740154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecd2f7-2849-4ba0-b144-cd7b333d0890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.740154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd2f7-2849-4ba0-b144-cd7b333d0890 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.740154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd2f7-2849-4ba0-b144-cd7b333d0890 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.740154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd2f7-2849-4ba0-b144-cd7b333d0890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.803520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6484e-9b22-4876-b330-f7157cc92c8e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.808346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de802ea2-5117-400c-835e-fdf50eee6f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.811130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecd2f7-2849-4ba0-b144-cd7b333d0890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.811287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de802ea2-5117-400c-835e-fdf50eee6f6b admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.811287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de802ea2-5117-400c-835e-fdf50eee6f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.811287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de802ea2-5117-400c-835e-fdf50eee6f6b admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.811287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de802ea2-5117-400c-835e-fdf50eee6f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.811596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecd2f7-2849-4ba0-b144-cd7b333d0890 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.812833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de802ea2-5117-400c-835e-fdf50eee6f6b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.821447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 927/1831] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:20.822643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382933a-eb1c-4690-8c16-2d33ff598810 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.823029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382933a-eb1c-4690-8c16-2d33ff598810 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.823303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382933a-eb1c-4690-8c16-2d33ff598810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.853451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c382933a-eb1c-4690-8c16-2d33ff598810 None None] MFA Rules not processed for user `4bbdebcc32954e2ca6959d814a8e6479`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:20.854939 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c382933a-eb1c-4690-8c16-2d33ff598810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:20.897984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 905/1832] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:20 2022] POST /identity/v3/users => generated 308 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:20.902314 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de802ea2-5117-400c-835e-fdf50eee6f6b admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.924699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de802ea2-5117-400c-835e-fdf50eee6f6b admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.934701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79591971-64b0-4455-8a1a-4800feaa5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.936192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79591971-64b0-4455-8a1a-4800feaa5791 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.936472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79591971-64b0-4455-8a1a-4800feaa5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.936738 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79591971-64b0-4455-8a1a-4800feaa5791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.937382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79591971-64b0-4455-8a1a-4800feaa5791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:20.938500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 928/1833] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:20.940141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79591971-64b0-4455-8a1a-4800feaa5791 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:20.946658 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382933a-eb1c-4690-8c16-2d33ff598810 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.959303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 906/1834] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:20.960301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79591971-64b0-4455-8a1a-4800feaa5791 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:20.973320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79591971-64b0-4455-8a1a-4800feaa5791 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:20.980330 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6066f11-4753-4c25-9825-9420481b8dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:20.981004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6066f11-4753-4c25-9825-9420481b8dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:20.981280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6066f11-4753-4c25-9825-9420481b8dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:20.981559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6066f11-4753-4c25-9825-9420481b8dd3 admin admin] PATH_INFO: `/v3/projects/a75de96728fc41ba9a4d8a1e833db191/users/e80e986a23ec4983b694ee8ab3c35181/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:20.997434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6066f11-4753-4c25-9825-9420481b8dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75de96728fc41ba9a4d8a1e833db191, user_id=e80e986a23ec4983b694ee8ab3c35181, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:21.000691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6066f11-4753-4c25-9825-9420481b8dd3 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:21.010472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382933a-eb1c-4690-8c16-2d33ff598810 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:21.014748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bb67e-24c7-4379-8930-981b6e247fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:21.015387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bb67e-24c7-4379-8930-981b6e247fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:21.015665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bb67e-24c7-4379-8930-981b6e247fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:21.015936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bb67e-24c7-4379-8930-981b6e247fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:21.025242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bb67e-24c7-4379-8930-981b6e247fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:21.026726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bb67e-24c7-4379-8930-981b6e247fa4 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:21.036821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 929/1835] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:21.037445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bb67e-24c7-4379-8930-981b6e247fa4 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:21.039033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a96bb67e-24c7-4379-8930-981b6e247fa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:21.050272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bb67e-24c7-4379-8930-981b6e247fa4 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:21.056929 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e415ef9-2dfe-4213-a387-7329df383129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:21.058352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e415ef9-2dfe-4213-a387-7329df383129 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:21.058352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e415ef9-2dfe-4213-a387-7329df383129 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:21.058352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e415ef9-2dfe-4213-a387-7329df383129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:21.117829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 907/1836] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:20 2022] PUT /identity/v3/projects/a75de96728fc41ba9a4d8a1e833db191/users/e80e986a23ec4983b694ee8ab3c35181/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:21.118863 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6066f11-4753-4c25-9825-9420481b8dd3 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:21.124044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:21.132139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e415ef9-2dfe-4213-a387-7329df383129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:21.134605 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e415ef9-2dfe-4213-a387-7329df383129 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:21.148251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 930/1837] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:21.198593 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6066f11-4753-4c25-9825-9420481b8dd3 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:21.203590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b4ca3-61e7-4cbc-aec8-f7ba9c60197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:21.207555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b4ca3-61e7-4cbc-aec8-f7ba9c60197b admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:21.207555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b4ca3-61e7-4cbc-aec8-f7ba9c60197b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:21.207555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b4ca3-61e7-4cbc-aec8-f7ba9c60197b admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:21.207555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b4ca3-61e7-4cbc-aec8-f7ba9c60197b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:21.207555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b4ca3-61e7-4cbc-aec8-f7ba9c60197b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:21.217134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 908/1838] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:21.222100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e415ef9-2dfe-4213-a387-7329df383129 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:21.234365 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e415ef9-2dfe-4213-a387-7329df383129 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:21.239275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c85df-c54e-4376-bb6c-b45d6aba9a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:21.239938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c85df-c54e-4376-bb6c-b45d6aba9a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:21.240214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c85df-c54e-4376-bb6c-b45d6aba9a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:21.240483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c85df-c54e-4376-bb6c-b45d6aba9a60 admin admin] PATH_INFO: `/v3/projects/a75de96728fc41ba9a4d8a1e833db191/users/e80e986a23ec4983b694ee8ab3c35181/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:21.242545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c85df-c54e-4376-bb6c-b45d6aba9a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75de96728fc41ba9a4d8a1e833db191, user_id=e80e986a23ec4983b694ee8ab3c35181, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:21.245180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c85df-c54e-4376-bb6c-b45d6aba9a60 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:21.264505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 931/1839] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:21 2022] PUT /identity/v3/projects/a75de96728fc41ba9a4d8a1e833db191/users/e80e986a23ec4983b694ee8ab3c35181/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:21.279292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29d7cb-de51-4146-b839-23ded2d97054 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:21.279292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29d7cb-de51-4146-b839-23ded2d97054 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:21.279292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29d7cb-de51-4146-b839-23ded2d97054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:21.320382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-8f29d7cb-de51-4146-b839-23ded2d97054 None None] MFA Rules not processed for user `e80e986a23ec4983b694ee8ab3c35181`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:21.321626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-8f29d7cb-de51-4146-b839-23ded2d97054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:21.389230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 909/1840] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:21 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:21.404086 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c85df-c54e-4376-bb6c-b45d6aba9a60 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:21.469233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c85df-c54e-4376-bb6c-b45d6aba9a60 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:21.473062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0929565-1f9d-439a-83a3-d1a2123b0d19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:21.473723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0929565-1f9d-439a-83a3-d1a2123b0d19 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:21.473998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0929565-1f9d-439a-83a3-d1a2123b0d19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:21.474264 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0929565-1f9d-439a-83a3-d1a2123b0d19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:21.490549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0929565-1f9d-439a-83a3-d1a2123b0d19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:21.490549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0929565-1f9d-439a-83a3-d1a2123b0d19 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:21.498728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 932/1841] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:21 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:22.080439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29d7cb-de51-4146-b839-23ded2d97054 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:22.122960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:22.156147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29d7cb-de51-4146-b839-23ded2d97054 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:22.161689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:22.162379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:22.162660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:22.162984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] PATH_INFO: `/v3/users/c51a1cd0795d4675a0180ada9a825db8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:22.164431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51a1cd0795d4675a0180ada9a825db8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:22.166483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:22.355262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0929565-1f9d-439a-83a3-d1a2123b0d19 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:22.364300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0929565-1f9d-439a-83a3-d1a2123b0d19 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:22.368520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dbe75-54f4-4710-a253-02965204794c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:22.369113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dbe75-54f4-4710-a253-02965204794c service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:22.369387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dbe75-54f4-4710-a253-02965204794c service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:22.369653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dbe75-54f4-4710-a253-02965204794c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:22.373908 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8a7dbe75-54f4-4710-a253-02965204794c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:22.375850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51a1cd0795d4675a0180ada9a825db8'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:22.376601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51a1cd0795d4675a0180ada9a825db8'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:22.442896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7dbe75-54f4-4710-a253-02965204794c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:22.444451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7dbe75-54f4-4710-a253-02965204794c service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:22.454095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 933/1842] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:22.464438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51a1cd0795d4675a0180ada9a825db8'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:22.466284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51a1cd0795d4675a0180ada9a825db8'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:22.473261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51a1cd0795d4675a0180ada9a825db8'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:22.494481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 910/1843] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:22 2022] DELETE /identity/v3/users/c51a1cd0795d4675a0180ada9a825db8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:22.499579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdbfed-ed80-45ae-8bcc-2f4c44199992 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:22.499867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdbfed-ed80-45ae-8bcc-2f4c44199992 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:22.500140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdbfed-ed80-45ae-8bcc-2f4c44199992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:22.520607 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bdcdbfed-ed80-45ae-8bcc-2f4c44199992 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:22.522043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bdcdbfed-ed80-45ae-8bcc-2f4c44199992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:22.587350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 934/1844] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:22.614938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:22.616376 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:22.678643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2d629-3cb4-469d-aa35-558e7ef22943 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:22.682503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab015a1-f3ac-4209-bcfc-f9a38f94ef76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:22.683201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab015a1-f3ac-4209-bcfc-f9a38f94ef76 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:22.683541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab015a1-f3ac-4209-bcfc-f9a38f94ef76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:22.683874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab015a1-f3ac-4209-bcfc-f9a38f94ef76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:22.694144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab015a1-f3ac-4209-bcfc-f9a38f94ef76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:22.695710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab015a1-f3ac-4209-bcfc-f9a38f94ef76 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:22.705814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 911/1845] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:22.819333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:23.122162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdbfed-ed80-45ae-8bcc-2f4c44199992 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:23.123870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bdcdbfed-ed80-45ae-8bcc-2f4c44199992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:23.137543 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdbfed-ed80-45ae-8bcc-2f4c44199992 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:23.158371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:23.159211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:23.159531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:23.159759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] PATH_INFO: `/v3/projects/1d7142ef1b194da3abcb8ac25a6b8a11` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:23.161055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7142ef1b194da3abcb8ac25a6b8a11)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:23.165047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:23.340796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7142ef1b194da3abcb8ac25a6b8a11', 'request_id': 'req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:23.349930 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7142ef1b194da3abcb8ac25a6b8a11', 'request_id': 'req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:23.356656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7142ef1b194da3abcb8ac25a6b8a11', 'request_id': 'req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:23.444430 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] The token cache is being invalidate because project 1d7142ef1b194da3abcb8ac25a6b8a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:23.445009 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:23.455291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:23.455291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 935/1846] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:23 2022] DELETE /identity/v3/projects/1d7142ef1b194da3abcb8ac25a6b8a11 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:23.455659 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab015a1-f3ac-4209-bcfc-f9a38f94ef76 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:23.465047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab015a1-f3ac-4209-bcfc-f9a38f94ef76 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:23.536182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:23.536830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:23.537301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:23.537577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] PATH_INFO: `/v3/users/e80e986a23ec4983b694ee8ab3c35181` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:23.539080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80e986a23ec4983b694ee8ab3c35181)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:23.541004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:23.749336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80e986a23ec4983b694ee8ab3c35181'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:23.750106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80e986a23ec4983b694ee8ab3c35181'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:23.803359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80e986a23ec4983b694ee8ab3c35181'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:23.804002 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80e986a23ec4983b694ee8ab3c35181'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:23.812402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80e986a23ec4983b694ee8ab3c35181'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:23.842200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 912/1847] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:23 2022] DELETE /identity/v3/users/e80e986a23ec4983b694ee8ab3c35181 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:23.900987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:24.334478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:24.336024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:24.351179 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ab7a-fcf2-45f6-b14d-da7ff0b1a17c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:24.422634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:24.423319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:24.423619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:24.424014 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] PATH_INFO: `/v3/projects/a75de96728fc41ba9a4d8a1e833db191` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:24.425249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75de96728fc41ba9a4d8a1e833db191)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:24.427675 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:24.531896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:24.535387 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:24.547740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f585c9-774d-452e-af51-a32f717b0a99 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:24.561230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75de96728fc41ba9a4d8a1e833db191', 'request_id': 'req-22fa6729-4ade-4b03-9aa8-3288dde93570'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:24.571816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75de96728fc41ba9a4d8a1e833db191', 'request_id': 'req-22fa6729-4ade-4b03-9aa8-3288dde93570'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:24.579641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75de96728fc41ba9a4d8a1e833db191', 'request_id': 'req-22fa6729-4ade-4b03-9aa8-3288dde93570'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:24.610883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad556e5a-ed10-49e5-bdba-a43c0e472536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:24.611761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556e5a-ed10-49e5-bdba-a43c0e472536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:24.612037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556e5a-ed10-49e5-bdba-a43c0e472536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:24.612309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad556e5a-ed10-49e5-bdba-a43c0e472536 admin admin] PATH_INFO: `/v3/users/08376f8a89974dfa994372462d3e3b2b` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:24.613464 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad556e5a-ed10-49e5-bdba-a43c0e472536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08376f8a89974dfa994372462d3e3b2b)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:24.615480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad556e5a-ed10-49e5-bdba-a43c0e472536 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:24.678319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:24.684195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] The token cache is being invalidate because project a75de96728fc41ba9a4d8a1e833db191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:24.684758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:24.685625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22fa6729-4ade-4b03-9aa8-3288dde93570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:24.687799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 936/1848] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:24 2022] DELETE /identity/v3/projects/a75de96728fc41ba9a4d8a1e833db191 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:24.692506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8f750-9678-4fde-8fc4-eb0b2d3f1b89 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:24.693201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8f750-9678-4fde-8fc4-eb0b2d3f1b89 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:24.693678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8f750-9678-4fde-8fc4-eb0b2d3f1b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:24.715362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d8b8f750-9678-4fde-8fc4-eb0b2d3f1b89 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:24.717344 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d8b8f750-9678-4fde-8fc4-eb0b2d3f1b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:24.725640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 937/1849] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:24.734266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c99e43-f45e-4c08-a269-8a53dc8c9b32 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:24.734565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c99e43-f45e-4c08-a269-8a53dc8c9b32 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:24.735039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c99e43-f45e-4c08-a269-8a53dc8c9b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:24.755914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-42c99e43-f45e-4c08-a269-8a53dc8c9b32 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:24.757134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-42c99e43-f45e-4c08-a269-8a53dc8c9b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:24.765309 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 938/1850] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:24.769514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c99e43-f45e-4c08-a269-8a53dc8c9b32 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:24.779366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c99e43-f45e-4c08-a269-8a53dc8c9b32 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:24.784025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e10a7-94d5-4574-b9ac-0831aef805ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:24.784758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e10a7-94d5-4574-b9ac-0831aef805ff admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:24.785042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e10a7-94d5-4574-b9ac-0831aef805ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:24.785314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e10a7-94d5-4574-b9ac-0831aef805ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:24.785963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e10a7-94d5-4574-b9ac-0831aef805ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:24.786267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e10a7-94d5-4574-b9ac-0831aef805ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:24.787907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e10a7-94d5-4574-b9ac-0831aef805ff admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:24.801087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 939/1851] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:18:24.805178 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e10a7-94d5-4574-b9ac-0831aef805ff admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:24.815215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e10a7-94d5-4574-b9ac-0831aef805ff admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:24.820090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae6e7b-762c-441d-a236-516e807f5f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:24.820692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae6e7b-762c-441d-a236-516e807f5f94 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:24.821049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae6e7b-762c-441d-a236-516e807f5f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:24.821286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae6e7b-762c-441d-a236-516e807f5f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:24.821944 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae6e7b-762c-441d-a236-516e807f5f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:24.823874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae6e7b-762c-441d-a236-516e807f5f94 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:24.849639 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ad556e5a-ed10-49e5-bdba-a43c0e472536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08376f8a89974dfa994372462d3e3b2b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:24.850388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ad556e5a-ed10-49e5-bdba-a43c0e472536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08376f8a89974dfa994372462d3e3b2b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:24.919345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 940/1852] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:24 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:24.923275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae6e7b-762c-441d-a236-516e807f5f94 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:24.974654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ad556e5a-ed10-49e5-bdba-a43c0e472536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08376f8a89974dfa994372462d3e3b2b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:24.975709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ad556e5a-ed10-49e5-bdba-a43c0e472536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08376f8a89974dfa994372462d3e3b2b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:24.984540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ad556e5a-ed10-49e5-bdba-a43c0e472536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08376f8a89974dfa994372462d3e3b2b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:24.990885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae6e7b-762c-441d-a236-516e807f5f94 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:24.996242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132cbc1-9865-49cc-8ec2-f6deb49743c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:24.996975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132cbc1-9865-49cc-8ec2-f6deb49743c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:24.997256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132cbc1-9865-49cc-8ec2-f6deb49743c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:24.997527 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132cbc1-9865-49cc-8ec2-f6deb49743c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:24.998165 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132cbc1-9865-49cc-8ec2-f6deb49743c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:25.000114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132cbc1-9865-49cc-8ec2-f6deb49743c0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:25.007066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 913/1853] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:24 2022] DELETE /identity/v3/users/08376f8a89974dfa994372462d3e3b2b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:25.011508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6cb11-65c4-4c4b-b7a5-48dff46f8b42 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:25.012000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6cb11-65c4-4c4b-b7a5-48dff46f8b42 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:25.012136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6cb11-65c4-4c4b-b7a5-48dff46f8b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:25.033027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3fe6cb11-65c4-4c4b-b7a5-48dff46f8b42 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:25.034235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3fe6cb11-65c4-4c4b-b7a5-48dff46f8b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:25.093648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 914/1854] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:25.103069 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6cb11-65c4-4c4b-b7a5-48dff46f8b42 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:25.104430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3fe6cb11-65c4-4c4b-b7a5-48dff46f8b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:25.135426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 941/1855] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:24 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:25.139646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132cbc1-9865-49cc-8ec2-f6deb49743c0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:25.141295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d132cbc1-9865-49cc-8ec2-f6deb49743c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:25.153541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132cbc1-9865-49cc-8ec2-f6deb49743c0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:25.160212 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea9601-d1c7-4e03-a360-035549e1eb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:25.160825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea9601-d1c7-4e03-a360-035549e1eb3c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:25.161722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea9601-d1c7-4e03-a360-035549e1eb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:25.162002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea9601-d1c7-4e03-a360-035549e1eb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:25.162648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea9601-d1c7-4e03-a360-035549e1eb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:25.164643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea9601-d1c7-4e03-a360-035549e1eb3c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:25.169610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6cb11-65c4-4c4b-b7a5-48dff46f8b42 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:25.176601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08f36e-f101-48b2-8f29-a578d2341d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:25.176601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08f36e-f101-48b2-8f29-a578d2341d75 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:25.176601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08f36e-f101-48b2-8f29-a578d2341d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:25.176601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08f36e-f101-48b2-8f29-a578d2341d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:25.177413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 942/1856] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:25.180641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea9601-d1c7-4e03-a360-035549e1eb3c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:25.189541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08f36e-f101-48b2-8f29-a578d2341d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:25.191064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08f36e-f101-48b2-8f29-a578d2341d75 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:25.191994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea9601-d1c7-4e03-a360-035549e1eb3c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:25.197479 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df1b01-1179-4f97-ad49-e5904ae580b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:25.198087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df1b01-1179-4f97-ad49-e5904ae580b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:25.198366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df1b01-1179-4f97-ad49-e5904ae580b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:25.198640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df1b01-1179-4f97-ad49-e5904ae580b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:25.199309 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df1b01-1179-4f97-ad49-e5904ae580b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:25.201780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df1b01-1179-4f97-ad49-e5904ae580b2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:25.202538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 915/1857] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:25.213887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 943/1858] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:25.218462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08f36e-f101-48b2-8f29-a578d2341d75 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:25.228123 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08f36e-f101-48b2-8f29-a578d2341d75 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:25.233079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf1484-d288-4c1b-a162-ee7b160499c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:25.233730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf1484-d288-4c1b-a162-ee7b160499c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:25.233999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf1484-d288-4c1b-a162-ee7b160499c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:25.234265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf1484-d288-4c1b-a162-ee7b160499c9 admin admin] PATH_INFO: `/v3/projects/f353c1c519f841b2bbd9c6bb2d39cf9a/users/83bd8ca4217f4ac683cf13c5d116bd1a/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:25.250639 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf1484-d288-4c1b-a162-ee7b160499c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f353c1c519f841b2bbd9c6bb2d39cf9a, user_id=83bd8ca4217f4ac683cf13c5d116bd1a, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:25.253495 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf1484-d288-4c1b-a162-ee7b160499c9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:25.352258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 916/1859] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:25 2022] PUT /identity/v3/projects/f353c1c519f841b2bbd9c6bb2d39cf9a/users/83bd8ca4217f4ac683cf13c5d116bd1a/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:25.364071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728af1b7-1c32-42e5-acbd-6d96a646e56d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:25.364356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728af1b7-1c32-42e5-acbd-6d96a646e56d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:25.364631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728af1b7-1c32-42e5-acbd-6d96a646e56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:25.427073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-728af1b7-1c32-42e5-acbd-6d96a646e56d None None] MFA Rules not processed for user `83bd8ca4217f4ac683cf13c5d116bd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:25.429109 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-728af1b7-1c32-42e5-acbd-6d96a646e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:25.524143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 944/1860] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:25.525705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf1484-d288-4c1b-a162-ee7b160499c9 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:25.607808 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf1484-d288-4c1b-a162-ee7b160499c9 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:25.613060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91ef13-0bf5-416d-b85c-db7e86f7bae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:25.613684 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91ef13-0bf5-416d-b85c-db7e86f7bae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:25.613964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91ef13-0bf5-416d-b85c-db7e86f7bae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:25.614236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91ef13-0bf5-416d-b85c-db7e86f7bae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:25.614912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91ef13-0bf5-416d-b85c-db7e86f7bae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:25.617370 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91ef13-0bf5-416d-b85c-db7e86f7bae4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:25.629742 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728af1b7-1c32-42e5-acbd-6d96a646e56d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:25.631536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-728af1b7-1c32-42e5-acbd-6d96a646e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:25.658865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728af1b7-1c32-42e5-acbd-6d96a646e56d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:25.683615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:25.684282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:25.684557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:25.684881 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] PATH_INFO: `/v3/projects/d37c1e85c4914145bd853cf80093526a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:25.689446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37c1e85c4914145bd853cf80093526a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:25.693178 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:25.739050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:25.804708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 917/1861] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:25 2022] POST /identity/v3/projects => generated 373 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:25.808721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91ef13-0bf5-416d-b85c-db7e86f7bae4 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:25.856012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37c1e85c4914145bd853cf80093526a', 'request_id': 'req-a5c8700b-8732-4b28-a7d1-a076f841efbe'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:25.863517 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37c1e85c4914145bd853cf80093526a', 'request_id': 'req-a5c8700b-8732-4b28-a7d1-a076f841efbe'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:25.870745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37c1e85c4914145bd853cf80093526a', 'request_id': 'req-a5c8700b-8732-4b28-a7d1-a076f841efbe'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:25.888788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91ef13-0bf5-416d-b85c-db7e86f7bae4 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:25.946968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b44b9-4734-49d9-9e7c-c6d16b238d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:25.947643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b44b9-4734-49d9-9e7c-c6d16b238d1d admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:25.950048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b44b9-4734-49d9-9e7c-c6d16b238d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:25.950470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b44b9-4734-49d9-9e7c-c6d16b238d1d admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:25.961158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b44b9-4734-49d9-9e7c-c6d16b238d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:25.961466 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] The token cache is being invalidate because project d37c1e85c4914145bd853cf80093526a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:25.961466 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:25.961675 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b44b9-4734-49d9-9e7c-c6d16b238d1d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:25.961761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:25.961761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 945/1862] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:25 2022] DELETE /identity/v3/projects/d37c1e85c4914145bd853cf80093526a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:25.961761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:25.961761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:25.974423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8700b-8732-4b28-a7d1-a076f841efbe admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:25.979424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:25.980233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:25.981613 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:25.982704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:25.983045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] PATH_INFO: `/v3/users/6663021e6c9a4216a2f6de8d0ef162ce` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:25.984262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6663021e6c9a4216a2f6de8d0ef162ce)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:25.986197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:26.073179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 918/1863] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:25 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:26.074336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b44b9-4734-49d9-9e7c-c6d16b238d1d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:26.075923 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dc0b44b9-4734-49d9-9e7c-c6d16b238d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:26.087179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b44b9-4734-49d9-9e7c-c6d16b238d1d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:26.093720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef590b6-88ba-434e-90d9-a2ac9e8898d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:26.094312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef590b6-88ba-434e-90d9-a2ac9e8898d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:26.094590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef590b6-88ba-434e-90d9-a2ac9e8898d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:26.094995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef590b6-88ba-434e-90d9-a2ac9e8898d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:26.095572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef590b6-88ba-434e-90d9-a2ac9e8898d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:26.097320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef590b6-88ba-434e-90d9-a2ac9e8898d4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:26.108260 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 919/1864] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:26.112336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef590b6-88ba-434e-90d9-a2ac9e8898d4 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:26.122606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef590b6-88ba-434e-90d9-a2ac9e8898d4 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:26.127842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ecce5-328f-43dc-bfa4-64a435746427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:26.128588 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ecce5-328f-43dc-bfa4-64a435746427 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:26.128866 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ecce5-328f-43dc-bfa4-64a435746427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:26.129135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ecce5-328f-43dc-bfa4-64a435746427 admin admin] PATH_INFO: `/v3/projects/63de3bc62c904d9eb6f338343c5122f8/users/69818c0194f94863bf338753fb6b52bf/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:26.144292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ecce5-328f-43dc-bfa4-64a435746427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63de3bc62c904d9eb6f338343c5122f8, user_id=69818c0194f94863bf338753fb6b52bf, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:26.147013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ecce5-328f-43dc-bfa4-64a435746427 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:26.211284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6663021e6c9a4216a2f6de8d0ef162ce'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:26.211898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6663021e6c9a4216a2f6de8d0ef162ce'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:26.281459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6663021e6c9a4216a2f6de8d0ef162ce'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:26.282149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6663021e6c9a4216a2f6de8d0ef162ce'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:26.288431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 920/1865] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:26 2022] PUT /identity/v3/projects/63de3bc62c904d9eb6f338343c5122f8/users/69818c0194f94863bf338753fb6b52bf/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:26.293424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6663021e6c9a4216a2f6de8d0ef162ce'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:26.293802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ecce5-328f-43dc-bfa4-64a435746427 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:26.297205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-fb1ecce5-328f-43dc-bfa4-64a435746427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:26.317969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 946/1866] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:25 2022] DELETE /identity/v3/users/6663021e6c9a4216a2f6de8d0ef162ce => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:26.390783 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ecce5-328f-43dc-bfa4-64a435746427 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:26.465817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7679a8-2276-438a-9c1d-ea88aa48f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:26.467385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7679a8-2276-438a-9c1d-ea88aa48f7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:26.467567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7679a8-2276-438a-9c1d-ea88aa48f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:26.467844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7679a8-2276-438a-9c1d-ea88aa48f7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:26.468491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7679a8-2276-438a-9c1d-ea88aa48f7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:26.470156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7679a8-2276-438a-9c1d-ea88aa48f7b0 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:26.482576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 921/1867] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:26.486348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:26.496675 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9153d26-604f-4ef7-ada4-1e9ba6a84c14 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:26.502002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc4a76-e0a4-49c5-959b-476bbde3aaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:26.502872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc4a76-e0a4-49c5-959b-476bbde3aaef admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:26.503214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc4a76-e0a4-49c5-959b-476bbde3aaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:26.503449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc4a76-e0a4-49c5-959b-476bbde3aaef admin admin] PATH_INFO: `/v3/projects/63de3bc62c904d9eb6f338343c5122f8/users/69818c0194f94863bf338753fb6b52bf/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:26.504780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7679a8-2276-438a-9c1d-ea88aa48f7b0 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:26.506167 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc4a76-e0a4-49c5-959b-476bbde3aaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=63de3bc62c904d9eb6f338343c5122f8, user_id=69818c0194f94863bf338753fb6b52bf, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:26.506856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ad7679a8-2276-438a-9c1d-ea88aa48f7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:26.509333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc4a76-e0a4-49c5-959b-476bbde3aaef admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:26.521197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 947/1868] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:26 2022] PUT /identity/v3/projects/63de3bc62c904d9eb6f338343c5122f8/users/69818c0194f94863bf338753fb6b52bf/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:26.522090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7679a8-2276-438a-9c1d-ea88aa48f7b0 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:26.532069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b3e5-de60-4104-81a4-df338c226332 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:26.532543 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b3e5-de60-4104-81a4-df338c226332 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:26.532879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b3e5-de60-4104-81a4-df338c226332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:26.567358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7243b3e5-de60-4104-81a4-df338c226332 None None] MFA Rules not processed for user `69818c0194f94863bf338753fb6b52bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:26.568590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7243b3e5-de60-4104-81a4-df338c226332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:26.615477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:26.618369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:26.618709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:26.619082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] PATH_INFO: `/v3/users/73c344359b834b9faa3cb779fd96bf4f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:26.620977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c344359b834b9faa3cb779fd96bf4f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:26.624437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:26.685939 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 948/1869] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:26.695297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b3e5-de60-4104-81a4-df338c226332 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:26.696827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7243b3e5-de60-4104-81a4-df338c226332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:26.773201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b3e5-de60-4104-81a4-df338c226332 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:26.777904 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb961f3-b068-49e0-976f-82411e2d3491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:26.778965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb961f3-b068-49e0-976f-82411e2d3491 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:26.779403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb961f3-b068-49e0-976f-82411e2d3491 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:26.779776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb961f3-b068-49e0-976f-82411e2d3491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:26.791831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb961f3-b068-49e0-976f-82411e2d3491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:26.793627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb961f3-b068-49e0-976f-82411e2d3491 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:26.803836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 949/1870] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:26.805199 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af44b2-afbf-4f84-acf2-79f9ce730218 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:26.805488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af44b2-afbf-4f84-acf2-79f9ce730218 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:26.805771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af44b2-afbf-4f84-acf2-79f9ce730218 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:26.807056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 950/1871] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:18:26.817613 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6428a4-ded9-42ed-ba51-ab5c01aaa7ee None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:26.817900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6428a4-ded9-42ed-ba51-ab5c01aaa7ee None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:26.818178 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6428a4-ded9-42ed-ba51-ab5c01aaa7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:26.838659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5b6428a4-ded9-42ed-ba51-ab5c01aaa7ee None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:26.839580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5b6428a4-ded9-42ed-ba51-ab5c01aaa7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:26.853053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c344359b834b9faa3cb779fd96bf4f'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:26.857639 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c344359b834b9faa3cb779fd96bf4f'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:26.928193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 951/1872] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:26.937854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6428a4-ded9-42ed-ba51-ab5c01aaa7ee None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:26.937854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5b6428a4-ded9-42ed-ba51-ab5c01aaa7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:26.955290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6428a4-ded9-42ed-ba51-ab5c01aaa7ee None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:26.961640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:26.962618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:26.962887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:26.968547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] PATH_INFO: `/v3/projects/a56ea00367634baba7368be4d72e893b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:26.968547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56ea00367634baba7368be4d72e893b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:26.968547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:26.989161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c344359b834b9faa3cb779fd96bf4f'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:26.989897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c344359b834b9faa3cb779fd96bf4f'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:26.999562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c344359b834b9faa3cb779fd96bf4f'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:27.022782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 922/1873] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:26 2022] DELETE /identity/v3/users/73c344359b834b9faa3cb779fd96bf4f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:27.025888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:27.026918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:27.112464 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4a4db-e72d-47b8-b701-2ad251791a8c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:27.119501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d94df8-5916-4bb2-a6c3-a337a6407731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:27.120481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d94df8-5916-4bb2-a6c3-a337a6407731 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.120767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d94df8-5916-4bb2-a6c3-a337a6407731 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.121049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d94df8-5916-4bb2-a6c3-a337a6407731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.124095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d5d94df8-5916-4bb2-a6c3-a337a6407731 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:27.135583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56ea00367634baba7368be4d72e893b', 'request_id': 'req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:27.142799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56ea00367634baba7368be4d72e893b', 'request_id': 'req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:27.144177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d94df8-5916-4bb2-a6c3-a337a6407731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:27.145888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d94df8-5916-4bb2-a6c3-a337a6407731 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:27.152651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56ea00367634baba7368be4d72e893b', 'request_id': 'req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:27.157211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 923/1874] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:27.158493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc672f5-db23-4e3f-8132-6d66cfd0ab13 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.158840 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc672f5-db23-4e3f-8132-6d66cfd0ab13 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.159336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc672f5-db23-4e3f-8132-6d66cfd0ab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.203101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0cc672f5-db23-4e3f-8132-6d66cfd0ab13 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:27.204585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0cc672f5-db23-4e3f-8132-6d66cfd0ab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:27.214235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:27.252559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] The token cache is being invalidate because project a56ea00367634baba7368be4d72e893b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:27.252559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:27.253294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5f08d3f4-f1db-4bf2-b00b-680922dcb2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:27.256389 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 952/1875] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:26 2022] DELETE /identity/v3/projects/a56ea00367634baba7368be4d72e893b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:27.260798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe9459-0c54-4b76-b0ba-8f504076e897 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.263221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe9459-0c54-4b76-b0ba-8f504076e897 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.263221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe9459-0c54-4b76-b0ba-8f504076e897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.294722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-38fe9459-0c54-4b76-b0ba-8f504076e897 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:27.296284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-38fe9459-0c54-4b76-b0ba-8f504076e897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:27.331900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 924/1876] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:27.339270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc672f5-db23-4e3f-8132-6d66cfd0ab13 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:27.340956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0cc672f5-db23-4e3f-8132-6d66cfd0ab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:27.398253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:27.415516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 953/1877] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:27.430316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc672f5-db23-4e3f-8132-6d66cfd0ab13 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:27.436433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a432-1900-4ef1-a52b-0ce72522b0a7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.436433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a432-1900-4ef1-a52b-0ce72522b0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.436433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1a432-1900-4ef1-a52b-0ce72522b0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.436728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8ed15-0953-48e9-86dc-5e9ccec70736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:27.436728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8ed15-0953-48e9-86dc-5e9ccec70736 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.437028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8ed15-0953-48e9-86dc-5e9ccec70736 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.437215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8ed15-0953-48e9-86dc-5e9ccec70736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.447750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8ed15-0953-48e9-86dc-5e9ccec70736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:27.449206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8ed15-0953-48e9-86dc-5e9ccec70736 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:27.467550 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3ef1a432-1900-4ef1-a52b-0ce72522b0a7 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:27.469305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3ef1a432-1900-4ef1-a52b-0ce72522b0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:27.471508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 925/1878] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:27.479711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 954/1879] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:27.484437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8ed15-0953-48e9-86dc-5e9ccec70736 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:27.497795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8ed15-0953-48e9-86dc-5e9ccec70736 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:27.503563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463713cc-3daf-43ab-b79a-f77dc4e0cef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:27.504424 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463713cc-3daf-43ab-b79a-f77dc4e0cef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.504840 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463713cc-3daf-43ab-b79a-f77dc4e0cef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.505184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463713cc-3daf-43ab-b79a-f77dc4e0cef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.505962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463713cc-3daf-43ab-b79a-f77dc4e0cef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:27.506368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463713cc-3daf-43ab-b79a-f77dc4e0cef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:27.507978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463713cc-3daf-43ab-b79a-f77dc4e0cef6 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:27.524070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 926/1880] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:18:27.533714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1a432-1900-4ef1-a52b-0ce72522b0a7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:27.538813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1a432-1900-4ef1-a52b-0ce72522b0a7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:27.548001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38537bbc-d35f-49a8-98b1-d4835c71f61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:27.549183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38537bbc-d35f-49a8-98b1-d4835c71f61f admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.550095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38537bbc-d35f-49a8-98b1-d4835c71f61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.550095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38537bbc-d35f-49a8-98b1-d4835c71f61f admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.550546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38537bbc-d35f-49a8-98b1-d4835c71f61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:27.552832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38537bbc-d35f-49a8-98b1-d4835c71f61f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:27.684491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 955/1881] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:27 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:27.689358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463713cc-3daf-43ab-b79a-f77dc4e0cef6 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:27.699228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463713cc-3daf-43ab-b79a-f77dc4e0cef6 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:27.746380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38537bbc-d35f-49a8-98b1-d4835c71f61f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:27.748921 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-38537bbc-d35f-49a8-98b1-d4835c71f61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:27.765052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cfc45-1be3-4f3f-9fce-9a8b7dce411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:27.766322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cfc45-1be3-4f3f-9fce-9a8b7dce411e admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.766725 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cfc45-1be3-4f3f-9fce-9a8b7dce411e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.767104 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cfc45-1be3-4f3f-9fce-9a8b7dce411e admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.767893 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cfc45-1be3-4f3f-9fce-9a8b7dce411e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:27.770362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cfc45-1be3-4f3f-9fce-9a8b7dce411e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:27.815566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38537bbc-d35f-49a8-98b1-d4835c71f61f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:27.819435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204be572-03a0-4b19-a4cf-49af0c222eb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:27.820130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204be572-03a0-4b19-a4cf-49af0c222eb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.820483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204be572-03a0-4b19-a4cf-49af0c222eb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.820828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204be572-03a0-4b19-a4cf-49af0c222eb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.823371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-204be572-03a0-4b19-a4cf-49af0c222eb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:27.870170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 927/1882] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:27 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:27.874851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cfc45-1be3-4f3f-9fce-9a8b7dce411e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:27.885752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cfc45-1be3-4f3f-9fce-9a8b7dce411e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:27.888876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204be572-03a0-4b19-a4cf-49af0c222eb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:27.890437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204be572-03a0-4b19-a4cf-49af0c222eb6 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:27.891091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e3a0e-711b-4c76-9bd0-71a48fdc1aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:27.891634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e3a0e-711b-4c76-9bd0-71a48fdc1aef admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.891920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e3a0e-711b-4c76-9bd0-71a48fdc1aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.892307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e3a0e-711b-4c76-9bd0-71a48fdc1aef admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.892959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e3a0e-711b-4c76-9bd0-71a48fdc1aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:27.894703 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e3a0e-711b-4c76-9bd0-71a48fdc1aef admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:27.901838 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 956/1883] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:27.906115 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 928/1884] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:27.910568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204be572-03a0-4b19-a4cf-49af0c222eb6 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:27.924300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204be572-03a0-4b19-a4cf-49af0c222eb6 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:27.929154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccdbc1-fc7e-4563-bb6e-0fcc270c761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:27.929795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccdbc1-fc7e-4563-bb6e-0fcc270c761f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.930076 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccdbc1-fc7e-4563-bb6e-0fcc270c761f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.930345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccdbc1-fc7e-4563-bb6e-0fcc270c761f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.931020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cccdbc1-fc7e-4563-bb6e-0fcc270c761f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:27.932621 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cccdbc1-fc7e-4563-bb6e-0fcc270c761f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:27.943673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 957/1885] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:27.948193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e3a0e-711b-4c76-9bd0-71a48fdc1aef admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:27.958526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e3a0e-711b-4c76-9bd0-71a48fdc1aef admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:27.963369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed6c09-fef9-47d4-89cd-daf204582b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:27.964020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed6c09-fef9-47d4-89cd-daf204582b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:27.964301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed6c09-fef9-47d4-89cd-daf204582b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:27.964567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed6c09-fef9-47d4-89cd-daf204582b02 admin admin] PATH_INFO: `/v3/projects/04fbfd6109b8464faa57709624c4b7f1/users/2f1f8be15d1c49b2b18af4e5bedce7f5/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:27.979139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed6c09-fef9-47d4-89cd-daf204582b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04fbfd6109b8464faa57709624c4b7f1, user_id=2f1f8be15d1c49b2b18af4e5bedce7f5, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:27.982312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed6c09-fef9-47d4-89cd-daf204582b02 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:28.047233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccdbc1-fc7e-4563-bb6e-0fcc270c761f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:28.049649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7cccdbc1-fc7e-4563-bb6e-0fcc270c761f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:28.063677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccdbc1-fc7e-4563-bb6e-0fcc270c761f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:28.068337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:28.070049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:28.070049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:28.070049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] PATH_INFO: `/v3/projects/719d45dae7d541bbba91ee0aaaa54741` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:28.070973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=719d45dae7d541bbba91ee0aaaa54741)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:28.073793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:28.105103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 929/1886] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:27 2022] PUT /identity/v3/projects/04fbfd6109b8464faa57709624c4b7f1/users/2f1f8be15d1c49b2b18af4e5bedce7f5/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:28.105103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed6c09-fef9-47d4-89cd-daf204582b02 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:28.109983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a6ed6c09-fef9-47d4-89cd-daf204582b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:28.197596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed6c09-fef9-47d4-89cd-daf204582b02 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:28.224290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719d45dae7d541bbba91ee0aaaa54741', 'request_id': 'req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.230637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719d45dae7d541bbba91ee0aaaa54741', 'request_id': 'req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.240519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719d45dae7d541bbba91ee0aaaa54741', 'request_id': 'req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.263231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:28.263807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:28.264081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:28.264350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] PATH_INFO: `/v3/users/83bd8ca4217f4ac683cf13c5d116bd1a` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:28.265490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bd8ca4217f4ac683cf13c5d116bd1a)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:28.267604 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:28.355003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] The token cache is being invalidate because project 719d45dae7d541bbba91ee0aaaa54741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:28.355540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.356370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b1a4cb70-61b1-43d6-bbd1-bde51cad72bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.359359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 958/1887] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:28 2022] DELETE /identity/v3/projects/719d45dae7d541bbba91ee0aaaa54741 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:28.360908 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3e980-ca46-4ce7-b447-b34774ab4890 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:28.361367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3e980-ca46-4ce7-b447-b34774ab4890 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:28.361763 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3e980-ca46-4ce7-b447-b34774ab4890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:28.399372 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b0e3e980-ca46-4ce7-b447-b34774ab4890 None None] MFA Rules not processed for user `2f1f8be15d1c49b2b18af4e5bedce7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:28.400927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b0e3e980-ca46-4ce7-b447-b34774ab4890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:28.502608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 959/1888] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:28.505938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3e980-ca46-4ce7-b447-b34774ab4890 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:28.505938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b0e3e980-ca46-4ce7-b447-b34774ab4890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:28.519929 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3e980-ca46-4ce7-b447-b34774ab4890 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:28.535993 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc63988-79b1-474b-ae15-89823c97b532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:28.536678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc63988-79b1-474b-ae15-89823c97b532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:28.536956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc63988-79b1-474b-ae15-89823c97b532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:28.537337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc63988-79b1-474b-ae15-89823c97b532 admin admin] PATH_INFO: `/v3/users/af95bf8e77b4417d9313d5b47920e989` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:28.538723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc63988-79b1-474b-ae15-89823c97b532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af95bf8e77b4417d9313d5b47920e989)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:28.548755 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc63988-79b1-474b-ae15-89823c97b532 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:28.553362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bd8ca4217f4ac683cf13c5d116bd1a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.554083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bd8ca4217f4ac683cf13c5d116bd1a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.619453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:28.647762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bd8ca4217f4ac683cf13c5d116bd1a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.648272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bd8ca4217f4ac683cf13c5d116bd1a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.657060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bd8ca4217f4ac683cf13c5d116bd1a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.685335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 930/1889] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:28 2022] DELETE /identity/v3/users/83bd8ca4217f4ac683cf13c5d116bd1a => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:28.686263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:28.687796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:28.767130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bcc63988-79b1-474b-ae15-89823c97b532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af95bf8e77b4417d9313d5b47920e989'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.768148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bcc63988-79b1-474b-ae15-89823c97b532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af95bf8e77b4417d9313d5b47920e989'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.770869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc74994-1b12-4060-b92f-7ff6880f2d77 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:28.776793 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbb32e-fa50-4146-93f4-24cfe21d7e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:28.777507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbb32e-fa50-4146-93f4-24cfe21d7e72 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:28.777801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbb32e-fa50-4146-93f4-24cfe21d7e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:28.778052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbb32e-fa50-4146-93f4-24cfe21d7e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:28.779336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbb32e-fa50-4146-93f4-24cfe21d7e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:28.781296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbb32e-fa50-4146-93f4-24cfe21d7e72 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:28.818876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:28.842295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bcc63988-79b1-474b-ae15-89823c97b532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af95bf8e77b4417d9313d5b47920e989'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.843077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bcc63988-79b1-474b-ae15-89823c97b532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af95bf8e77b4417d9313d5b47920e989'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.851217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bcc63988-79b1-474b-ae15-89823c97b532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af95bf8e77b4417d9313d5b47920e989'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:28.870697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 960/1890] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:28 2022] DELETE /identity/v3/users/af95bf8e77b4417d9313d5b47920e989 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:28.872151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963755-cd6d-46d9-bf74-8248ee59fa1b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:28.872502 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963755-cd6d-46d9-bf74-8248ee59fa1b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:28.872847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963755-cd6d-46d9-bf74-8248ee59fa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:28.889752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 931/1891] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:28 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:28.890946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbb32e-fa50-4146-93f4-24cfe21d7e72 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:28.892819 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-37cbb32e-fa50-4146-93f4-24cfe21d7e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:28.898898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e5963755-cd6d-46d9-bf74-8248ee59fa1b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:28.900713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e5963755-cd6d-46d9-bf74-8248ee59fa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:28.975566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbb32e-fa50-4146-93f4-24cfe21d7e72 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:28.983049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810562f0-d8fe-4c00-9ddb-287c5a859587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:28.983760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810562f0-d8fe-4c00-9ddb-287c5a859587 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:28.984172 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810562f0-d8fe-4c00-9ddb-287c5a859587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:28.984645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810562f0-d8fe-4c00-9ddb-287c5a859587 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:28.985179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810562f0-d8fe-4c00-9ddb-287c5a859587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:28.987643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810562f0-d8fe-4c00-9ddb-287c5a859587 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:29.000890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 961/1892] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:29.010653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5963755-cd6d-46d9-bf74-8248ee59fa1b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:29.012037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e5963755-cd6d-46d9-bf74-8248ee59fa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:29.070566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5963755-cd6d-46d9-bf74-8248ee59fa1b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:29.080253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 932/1893] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:28 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:29.082385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2de4af-2c4a-4fdd-8663-84449c0a6015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:29.083046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2de4af-2c4a-4fdd-8663-84449c0a6015 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:29.083778 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2de4af-2c4a-4fdd-8663-84449c0a6015 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:29.083778 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2de4af-2c4a-4fdd-8663-84449c0a6015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:29.086183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810562f0-d8fe-4c00-9ddb-287c5a859587 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:29.098713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2de4af-2c4a-4fdd-8663-84449c0a6015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:29.100169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2de4af-2c4a-4fdd-8663-84449c0a6015 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:29.101130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810562f0-d8fe-4c00-9ddb-287c5a859587 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:29.107434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0796598-e349-4051-b48d-0f34d2adb6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:29.108052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0796598-e349-4051-b48d-0f34d2adb6cf admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:29.108328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0796598-e349-4051-b48d-0f34d2adb6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:29.108595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0796598-e349-4051-b48d-0f34d2adb6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:29.109279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0796598-e349-4051-b48d-0f34d2adb6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:29.111019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0796598-e349-4051-b48d-0f34d2adb6cf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:29.114192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 962/1894] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:29.125545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 933/1895] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:29.126805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2de4af-2c4a-4fdd-8663-84449c0a6015 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:29.139019 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2de4af-2c4a-4fdd-8663-84449c0a6015 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:29.145695 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85339dd8-11ae-4dd7-9789-dc5e85a0266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:29.148874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339dd8-11ae-4dd7-9789-dc5e85a0266a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:29.149371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339dd8-11ae-4dd7-9789-dc5e85a0266a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:29.150243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339dd8-11ae-4dd7-9789-dc5e85a0266a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:29.151167 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85339dd8-11ae-4dd7-9789-dc5e85a0266a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:29.154461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85339dd8-11ae-4dd7-9789-dc5e85a0266a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:29.173877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 963/1896] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:29.177452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0796598-e349-4051-b48d-0f34d2adb6cf admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:29.203925 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0796598-e349-4051-b48d-0f34d2adb6cf admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:29.218964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971f29a-720d-4db4-b4b1-f3e797488734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:29.219663 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971f29a-720d-4db4-b4b1-f3e797488734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:29.219976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971f29a-720d-4db4-b4b1-f3e797488734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:29.220338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971f29a-720d-4db4-b4b1-f3e797488734 admin admin] PATH_INFO: `/v3/projects/59ffbaf73cc946168958f6c84592b29e/users/63255abedcc340abacc4b347e6781cbc/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:29.240313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971f29a-720d-4db4-b4b1-f3e797488734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ffbaf73cc946168958f6c84592b29e, user_id=63255abedcc340abacc4b347e6781cbc, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:29.249963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971f29a-720d-4db4-b4b1-f3e797488734 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:29.353256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 934/1897] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:29 2022] PUT /identity/v3/projects/59ffbaf73cc946168958f6c84592b29e/users/63255abedcc340abacc4b347e6781cbc/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:29.365672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8be8-d2da-4f07-a951-6d1f79854b82 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:29.366300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8be8-d2da-4f07-a951-6d1f79854b82 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:29.366780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8be8-d2da-4f07-a951-6d1f79854b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:29.398846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-011f8be8-d2da-4f07-a951-6d1f79854b82 None None] MFA Rules not processed for user `63255abedcc340abacc4b347e6781cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:29.400317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-011f8be8-d2da-4f07-a951-6d1f79854b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:29.465934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971f29a-720d-4db4-b4b1-f3e797488734 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:29.467168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5971f29a-720d-4db4-b4b1-f3e797488734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:29.501156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 964/1898] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:29.506102 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8be8-d2da-4f07-a951-6d1f79854b82 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:29.565044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:29.658565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971f29a-720d-4db4-b4b1-f3e797488734 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:29.667186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:29.668740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:29.669838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:29.670255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] PATH_INFO: `/v3/projects/b745a9f3e44d4050b33fd8dfccbb139a` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:29.671962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b745a9f3e44d4050b33fd8dfccbb139a)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:29.676054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:29.711630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8be8-d2da-4f07-a951-6d1f79854b82 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:29.731067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc7281-1fbb-469c-a631-ac617c1953c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:29.732664 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc7281-1fbb-469c-a631-ac617c1953c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:29.733033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc7281-1fbb-469c-a631-ac617c1953c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:29.733505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc7281-1fbb-469c-a631-ac617c1953c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:29.734557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc7281-1fbb-469c-a631-ac617c1953c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:29.736806 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc7281-1fbb-469c-a631-ac617c1953c4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:29.894215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 965/1899] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:29 2022] POST /identity/v3/projects => generated 385 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:29.896080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc7281-1fbb-469c-a631-ac617c1953c4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:29.899052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8ddc7281-1fbb-469c-a631-ac617c1953c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:29.908879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b745a9f3e44d4050b33fd8dfccbb139a', 'request_id': 'req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:29.915344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b745a9f3e44d4050b33fd8dfccbb139a', 'request_id': 'req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:29.922735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b745a9f3e44d4050b33fd8dfccbb139a', 'request_id': 'req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:29.980190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc7281-1fbb-469c-a631-ac617c1953c4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:29.986030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:29.986708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:29.987002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:29.987270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] PATH_INFO: `/v3/projects/f353c1c519f841b2bbd9c6bb2d39cf9a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:29.988433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f353c1c519f841b2bbd9c6bb2d39cf9a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:29.990369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:30.043651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] The token cache is being invalidate because project b745a9f3e44d4050b33fd8dfccbb139a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:30.050018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.050018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.050018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 935/1900] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:29 2022] DELETE /identity/v3/projects/b745a9f3e44d4050b33fd8dfccbb139a => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:30.050018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:30.050018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:30.117654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:30.127004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f271e1-6071-4bf7-b8e6-67c8ee8cb630 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:30.140642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f353c1c519f841b2bbd9c6bb2d39cf9a', 'request_id': 'req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.147213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f353c1c519f841b2bbd9c6bb2d39cf9a', 'request_id': 'req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.154335 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f353c1c519f841b2bbd9c6bb2d39cf9a', 'request_id': 'req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.192885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdea97-70bd-43cd-8cb3-22cc69eb119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:30.193544 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdea97-70bd-43cd-8cb3-22cc69eb119a admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.193825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdea97-70bd-43cd-8cb3-22cc69eb119a admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.194083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdea97-70bd-43cd-8cb3-22cc69eb119a admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.194800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdea97-70bd-43cd-8cb3-22cc69eb119a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:30.196728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdea97-70bd-43cd-8cb3-22cc69eb119a admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:30.253127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] The token cache is being invalidate because project f353c1c519f841b2bbd9c6bb2d39cf9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:30.253422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.254130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4464204a-ecd5-45db-90e5-6cc67c9c4eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.255696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 966/1901] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:29 2022] DELETE /identity/v3/projects/f353c1c519f841b2bbd9c6bb2d39cf9a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:30.257182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7370e-b20d-4026-98e4-c9ac073fb379 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.257472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7370e-b20d-4026-98e4-c9ac073fb379 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.258202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7370e-b20d-4026-98e4-c9ac073fb379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.277382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a7a7370e-b20d-4026-98e4-c9ac073fb379 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:30.278631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a7a7370e-b20d-4026-98e4-c9ac073fb379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:30.297387 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 936/1902] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:30 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:30.297606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 967/1903] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:30.297707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdea97-70bd-43cd-8cb3-22cc69eb119a admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:30.299260 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-69cdea97-70bd-43cd-8cb3-22cc69eb119a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:30.301089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568d5cf-003d-474c-9df9-485e749aab7c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.301392 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568d5cf-003d-474c-9df9-485e749aab7c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.301665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568d5cf-003d-474c-9df9-485e749aab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.316274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdea97-70bd-43cd-8cb3-22cc69eb119a admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:30.322115 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:30.323014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.323296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.323720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] PATH_INFO: `/v3/users/69818c0194f94863bf338753fb6b52bf` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.324614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e568d5cf-003d-474c-9df9-485e749aab7c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:30.324888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69818c0194f94863bf338753fb6b52bf)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:30.325925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e568d5cf-003d-474c-9df9-485e749aab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:30.327433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:30.338275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 968/1904] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:30.338275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568d5cf-003d-474c-9df9-485e749aab7c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:30.338275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e568d5cf-003d-474c-9df9-485e749aab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:30.367251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568d5cf-003d-474c-9df9-485e749aab7c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:30.378000 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc640f4f-ffa4-4ecb-85af-e799b789ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:30.378000 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc640f4f-ffa4-4ecb-85af-e799b789ef00 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.378000 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc640f4f-ffa4-4ecb-85af-e799b789ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.378000 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc640f4f-ffa4-4ecb-85af-e799b789ef00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.378297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc640f4f-ffa4-4ecb-85af-e799b789ef00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:30.378297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc640f4f-ffa4-4ecb-85af-e799b789ef00 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:30.398048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 969/1905] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:30.399480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc640f4f-ffa4-4ecb-85af-e799b789ef00 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:30.410934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc640f4f-ffa4-4ecb-85af-e799b789ef00 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:30.416693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b123427-1af7-481f-a362-62441633d0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:30.417423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123427-1af7-481f-a362-62441633d0ba admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.418289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123427-1af7-481f-a362-62441633d0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.418761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123427-1af7-481f-a362-62441633d0ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.419982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b123427-1af7-481f-a362-62441633d0ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:30.420360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b123427-1af7-481f-a362-62441633d0ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:30.422689 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b123427-1af7-481f-a362-62441633d0ba admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:30.448388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 970/1906] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:30.448388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b123427-1af7-481f-a362-62441633d0ba admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:30.459170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b123427-1af7-481f-a362-62441633d0ba admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:30.463866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf441a-9300-4ce9-a552-c84a5851b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:30.464535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf441a-9300-4ce9-a552-c84a5851b189 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.467681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf441a-9300-4ce9-a552-c84a5851b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.467681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf441a-9300-4ce9-a552-c84a5851b189 admin admin] PATH_INFO: `/v3/projects/a26a677de3e8435f9fee6ea432bfcfa3/users/4baabec637a94b53818f0a00fd79759d/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.480193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf441a-9300-4ce9-a552-c84a5851b189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26a677de3e8435f9fee6ea432bfcfa3, user_id=4baabec637a94b53818f0a00fd79759d, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:30.483490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf441a-9300-4ce9-a552-c84a5851b189 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:30.567077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69818c0194f94863bf338753fb6b52bf'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.567767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69818c0194f94863bf338753fb6b52bf'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.568039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 971/1907] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:30 2022] PUT /identity/v3/projects/a26a677de3e8435f9fee6ea432bfcfa3/users/4baabec637a94b53818f0a00fd79759d/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:30.569339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf441a-9300-4ce9-a552-c84a5851b189 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:30.650754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf441a-9300-4ce9-a552-c84a5851b189 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:30.665614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1ddc9-2c1f-4b70-a137-988e5360460b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:30.666362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ddc9-2c1f-4b70-a137-988e5360460b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.666641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ddc9-2c1f-4b70-a137-988e5360460b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.667179 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1ddc9-2c1f-4b70-a137-988e5360460b admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.667818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1ddc9-2c1f-4b70-a137-988e5360460b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:30.670396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1ddc9-2c1f-4b70-a137-988e5360460b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:30.700388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69818c0194f94863bf338753fb6b52bf'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.701357 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69818c0194f94863bf338753fb6b52bf'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.709773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69818c0194f94863bf338753fb6b52bf'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:30.728899 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 937/1908] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:30 2022] DELETE /identity/v3/users/69818c0194f94863bf338753fb6b52bf => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:30.729763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:30.732120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:30.764526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 972/1909] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:30 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:30.765681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1ddc9-2c1f-4b70-a137-988e5360460b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:30.770596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d7d1ddc9-2c1f-4b70-a137-988e5360460b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:30.827538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc79aa9-1a87-4f88-bd26-c390a94cb466 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:30.874068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1ddc9-2c1f-4b70-a137-988e5360460b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:30.879664 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678fc6c-05ad-4eb9-be86-c6b80b41c96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:30.880289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678fc6c-05ad-4eb9-be86-c6b80b41c96b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.880615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678fc6c-05ad-4eb9-be86-c6b80b41c96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.880965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678fc6c-05ad-4eb9-be86-c6b80b41c96b admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.881673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678fc6c-05ad-4eb9-be86-c6b80b41c96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:30.883795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678fc6c-05ad-4eb9-be86-c6b80b41c96b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:30.906472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e67d0d-1829-4bc8-9258-f83ed274dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:30.907169 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67d0d-1829-4bc8-9258-f83ed274dd5b admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.907448 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67d0d-1829-4bc8-9258-f83ed274dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.907723 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67d0d-1829-4bc8-9258-f83ed274dd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.908369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e67d0d-1829-4bc8-9258-f83ed274dd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:30.910084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e67d0d-1829-4bc8-9258-f83ed274dd5b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:30.920618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 938/1910] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:30.924741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e67d0d-1829-4bc8-9258-f83ed274dd5b admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:30.934907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:30.935436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e67d0d-1829-4bc8-9258-f83ed274dd5b admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:30.939857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98719df7-e8c5-4e45-b859-51439d939c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:30.940512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98719df7-e8c5-4e45-b859-51439d939c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.945722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98719df7-e8c5-4e45-b859-51439d939c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.945722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98719df7-e8c5-4e45-b859-51439d939c9c admin admin] PATH_INFO: `/v3/projects/a26a677de3e8435f9fee6ea432bfcfa3/users/4baabec637a94b53818f0a00fd79759d/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.945722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98719df7-e8c5-4e45-b859-51439d939c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26a677de3e8435f9fee6ea432bfcfa3, user_id=4baabec637a94b53818f0a00fd79759d, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:30.945722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98719df7-e8c5-4e45-b859-51439d939c9c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:30.957001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 939/1911] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:30 2022] PUT /identity/v3/projects/a26a677de3e8435f9fee6ea432bfcfa3/users/4baabec637a94b53818f0a00fd79759d/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:30.967939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd856-8e66-4d8f-9f4b-55ab91c47dba None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:30.968232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd856-8e66-4d8f-9f4b-55ab91c47dba None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:30.968511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd856-8e66-4d8f-9f4b-55ab91c47dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:30.978401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 973/1912] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:30 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:30.982278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678fc6c-05ad-4eb9-be86-c6b80b41c96b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:30.994041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678fc6c-05ad-4eb9-be86-c6b80b41c96b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.006242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-cd1fd856-8e66-4d8f-9f4b-55ab91c47dba None None] MFA Rules not processed for user `4baabec637a94b53818f0a00fd79759d`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:31.007583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-cd1fd856-8e66-4d8f-9f4b-55ab91c47dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:31.085849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580d468-b491-4c1b-a093-fc53e8d32c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.086487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580d468-b491-4c1b-a093-fc53e8d32c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.086800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580d468-b491-4c1b-a093-fc53e8d32c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.087394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580d468-b491-4c1b-a093-fc53e8d32c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.087777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580d468-b491-4c1b-a093-fc53e8d32c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:31.089800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580d468-b491-4c1b-a093-fc53e8d32c7c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:31.097884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 940/1913] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:31.106256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 974/1914] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:31.112524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fd856-8e66-4d8f-9f4b-55ab91c47dba None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:31.114171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-cd1fd856-8e66-4d8f-9f4b-55ab91c47dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:31.120022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580d468-b491-4c1b-a093-fc53e8d32c7c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:31.132197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580d468-b491-4c1b-a093-fc53e8d32c7c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.137348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:31.138817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c4ae2-8fa0-4521-b5af-3fd3af7a427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.139505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c4ae2-8fa0-4521-b5af-3fd3af7a427d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.144342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c4ae2-8fa0-4521-b5af-3fd3af7a427d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.144342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c4ae2-8fa0-4521-b5af-3fd3af7a427d admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.144342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c4ae2-8fa0-4521-b5af-3fd3af7a427d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:31.144342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c4ae2-8fa0-4521-b5af-3fd3af7a427d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:31.157634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 975/1915] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:31.162734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c4ae2-8fa0-4521-b5af-3fd3af7a427d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:31.175438 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c4ae2-8fa0-4521-b5af-3fd3af7a427d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.181741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc2d83-ae2d-43db-8e43-210495c787f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.182530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc2d83-ae2d-43db-8e43-210495c787f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.182914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc2d83-ae2d-43db-8e43-210495c787f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.183261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc2d83-ae2d-43db-8e43-210495c787f2 admin admin] PATH_INFO: `/v3/projects/25097639c7804401ba7f5bdb92074047/users/e453b2636cb64e4b98519897f1d4bc17/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.192881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fd856-8e66-4d8f-9f4b-55ab91c47dba None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.199053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051429b9-2b20-45ab-876d-f952d9d0eb88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.199869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051429b9-2b20-45ab-876d-f952d9d0eb88 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.205917 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051429b9-2b20-45ab-876d-f952d9d0eb88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.205917 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051429b9-2b20-45ab-876d-f952d9d0eb88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.206089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc2d83-ae2d-43db-8e43-210495c787f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25097639c7804401ba7f5bdb92074047, user_id=e453b2636cb64e4b98519897f1d4bc17, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:31.206168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-051429b9-2b20-45ab-876d-f952d9d0eb88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:31.206448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc2d83-ae2d-43db-8e43-210495c787f2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:31.272111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051429b9-2b20-45ab-876d-f952d9d0eb88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:31.273559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051429b9-2b20-45ab-876d-f952d9d0eb88 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:31.277972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 976/1916] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:31 2022] PUT /identity/v3/projects/25097639c7804401ba7f5bdb92074047/users/e453b2636cb64e4b98519897f1d4bc17/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:31.282950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 941/1917] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:31.288082 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10b26f-6a57-4c63-b1d8-37acba472087 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.288634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10b26f-6a57-4c63-b1d8-37acba472087 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.288945 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10b26f-6a57-4c63-b1d8-37acba472087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.317705 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1b10b26f-6a57-4c63-b1d8-37acba472087 None None] MFA Rules not processed for user `e453b2636cb64e4b98519897f1d4bc17`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:31.319196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1b10b26f-6a57-4c63-b1d8-37acba472087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:31.387141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051429b9-2b20-45ab-876d-f952d9d0eb88 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:31.390140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 977/1918] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:31.393887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-051429b9-2b20-45ab-876d-f952d9d0eb88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:31.395376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10b26f-6a57-4c63-b1d8-37acba472087 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:31.405122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051429b9-2b20-45ab-876d-f952d9d0eb88 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.485753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10b26f-6a57-4c63-b1d8-37acba472087 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.489927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.490560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f40844-fc53-41f0-9c84-e31e0bf15cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.490783 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.491078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.491244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f40844-fc53-41f0-9c84-e31e0bf15cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.491494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f40844-fc53-41f0-9c84-e31e0bf15cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.491589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] PATH_INFO: `/v3/projects/63de3bc62c904d9eb6f338343c5122f8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.491737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f40844-fc53-41f0-9c84-e31e0bf15cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.492685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f40844-fc53-41f0-9c84-e31e0bf15cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:31.493211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63de3bc62c904d9eb6f338343c5122f8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:31.495372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:31.495745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f40844-fc53-41f0-9c84-e31e0bf15cc4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:31.598832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 978/1919] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:31 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:31.603025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f40844-fc53-41f0-9c84-e31e0bf15cc4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:31.644308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63de3bc62c904d9eb6f338343c5122f8', 'request_id': 'req-a7821c43-1841-40a1-aae8-7e2ff3835d66'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:31.650452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63de3bc62c904d9eb6f338343c5122f8', 'request_id': 'req-a7821c43-1841-40a1-aae8-7e2ff3835d66'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:31.657262 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63de3bc62c904d9eb6f338343c5122f8', 'request_id': 'req-a7821c43-1841-40a1-aae8-7e2ff3835d66'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:31.688358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f40844-fc53-41f0-9c84-e31e0bf15cc4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.740520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] The token cache is being invalidate because project 63de3bc62c904d9eb6f338343c5122f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:31.741046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:31.741623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a7821c43-1841-40a1-aae8-7e2ff3835d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:31.747781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 942/1920] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:31 2022] DELETE /identity/v3/projects/63de3bc62c904d9eb6f338343c5122f8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:31.749859 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd6853-4f3b-4d99-9669-525ddf803192 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.749859 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd6853-4f3b-4d99-9669-525ddf803192 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.750016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd6853-4f3b-4d99-9669-525ddf803192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.755326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb070f4a-9fb6-4818-ac4e-1622c62bdac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.756217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb070f4a-9fb6-4818-ac4e-1622c62bdac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.756684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb070f4a-9fb6-4818-ac4e-1622c62bdac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.757003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb070f4a-9fb6-4818-ac4e-1622c62bdac0 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.757848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb070f4a-9fb6-4818-ac4e-1622c62bdac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:31.759912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb070f4a-9fb6-4818-ac4e-1622c62bdac0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:31.773870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:31.784416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-58fd6853-4f3b-4d99-9669-525ddf803192 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:31.785717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-58fd6853-4f3b-4d99-9669-525ddf803192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:31.801564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 943/1921] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:31.802968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddedd33-4908-446e-a647-537bdd996df2 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.803250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddedd33-4908-446e-a647-537bdd996df2 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.803521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddedd33-4908-446e-a647-537bdd996df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.836742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-9ddedd33-4908-446e-a647-537bdd996df2 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:31.839201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9ddedd33-4908-446e-a647-537bdd996df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:31.843583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 979/1922] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:31 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:31.844654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb070f4a-9fb6-4818-ac4e-1622c62bdac0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:31.846854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-eb070f4a-9fb6-4818-ac4e-1622c62bdac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:31.851713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 944/1923] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:31.859684 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddedd33-4908-446e-a647-537bdd996df2 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:31.866062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb070f4a-9fb6-4818-ac4e-1622c62bdac0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.874298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf324c-457b-4693-acfc-691d81905ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.881710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddedd33-4908-446e-a647-537bdd996df2 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.887521 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf324c-457b-4693-acfc-691d81905ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.887810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf324c-457b-4693-acfc-691d81905ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.888524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf324c-457b-4693-acfc-691d81905ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.889914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf324c-457b-4693-acfc-691d81905ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:31.891709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e4a65-027f-4715-ac3f-86e95f41666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.892319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf324c-457b-4693-acfc-691d81905ec4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:31.894531 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e4a65-027f-4715-ac3f-86e95f41666d admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.894778 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e4a65-027f-4715-ac3f-86e95f41666d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.895471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e4a65-027f-4715-ac3f-86e95f41666d admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.896141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e4a65-027f-4715-ac3f-86e95f41666d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:31.896447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e4a65-027f-4715-ac3f-86e95f41666d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:31.900112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e4a65-027f-4715-ac3f-86e95f41666d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:31.906337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 980/1924] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:31.912062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf324c-457b-4693-acfc-691d81905ec4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:31.927600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf324c-457b-4693-acfc-691d81905ec4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.931295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 945/1925] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:31.932258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e4a65-027f-4715-ac3f-86e95f41666d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:31.938263 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdb965-5e9c-419e-8dd8-a415d006d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.938932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdb965-5e9c-419e-8dd8-a415d006d7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.939258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdb965-5e9c-419e-8dd8-a415d006d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.939529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdb965-5e9c-419e-8dd8-a415d006d7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.944924 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdb965-5e9c-419e-8dd8-a415d006d7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:31.944924 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbdb965-5e9c-419e-8dd8-a415d006d7fa admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:31.951305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e4a65-027f-4715-ac3f-86e95f41666d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.963752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c935e-fc85-450a-a770-c5e60d0afb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.963957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 981/1926] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:31.964393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c935e-fc85-450a-a770-c5e60d0afb34 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.964671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c935e-fc85-450a-a770-c5e60d0afb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.964837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdb965-5e9c-419e-8dd8-a415d006d7fa admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:31.964956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c935e-fc85-450a-a770-c5e60d0afb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:31.966230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c935e-fc85-450a-a770-c5e60d0afb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:31.968209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c935e-fc85-450a-a770-c5e60d0afb34 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:31.977460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdb965-5e9c-419e-8dd8-a415d006d7fa admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:31.983433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c29a0-46ab-483f-863a-b640058fcc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:31.984183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c29a0-46ab-483f-863a-b640058fcc5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:31.984545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c29a0-46ab-483f-863a-b640058fcc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:31.984817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c29a0-46ab-483f-863a-b640058fcc5a admin admin] PATH_INFO: `/v3/projects/d1188ece172f411ea651cb14c023c95b/users/348104ff08004d2db7c5e61294f56486/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.005248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c29a0-46ab-483f-863a-b640058fcc5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1188ece172f411ea651cb14c023c95b, user_id=348104ff08004d2db7c5e61294f56486, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:32.008314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c29a0-46ab-483f-863a-b640058fcc5a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:32.043440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:32.077901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 982/1927] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:31 2022] PUT /identity/v3/projects/d1188ece172f411ea651cb14c023c95b/users/348104ff08004d2db7c5e61294f56486/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:32.097282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a943f45-e056-4047-a6c2-6e0a7c460ed5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:32.097570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a943f45-e056-4047-a6c2-6e0a7c460ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:32.097848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a943f45-e056-4047-a6c2-6e0a7c460ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.126789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9a943f45-e056-4047-a6c2-6e0a7c460ed5 None None] MFA Rules not processed for user `348104ff08004d2db7c5e61294f56486`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:32.131990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9a943f45-e056-4047-a6c2-6e0a7c460ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:32.180903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 946/1928] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:31 2022] POST /identity/v3/projects => generated 365 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:32.184759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c935e-fc85-450a-a770-c5e60d0afb34 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:32.216630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 983/1929] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:32.221155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a943f45-e056-4047-a6c2-6e0a7c460ed5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:32.264345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c935e-fc85-450a-a770-c5e60d0afb34 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:32.269128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab992150-6fc3-40aa-bf15-0632903b94e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:32.269781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab992150-6fc3-40aa-bf15-0632903b94e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:32.270082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab992150-6fc3-40aa-bf15-0632903b94e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:32.270360 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab992150-6fc3-40aa-bf15-0632903b94e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.271098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab992150-6fc3-40aa-bf15-0632903b94e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:32.273046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab992150-6fc3-40aa-bf15-0632903b94e8 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:32.302160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a943f45-e056-4047-a6c2-6e0a7c460ed5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:32.306887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a653a-d5b8-45f0-a9af-3a8780153d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:32.307515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a653a-d5b8-45f0-a9af-3a8780153d51 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:32.307794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a653a-d5b8-45f0-a9af-3a8780153d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:32.308068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a653a-d5b8-45f0-a9af-3a8780153d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.308682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a653a-d5b8-45f0-a9af-3a8780153d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:32.310681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a653a-d5b8-45f0-a9af-3a8780153d51 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:32.345944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 947/1930] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:32 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:32.349934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab992150-6fc3-40aa-bf15-0632903b94e8 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:32.360887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab992150-6fc3-40aa-bf15-0632903b94e8 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:32.366055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a88fb5-d45b-4168-82f6-9f4ee76670bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:32.366676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a88fb5-d45b-4168-82f6-9f4ee76670bd admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:32.367024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a88fb5-d45b-4168-82f6-9f4ee76670bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:32.367296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a88fb5-d45b-4168-82f6-9f4ee76670bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.367939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a88fb5-d45b-4168-82f6-9f4ee76670bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:32.369598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a88fb5-d45b-4168-82f6-9f4ee76670bd admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:32.385488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 984/1931] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:32 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:32.389205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 948/1932] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:32.389901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a653a-d5b8-45f0-a9af-3a8780153d51 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:32.393720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a88fb5-d45b-4168-82f6-9f4ee76670bd admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:32.407136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a88fb5-d45b-4168-82f6-9f4ee76670bd admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:32.473346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c1a16-1440-47ce-8a95-afa22bcae1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:32.474184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1a16-1440-47ce-8a95-afa22bcae1bc admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:32.474534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1a16-1440-47ce-8a95-afa22bcae1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:32.474919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1a16-1440-47ce-8a95-afa22bcae1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.475637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c1a16-1440-47ce-8a95-afa22bcae1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:32.477327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c1a16-1440-47ce-8a95-afa22bcae1bc admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:32.482583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a653a-d5b8-45f0-a9af-3a8780153d51 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:32.488332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e037e-46e9-4817-b1e7-946587f5861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:32.488947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e037e-46e9-4817-b1e7-946587f5861f admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:32.489239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e037e-46e9-4817-b1e7-946587f5861f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:32.489540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e037e-46e9-4817-b1e7-946587f5861f admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.490249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e037e-46e9-4817-b1e7-946587f5861f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:32.492207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e037e-46e9-4817-b1e7-946587f5861f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:32.493579 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 949/1933] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:32.498555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c1a16-1440-47ce-8a95-afa22bcae1bc admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:32.509491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c1a16-1440-47ce-8a95-afa22bcae1bc admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:32.516277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef982728-3157-4408-8b05-bf7e5be71f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:32.517207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef982728-3157-4408-8b05-bf7e5be71f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:32.517386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef982728-3157-4408-8b05-bf7e5be71f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:32.517900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef982728-3157-4408-8b05-bf7e5be71f7e admin admin] PATH_INFO: `/v3/projects/de41eb5b2e0849888c1bc4aadae97833/users/ef357e3f09754d1782c04bfcbee18559/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.538959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef982728-3157-4408-8b05-bf7e5be71f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de41eb5b2e0849888c1bc4aadae97833, user_id=ef357e3f09754d1782c04bfcbee18559, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:32.541739 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef982728-3157-4408-8b05-bf7e5be71f7e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:32.582214 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:32.627407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 985/1934] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:32 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:32.627407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e037e-46e9-4817-b1e7-946587f5861f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:32.628882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-134e037e-46e9-4817-b1e7-946587f5861f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:32.641554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e037e-46e9-4817-b1e7-946587f5861f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:32.647447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:32.648133 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:32.648402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:32.648673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] PATH_INFO: `/v3/users/607b54ba93634afbb1b6b5fbd283be5e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.649835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=607b54ba93634afbb1b6b5fbd283be5e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:32.653284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:32.655267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 950/1935] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:32 2022] PUT /identity/v3/projects/de41eb5b2e0849888c1bc4aadae97833/users/ef357e3f09754d1782c04bfcbee18559/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:32.656084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef982728-3157-4408-8b05-bf7e5be71f7e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:32.719708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef982728-3157-4408-8b05-bf7e5be71f7e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:32.724998 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7f2d9-04ff-43f6-bf9a-2a29d78f9473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:32.725601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7f2d9-04ff-43f6-bf9a-2a29d78f9473 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:32.725878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7f2d9-04ff-43f6-bf9a-2a29d78f9473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:32.726149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7f2d9-04ff-43f6-bf9a-2a29d78f9473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.726823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7f2d9-04ff-43f6-bf9a-2a29d78f9473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:32.728425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7f2d9-04ff-43f6-bf9a-2a29d78f9473 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:32.738558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 951/1936] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:32.739620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39a6e4-d953-4a85-b7bf-e03104dfb8cc None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:32.739881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39a6e4-d953-4a85-b7bf-e03104dfb8cc None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:32.745867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39a6e4-d953-4a85-b7bf-e03104dfb8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.769308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-4d39a6e4-d953-4a85-b7bf-e03104dfb8cc None None] MFA Rules not processed for user `ef357e3f09754d1782c04bfcbee18559`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:32.773603 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4d39a6e4-d953-4a85-b7bf-e03104dfb8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:32.841090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 952/1937] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:32.842154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39a6e4-d953-4a85-b7bf-e03104dfb8cc None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:32.855411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39a6e4-d953-4a85-b7bf-e03104dfb8cc None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:32.860304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cb87c-7966-49e1-a438-cbd253a48029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:32.860971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cb87c-7966-49e1-a438-cbd253a48029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:32.861425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cb87c-7966-49e1-a438-cbd253a48029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:32.861707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cb87c-7966-49e1-a438-cbd253a48029 admin admin] PATH_INFO: `/v3/projects/337e638b197748b5ae21e49999197080/users/6c8c79423d434d6ba16281f0d38926d4/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:32.877488 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915cb87c-7966-49e1-a438-cbd253a48029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337e638b197748b5ae21e49999197080, user_id=6c8c79423d434d6ba16281f0d38926d4, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:32.880212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915cb87c-7966-49e1-a438-cbd253a48029 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:32.890893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '607b54ba93634afbb1b6b5fbd283be5e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:32.891659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '607b54ba93634afbb1b6b5fbd283be5e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:32.978554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '607b54ba93634afbb1b6b5fbd283be5e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:32.979279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '607b54ba93634afbb1b6b5fbd283be5e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:32.984685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 953/1938] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:32 2022] PUT /identity/v3/projects/337e638b197748b5ae21e49999197080/users/6c8c79423d434d6ba16281f0d38926d4/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:32.985491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cb87c-7966-49e1-a438-cbd253a48029 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:32.987166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-915cb87c-7966-49e1-a438-cbd253a48029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:32.989740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '607b54ba93634afbb1b6b5fbd283be5e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:33.007771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 986/1939] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:32 2022] DELETE /identity/v3/users/607b54ba93634afbb1b6b5fbd283be5e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:33.008683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:33.010020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:33.055620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cb87c-7966-49e1-a438-cbd253a48029 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:33.079799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b96522-6ec8-4aa1-a341-995f7e9cfed2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:33.084943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a9e3f-e194-452f-9fd7-e406dc5ea196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:33.085692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a9e3f-e194-452f-9fd7-e406dc5ea196 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:33.086160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a9e3f-e194-452f-9fd7-e406dc5ea196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:33.086509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a9e3f-e194-452f-9fd7-e406dc5ea196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:33.087340 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a9e3f-e194-452f-9fd7-e406dc5ea196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:33.089336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a9e3f-e194-452f-9fd7-e406dc5ea196 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:33.104061 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 987/1940] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:33.107288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0afd59-f8dd-4d95-a5fd-ad80d09b511d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:33.107668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:33.108734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0afd59-f8dd-4d95-a5fd-ad80d09b511d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:33.109105 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0afd59-f8dd-4d95-a5fd-ad80d09b511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:33.132204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ea0afd59-f8dd-4d95-a5fd-ad80d09b511d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:33.133877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ea0afd59-f8dd-4d95-a5fd-ad80d09b511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:33.146074 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 988/1941] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:33.146968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0afd59-f8dd-4d95-a5fd-ad80d09b511d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:33.155463 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110a126-f7d0-4595-a2c0-edf8dcf48c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:33.156428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a126-f7d0-4595-a2c0-edf8dcf48c1c admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:33.156714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a126-f7d0-4595-a2c0-edf8dcf48c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:33.157089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a126-f7d0-4595-a2c0-edf8dcf48c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:33.157360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0afd59-f8dd-4d95-a5fd-ad80d09b511d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:33.159085 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110a126-f7d0-4595-a2c0-edf8dcf48c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:33.161845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110a126-f7d0-4595-a2c0-edf8dcf48c1c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:33.165416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184170b1-334f-45ea-ae3e-04ed1494763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:33.166830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184170b1-334f-45ea-ae3e-04ed1494763a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:33.166830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184170b1-334f-45ea-ae3e-04ed1494763a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:33.166830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184170b1-334f-45ea-ae3e-04ed1494763a admin admin] PATH_INFO: `/v3/projects/337e638b197748b5ae21e49999197080/users/6c8c79423d434d6ba16281f0d38926d4/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:33.170098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184170b1-334f-45ea-ae3e-04ed1494763a admin admin] RBAC: Authorizing `identity:create_grant(project_id=337e638b197748b5ae21e49999197080, user_id=6c8c79423d434d6ba16281f0d38926d4, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:33.173812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184170b1-334f-45ea-ae3e-04ed1494763a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:33.203167 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 989/1942] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:33 2022] PUT /identity/v3/projects/337e638b197748b5ae21e49999197080/users/6c8c79423d434d6ba16281f0d38926d4/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:33.211938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184170b1-334f-45ea-ae3e-04ed1494763a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:33.217114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-184170b1-334f-45ea-ae3e-04ed1494763a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:33.289856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 954/1943] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:32 2022] POST /identity/v3/projects => generated 363 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:33.289856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa237751-eecc-4054-b115-35cbd0c498ff None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:33.289856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa237751-eecc-4054-b115-35cbd0c498ff None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:33.289856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa237751-eecc-4054-b115-35cbd0c498ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:33.322684 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184170b1-334f-45ea-ae3e-04ed1494763a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:33.351639 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-aa237751-eecc-4054-b115-35cbd0c498ff None None] MFA Rules not processed for user `6c8c79423d434d6ba16281f0d38926d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:33.361517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-aa237751-eecc-4054-b115-35cbd0c498ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:33.404607 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9627-6fa3-4988-a2cf-82e2df0e38f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:33.405242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9627-6fa3-4988-a2cf-82e2df0e38f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:33.405522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9627-6fa3-4988-a2cf-82e2df0e38f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:33.405858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9627-6fa3-4988-a2cf-82e2df0e38f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:33.479069 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 955/1944] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:33.480998 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa237751-eecc-4054-b115-35cbd0c498ff None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:33.572788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e9627-6fa3-4988-a2cf-82e2df0e38f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:33.573829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa237751-eecc-4054-b115-35cbd0c498ff None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:33.574531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e9627-6fa3-4988-a2cf-82e2df0e38f8 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:33.579566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063940b6-3a2d-4169-9116-792f96c911bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:33.580470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063940b6-3a2d-4169-9116-792f96c911bf admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:33.580820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063940b6-3a2d-4169-9116-792f96c911bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:33.581173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063940b6-3a2d-4169-9116-792f96c911bf admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:33.581881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063940b6-3a2d-4169-9116-792f96c911bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:33.583914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063940b6-3a2d-4169-9116-792f96c911bf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:33.586424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 990/1945] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:33.587383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9627-6fa3-4988-a2cf-82e2df0e38f8 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:33.588918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4d8e9627-6fa3-4988-a2cf-82e2df0e38f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:33.691786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9627-6fa3-4988-a2cf-82e2df0e38f8 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:33.696100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc14ff-5c7c-4243-ae81-3808f8f616bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:33.696716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc14ff-5c7c-4243-ae81-3808f8f616bd service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:33.696992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc14ff-5c7c-4243-ae81-3808f8f616bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:33.697271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc14ff-5c7c-4243-ae81-3808f8f616bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:33.706769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc14ff-5c7c-4243-ae81-3808f8f616bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:33.708235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc14ff-5c7c-4243-ae81-3808f8f616bd service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:33.718449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 991/1946] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:33.786292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 956/1947] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:33 2022] POST /identity/v3/users => generated 288 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:33.790581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc14ff-5c7c-4243-ae81-3808f8f616bd service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:33.801882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc14ff-5c7c-4243-ae81-3808f8f616bd service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:33.806898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1adcf-9211-44e1-8ead-ee0f0e39c612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:33.807513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1adcf-9211-44e1-8ead-ee0f0e39c612 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:33.807794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1adcf-9211-44e1-8ead-ee0f0e39c612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:33.810264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:33.810829 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1adcf-9211-44e1-8ead-ee0f0e39c612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:33.810829 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1adcf-9211-44e1-8ead-ee0f0e39c612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:33.810829 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1adcf-9211-44e1-8ead-ee0f0e39c612 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:33.821700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 992/1948] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:33.828726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063940b6-3a2d-4169-9116-792f96c911bf admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:33.842121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063940b6-3a2d-4169-9116-792f96c911bf admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:33.849631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03842b72-3474-4df9-8859-59630dd59c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:33.850543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03842b72-3474-4df9-8859-59630dd59c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:33.851017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03842b72-3474-4df9-8859-59630dd59c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:33.851423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03842b72-3474-4df9-8859-59630dd59c96 admin admin] PATH_INFO: `/v3/projects/988e532ac3af46b1b9e36a785d17f261/users/8dfae0eb360e45968406aa98ccc3e0b5/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:33.864288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1adcf-9211-44e1-8ead-ee0f0e39c612 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:33.869632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03842b72-3474-4df9-8859-59630dd59c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988e532ac3af46b1b9e36a785d17f261, user_id=8dfae0eb360e45968406aa98ccc3e0b5, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:33.872509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03842b72-3474-4df9-8859-59630dd59c96 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:33.874928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1adcf-9211-44e1-8ead-ee0f0e39c612 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:33.879516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7017bb-c3a3-4c8d-9dfc-e435822f54e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:33.880464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7017bb-c3a3-4c8d-9dfc-e435822f54e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:33.880761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7017bb-c3a3-4c8d-9dfc-e435822f54e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:33.881183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7017bb-c3a3-4c8d-9dfc-e435822f54e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:33.883043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-af7017bb-c3a3-4c8d-9dfc-e435822f54e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:33.939851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 957/1949] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:33 2022] PUT /identity/v3/projects/988e532ac3af46b1b9e36a785d17f261/users/8dfae0eb360e45968406aa98ccc3e0b5/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:33.943772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03842b72-3474-4df9-8859-59630dd59c96 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:33.960042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7017bb-c3a3-4c8d-9dfc-e435822f54e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:33.961601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7017bb-c3a3-4c8d-9dfc-e435822f54e0 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:33.974793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 993/1950] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:34.007886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7017bb-c3a3-4c8d-9dfc-e435822f54e0 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:34.015653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03842b72-3474-4df9-8859-59630dd59c96 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:34.018236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7017bb-c3a3-4c8d-9dfc-e435822f54e0 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:34.020734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1abb58-dbe7-4ee6-968b-1146c0adee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:34.021507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1abb58-dbe7-4ee6-968b-1146c0adee85 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:34.021786 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1abb58-dbe7-4ee6-968b-1146c0adee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:34.022065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1abb58-dbe7-4ee6-968b-1146c0adee85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:34.022743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1abb58-dbe7-4ee6-968b-1146c0adee85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:34.024428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1abb58-dbe7-4ee6-968b-1146c0adee85 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:34.035538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 958/1951] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:34.039879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1abb58-dbe7-4ee6-968b-1146c0adee85 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:34.051494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1abb58-dbe7-4ee6-968b-1146c0adee85 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:34.057087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d303d19-812b-41dc-9086-7bc801c201c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:34.057829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d303d19-812b-41dc-9086-7bc801c201c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:34.058270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d303d19-812b-41dc-9086-7bc801c201c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:34.058567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d303d19-812b-41dc-9086-7bc801c201c3 admin admin] PATH_INFO: `/v3/projects/988e532ac3af46b1b9e36a785d17f261/users/8dfae0eb360e45968406aa98ccc3e0b5/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:34.061991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d303d19-812b-41dc-9086-7bc801c201c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988e532ac3af46b1b9e36a785d17f261, user_id=8dfae0eb360e45968406aa98ccc3e0b5, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:34.064863 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d303d19-812b-41dc-9086-7bc801c201c3 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:34.074040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dd526-2d41-4319-ab83-2f96650c30e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:34.074784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd526-2d41-4319-ab83-2f96650c30e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:34.075702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd526-2d41-4319-ab83-2f96650c30e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:34.076037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd526-2d41-4319-ab83-2f96650c30e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:34.077005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 959/1952] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:34 2022] PUT /identity/v3/projects/988e532ac3af46b1b9e36a785d17f261/users/8dfae0eb360e45968406aa98ccc3e0b5/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:34.078404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5e5dd526-2d41-4319-ab83-2f96650c30e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:34.087042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa2d68-be5f-4245-9b8a-457bf37f58bd None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:34.087399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa2d68-be5f-4245-9b8a-457bf37f58bd None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:34.087597 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa2d68-be5f-4245-9b8a-457bf37f58bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:34.157015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a4fa2d68-be5f-4245-9b8a-457bf37f58bd None None] MFA Rules not processed for user `8dfae0eb360e45968406aa98ccc3e0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:34.158326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a4fa2d68-be5f-4245-9b8a-457bf37f58bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:34.161663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dd526-2d41-4319-ab83-2f96650c30e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:34.163411 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dd526-2d41-4319-ab83-2f96650c30e9 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:34.173636 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 994/1953] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:34.174489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dd526-2d41-4319-ab83-2f96650c30e9 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:34.175947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5e5dd526-2d41-4319-ab83-2f96650c30e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:34.190731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dd526-2d41-4319-ab83-2f96650c30e9 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:34.290609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:34.290609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:34.290609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:34.290609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] PATH_INFO: `/v3/projects/0bb22f6fd7d14ded80ccf53ae5cc4040` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:34.291240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bb22f6fd7d14ded80ccf53ae5cc4040)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:34.291240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:34.306558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 960/1954] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:34.440202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:34.480516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bb22f6fd7d14ded80ccf53ae5cc4040', 'request_id': 'req-f1f77e97-fcac-4cae-897b-bc3de164181f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:34.488498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bb22f6fd7d14ded80ccf53ae5cc4040', 'request_id': 'req-f1f77e97-fcac-4cae-897b-bc3de164181f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:34.495741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bb22f6fd7d14ded80ccf53ae5cc4040', 'request_id': 'req-f1f77e97-fcac-4cae-897b-bc3de164181f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:34.622780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] The token cache is being invalidate because project 0bb22f6fd7d14ded80ccf53ae5cc4040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:34.623367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:34.624400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:34.626717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 995/1955] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:34 2022] DELETE /identity/v3/projects/0bb22f6fd7d14ded80ccf53ae5cc4040 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:34.630451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa2d68-be5f-4245-9b8a-457bf37f58bd None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:34.641617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa2d68-be5f-4245-9b8a-457bf37f58bd None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:34.710219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:34.711087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:34.711425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:34.711703 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] PATH_INFO: `/v3/users/8a964a1b3ecd4b42b7878b6ab490f3f7` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:34.712957 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a964a1b3ecd4b42b7878b6ab490f3f7)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:34.715382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:34.960008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a964a1b3ecd4b42b7878b6ab490f3f7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:34.960746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a964a1b3ecd4b42b7878b6ab490f3f7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:35.037420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a964a1b3ecd4b42b7878b6ab490f3f7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:35.038741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a964a1b3ecd4b42b7878b6ab490f3f7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:35.050229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a964a1b3ecd4b42b7878b6ab490f3f7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:35.072136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 961/1956] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:34 2022] DELETE /identity/v3/users/8a964a1b3ecd4b42b7878b6ab490f3f7 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:35.077483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:35.078913 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:35.172756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f77e97-fcac-4cae-897b-bc3de164181f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:35.272874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f991941-e3ee-46a0-9181-7aa1e56313bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:35.273502 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f991941-e3ee-46a0-9181-7aa1e56313bf service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:35.273780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f991941-e3ee-46a0-9181-7aa1e56313bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:35.274049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f991941-e3ee-46a0-9181-7aa1e56313bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:35.275874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8f991941-e3ee-46a0-9181-7aa1e56313bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:35.366556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f991941-e3ee-46a0-9181-7aa1e56313bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:35.368165 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f991941-e3ee-46a0-9181-7aa1e56313bf service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:35.380444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 996/1957] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:35.449592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:35.672707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:35.673958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:35.756391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4477b-ee06-44d0-a3a4-56fbd5a86e7d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:35.761773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:35.768035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:35.768035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:35.768035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] PATH_INFO: `/v3/projects/48291e868ccf43fd82879933f3834808` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:35.768035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48291e868ccf43fd82879933f3834808)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:35.768035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:35.817715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f991941-e3ee-46a0-9181-7aa1e56313bf service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:35.819576 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8f991941-e3ee-46a0-9181-7aa1e56313bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:35.831920 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f991941-e3ee-46a0-9181-7aa1e56313bf service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:35.836262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da8e2-6564-4054-8fc3-272c36dbdbb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:35.837133 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da8e2-6564-4054-8fc3-272c36dbdbb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:35.837608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da8e2-6564-4054-8fc3-272c36dbdbb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:35.838093 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da8e2-6564-4054-8fc3-272c36dbdbb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:35.840286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c01da8e2-6564-4054-8fc3-272c36dbdbb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:35.960085 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48291e868ccf43fd82879933f3834808', 'request_id': 'req-088f6095-bbb4-4504-9058-6dce1cb9a3b9'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:35.967121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48291e868ccf43fd82879933f3834808', 'request_id': 'req-088f6095-bbb4-4504-9058-6dce1cb9a3b9'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:35.968300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01da8e2-6564-4054-8fc3-272c36dbdbb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:35.969783 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01da8e2-6564-4054-8fc3-272c36dbdbb0 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:35.978249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48291e868ccf43fd82879933f3834808', 'request_id': 'req-088f6095-bbb4-4504-9058-6dce1cb9a3b9'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:35.992083 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 997/1958] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:36.063079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] The token cache is being invalidate because project 48291e868ccf43fd82879933f3834808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:36.068413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:36.068413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:36.069845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 962/1959] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:35 2022] DELETE /identity/v3/projects/48291e868ccf43fd82879933f3834808 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:36.073804 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da8e2-6564-4054-8fc3-272c36dbdbb0 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:36.080891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:36.084871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:36.088796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da8e2-6564-4054-8fc3-272c36dbdbb0 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:36.183332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5796bb-63a5-476d-ab4f-2c77aeaf3acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:36.184352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5796bb-63a5-476d-ab4f-2c77aeaf3acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:36.186526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5796bb-63a5-476d-ab4f-2c77aeaf3acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:36.186957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5796bb-63a5-476d-ab4f-2c77aeaf3acd admin admin] PATH_INFO: `/v3/users/4bbdebcc32954e2ca6959d814a8e6479` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:36.190884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5796bb-63a5-476d-ab4f-2c77aeaf3acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbdebcc32954e2ca6959d814a8e6479)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:36.195626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5796bb-63a5-476d-ab4f-2c77aeaf3acd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:36.215310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f6095-bbb4-4504-9058-6dce1cb9a3b9 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:36.225381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016e75c-5362-4896-a3f3-50a0ed2332f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:36.226184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016e75c-5362-4896-a3f3-50a0ed2332f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:36.226561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016e75c-5362-4896-a3f3-50a0ed2332f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:36.227721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016e75c-5362-4896-a3f3-50a0ed2332f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:36.229867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6016e75c-5362-4896-a3f3-50a0ed2332f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:36.312496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016e75c-5362-4896-a3f3-50a0ed2332f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:36.314206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016e75c-5362-4896-a3f3-50a0ed2332f2 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:36.327732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 963/1960] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:36.508976 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5c5796bb-63a5-476d-ab4f-2c77aeaf3acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbdebcc32954e2ca6959d814a8e6479'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:36.510357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5c5796bb-63a5-476d-ab4f-2c77aeaf3acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbdebcc32954e2ca6959d814a8e6479'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:36.746980 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5c5796bb-63a5-476d-ab4f-2c77aeaf3acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbdebcc32954e2ca6959d814a8e6479'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:36.749392 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:36.750964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5c5796bb-63a5-476d-ab4f-2c77aeaf3acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbdebcc32954e2ca6959d814a8e6479'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:36.762413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5c5796bb-63a5-476d-ab4f-2c77aeaf3acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbdebcc32954e2ca6959d814a8e6479'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:36.808848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 998/1961] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:36 2022] DELETE /identity/v3/users/4bbdebcc32954e2ca6959d814a8e6479 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:37.049833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:37.515391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016e75c-5362-4896-a3f3-50a0ed2332f2 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:37.518008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6016e75c-5362-4896-a3f3-50a0ed2332f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:37.548796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016e75c-5362-4896-a3f3-50a0ed2332f2 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:37.627180 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:37.628056 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:37.628476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:37.628912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] PATH_INFO: `/v3/projects/ea64efda5d6f45d7b11ec8ff5010d304` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:37.634997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea64efda5d6f45d7b11ec8ff5010d304)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:37.638620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:37.838975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea64efda5d6f45d7b11ec8ff5010d304', 'request_id': 'req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:37.846801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea64efda5d6f45d7b11ec8ff5010d304', 'request_id': 'req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:37.853971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea64efda5d6f45d7b11ec8ff5010d304', 'request_id': 'req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:37.951942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] The token cache is being invalidate because project ea64efda5d6f45d7b11ec8ff5010d304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:37.952340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:37.952996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-78a62ab2-f55c-4b32-85a7-2e91df94f9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:37.955468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 964/1962] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:37 2022] DELETE /identity/v3/projects/ea64efda5d6f45d7b11ec8ff5010d304 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:37.967407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ba6b2-a644-4959-b51e-91c3caae1f03 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:37.971725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ba6b2-a644-4959-b51e-91c3caae1f03 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:37.972780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ba6b2-a644-4959-b51e-91c3caae1f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:38.001357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cf9ba6b2-a644-4959-b51e-91c3caae1f03 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:38.002926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cf9ba6b2-a644-4959-b51e-91c3caae1f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:38.100096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 999/1963] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:38.112070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a89ae5-5089-44eb-9ac4-5f9bd0cae7cc None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:38.113072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a89ae5-5089-44eb-9ac4-5f9bd0cae7cc None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:38.113825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a89ae5-5089-44eb-9ac4-5f9bd0cae7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:38.143960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b8a89ae5-5089-44eb-9ac4-5f9bd0cae7cc None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:38.146005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b8a89ae5-5089-44eb-9ac4-5f9bd0cae7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:38.158434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 965/1964] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:38.161971 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ba6b2-a644-4959-b51e-91c3caae1f03 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:38.172602 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ba6b2-a644-4959-b51e-91c3caae1f03 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:38.179030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b14143-6038-44eb-a9b3-7c6ce0a1844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:38.179652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b14143-6038-44eb-a9b3-7c6ce0a1844a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:38.179934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b14143-6038-44eb-a9b3-7c6ce0a1844a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:38.180210 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b14143-6038-44eb-a9b3-7c6ce0a1844a admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:38.181171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b14143-6038-44eb-a9b3-7c6ce0a1844a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:38.181171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b14143-6038-44eb-a9b3-7c6ce0a1844a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:38.183942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b14143-6038-44eb-a9b3-7c6ce0a1844a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:38.205344 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1000/1965] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:38.209551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a89ae5-5089-44eb-9ac4-5f9bd0cae7cc None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:38.219255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a89ae5-5089-44eb-9ac4-5f9bd0cae7cc None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:38.224776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8df94-d196-4967-8621-5336745bb1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:38.225504 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8df94-d196-4967-8621-5336745bb1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:38.226125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8df94-d196-4967-8621-5336745bb1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:38.226125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8df94-d196-4967-8621-5336745bb1c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:38.226940 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8df94-d196-4967-8621-5336745bb1c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:38.229025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8df94-d196-4967-8621-5336745bb1c6 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:38.370112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 966/1966] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:38 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:38.375602 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b14143-6038-44eb-a9b3-7c6ce0a1844a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:38.392710 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b14143-6038-44eb-a9b3-7c6ce0a1844a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:38.477919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a1659-60c2-4fdf-81ad-a619f31d347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:38.478609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a1659-60c2-4fdf-81ad-a619f31d347a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:38.479331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a1659-60c2-4fdf-81ad-a619f31d347a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:38.479331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a1659-60c2-4fdf-81ad-a619f31d347a admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:38.479858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a1659-60c2-4fdf-81ad-a619f31d347a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:38.482556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a1659-60c2-4fdf-81ad-a619f31d347a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:38.578777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1001/1967] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:38 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:38.594771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8df94-d196-4967-8621-5336745bb1c6 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:38.610262 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8df94-d196-4967-8621-5336745bb1c6 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:38.623256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecc3f5-fa70-41fe-815b-bb7686a25ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:38.623894 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc3f5-fa70-41fe-815b-bb7686a25ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:38.624819 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc3f5-fa70-41fe-815b-bb7686a25ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:38.626794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:38.627417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecc3f5-fa70-41fe-815b-bb7686a25ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:38.628255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecc3f5-fa70-41fe-815b-bb7686a25ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:38.640109 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecc3f5-fa70-41fe-815b-bb7686a25ba8 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:38.660727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a1659-60c2-4fdf-81ad-a619f31d347a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:38.666212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 967/1968] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:38.672172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a1659-60c2-4fdf-81ad-a619f31d347a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:38.677376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8783-4269-4f68-8c0f-134db44e1190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:38.677651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8783-4269-4f68-8c0f-134db44e1190 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:38.677931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8783-4269-4f68-8c0f-134db44e1190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:38.678204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8783-4269-4f68-8c0f-134db44e1190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:38.678895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c8783-4269-4f68-8c0f-134db44e1190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:38.680487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c8783-4269-4f68-8c0f-134db44e1190 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:38.695784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1002/1969] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:38.700889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecc3f5-fa70-41fe-815b-bb7686a25ba8 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:38.736960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecc3f5-fa70-41fe-815b-bb7686a25ba8 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:38.745700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ce42f-ec2c-4f76-9ff3-de2fb7ee9f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:38.746995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce42f-ec2c-4f76-9ff3-de2fb7ee9f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:38.747283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce42f-ec2c-4f76-9ff3-de2fb7ee9f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:38.747562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce42f-ec2c-4f76-9ff3-de2fb7ee9f2f admin admin] PATH_INFO: `/v3/projects/be79d0294e52407ea63fb1a1fae2ff4c/users/473d07ba4c404fb59cbb61d52b04fdcd/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:38.775669 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ce42f-ec2c-4f76-9ff3-de2fb7ee9f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be79d0294e52407ea63fb1a1fae2ff4c, user_id=473d07ba4c404fb59cbb61d52b04fdcd, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:38.779326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ce42f-ec2c-4f76-9ff3-de2fb7ee9f2f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:38.919373 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 968/1970] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:38 2022] PUT /identity/v3/projects/be79d0294e52407ea63fb1a1fae2ff4c/users/473d07ba4c404fb59cbb61d52b04fdcd/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:38.932368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2b0a-26e4-4258-ba95-bbafb84584f4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:38.932768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2b0a-26e4-4258-ba95-bbafb84584f4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:38.933156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2b0a-26e4-4258-ba95-bbafb84584f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:38.979676 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a0bc2b0a-26e4-4258-ba95-bbafb84584f4 None None] MFA Rules not processed for user `473d07ba4c404fb59cbb61d52b04fdcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:38.982285 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a0bc2b0a-26e4-4258-ba95-bbafb84584f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:39.057386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1003/1971] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:39.061607 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ce42f-ec2c-4f76-9ff3-de2fb7ee9f2f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:39.134909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ce42f-ec2c-4f76-9ff3-de2fb7ee9f2f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:39.141722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c5aa3-c7a3-4304-8eb4-6b0b66da32c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:39.142335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c5aa3-c7a3-4304-8eb4-6b0b66da32c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:39.142618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c5aa3-c7a3-4304-8eb4-6b0b66da32c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:39.142922 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c5aa3-c7a3-4304-8eb4-6b0b66da32c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:39.143566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c5aa3-c7a3-4304-8eb4-6b0b66da32c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:39.145517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c5aa3-c7a3-4304-8eb4-6b0b66da32c2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:39.236349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 969/1972] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:39 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:39.242768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc2b0a-26e4-4258-ba95-bbafb84584f4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:39.249455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc2b0a-26e4-4258-ba95-bbafb84584f4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:39.265530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:39.331399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f78e9-3ec6-49b6-8914-30bd5b0e6076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:39.332080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f78e9-3ec6-49b6-8914-30bd5b0e6076 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:39.332406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f78e9-3ec6-49b6-8914-30bd5b0e6076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:39.332833 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f78e9-3ec6-49b6-8914-30bd5b0e6076 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:39.334463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f78e9-3ec6-49b6-8914-30bd5b0e6076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:39.337208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f78e9-3ec6-49b6-8914-30bd5b0e6076 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:39.466703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1004/1973] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:39 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:39.470327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c5aa3-c7a3-4304-8eb4-6b0b66da32c2 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:39.480494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c5aa3-c7a3-4304-8eb4-6b0b66da32c2 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:39.485096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd30d13-10df-403d-a763-fdc9bbf29831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:39.485701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30d13-10df-403d-a763-fdc9bbf29831 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:39.486027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30d13-10df-403d-a763-fdc9bbf29831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:39.486272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30d13-10df-403d-a763-fdc9bbf29831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:39.486955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd30d13-10df-403d-a763-fdc9bbf29831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:39.488539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd30d13-10df-403d-a763-fdc9bbf29831 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:39.499927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 970/1974] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:39.503922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f78e9-3ec6-49b6-8914-30bd5b0e6076 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:39.514385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f78e9-3ec6-49b6-8914-30bd5b0e6076 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:39.519268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce80cb-d392-47d4-965b-bd3601b2cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:39.519927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce80cb-d392-47d4-965b-bd3601b2cb32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:39.520204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce80cb-d392-47d4-965b-bd3601b2cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:39.520487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce80cb-d392-47d4-965b-bd3601b2cb32 admin admin] PATH_INFO: `/v3/projects/de27ccc9e2e042a29af1de26a8cb02eb/users/d35728f853764dde96944ddce174e165/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:39.535317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce80cb-d392-47d4-965b-bd3601b2cb32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de27ccc9e2e042a29af1de26a8cb02eb, user_id=d35728f853764dde96944ddce174e165, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:39.537982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce80cb-d392-47d4-965b-bd3601b2cb32 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:39.638153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1005/1975] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:39 2022] PUT /identity/v3/projects/de27ccc9e2e042a29af1de26a8cb02eb/users/d35728f853764dde96944ddce174e165/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:39.642715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd30d13-10df-403d-a763-fdc9bbf29831 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:39.653327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd30d13-10df-403d-a763-fdc9bbf29831 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:39.709405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defed092-b359-446e-b055-c6afaa475d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:39.709976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defed092-b359-446e-b055-c6afaa475d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:39.710257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defed092-b359-446e-b055-c6afaa475d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:39.710524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defed092-b359-446e-b055-c6afaa475d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:39.711198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defed092-b359-446e-b055-c6afaa475d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:39.712810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defed092-b359-446e-b055-c6afaa475d3b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:39.722840 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 971/1976] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:39.726922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce80cb-d392-47d4-965b-bd3601b2cb32 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:39.737266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce80cb-d392-47d4-965b-bd3601b2cb32 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:39.742425 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce5d40-e25f-4c1f-99d1-b0aa2b89104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:39.743128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce5d40-e25f-4c1f-99d1-b0aa2b89104c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:39.743411 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce5d40-e25f-4c1f-99d1-b0aa2b89104c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:39.743686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce5d40-e25f-4c1f-99d1-b0aa2b89104c admin admin] PATH_INFO: `/v3/projects/de27ccc9e2e042a29af1de26a8cb02eb/users/d35728f853764dde96944ddce174e165/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:39.745640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce5d40-e25f-4c1f-99d1-b0aa2b89104c admin admin] RBAC: Authorizing `identity:create_grant(project_id=de27ccc9e2e042a29af1de26a8cb02eb, user_id=d35728f853764dde96944ddce174e165, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:39.749215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce5d40-e25f-4c1f-99d1-b0aa2b89104c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:39.770988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1006/1977] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:39 2022] PUT /identity/v3/projects/de27ccc9e2e042a29af1de26a8cb02eb/users/d35728f853764dde96944ddce174e165/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:39.772019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c6516-10a1-42c4-ab50-b0df0f742834 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:39.772390 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c6516-10a1-42c4-ab50-b0df0f742834 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:39.772741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c6516-10a1-42c4-ab50-b0df0f742834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:39.804675 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3b6c6516-10a1-42c4-ab50-b0df0f742834 None None] MFA Rules not processed for user `d35728f853764dde96944ddce174e165`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:39.805910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3b6c6516-10a1-42c4-ab50-b0df0f742834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:39.881258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce5d40-e25f-4c1f-99d1-b0aa2b89104c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:39.884982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-37ce5d40-e25f-4c1f-99d1-b0aa2b89104c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:39.890021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 972/1978] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:39.901542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c6516-10a1-42c4-ab50-b0df0f742834 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:39.903108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3b6c6516-10a1-42c4-ab50-b0df0f742834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:39.968624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce5d40-e25f-4c1f-99d1-b0aa2b89104c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:39.978879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:39.979509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:39.979785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:39.984835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] PATH_INFO: `/v3/users/e453b2636cb64e4b98519897f1d4bc17` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:39.984835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e453b2636cb64e4b98519897f1d4bc17)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:39.984835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:39.986077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c6516-10a1-42c4-ab50-b0df0f742834 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:39.990230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56fbb2-dc92-4b74-999c-e23d12bcc5cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:39.991025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fbb2-dc92-4b74-999c-e23d12bcc5cb service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:39.991404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fbb2-dc92-4b74-999c-e23d12bcc5cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:39.991772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fbb2-dc92-4b74-999c-e23d12bcc5cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:40.069959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56fbb2-dc92-4b74-999c-e23d12bcc5cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:40.071526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56fbb2-dc92-4b74-999c-e23d12bcc5cb service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:40.081333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 973/1979] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:40.182444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e453b2636cb64e4b98519897f1d4bc17'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:40.183665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e453b2636cb64e4b98519897f1d4bc17'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:40.311248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e453b2636cb64e4b98519897f1d4bc17'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:40.311913 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e453b2636cb64e4b98519897f1d4bc17'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:40.324656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e453b2636cb64e4b98519897f1d4bc17'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:40.359176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1007/1980] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:39 2022] DELETE /identity/v3/users/e453b2636cb64e4b98519897f1d4bc17 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:40.364324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386017-ccc7-418e-bc89-2f37d8ed6cd4 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:40.364739 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386017-ccc7-418e-bc89-2f37d8ed6cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:40.365139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386017-ccc7-418e-bc89-2f37d8ed6cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:40.391670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b9386017-ccc7-418e-bc89-2f37d8ed6cd4 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:40.393036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b9386017-ccc7-418e-bc89-2f37d8ed6cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:40.474800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 974/1981] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:40.485574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:40.487776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:40.583955 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d35943-465a-4aaf-9214-cfce2dcd6791 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:40.589087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ff5f1-d0ad-4982-b39c-ea707939cc25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:40.589889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ff5f1-d0ad-4982-b39c-ea707939cc25 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:40.590280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ff5f1-d0ad-4982-b39c-ea707939cc25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:40.591632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ff5f1-d0ad-4982-b39c-ea707939cc25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:40.612698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ff5f1-d0ad-4982-b39c-ea707939cc25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:40.618531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ff5f1-d0ad-4982-b39c-ea707939cc25 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:40.627522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1008/1982] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:41.016912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:41.194110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9386017-ccc7-418e-bc89-2f37d8ed6cd4 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:41.195739 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b9386017-ccc7-418e-bc89-2f37d8ed6cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:41.214763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9386017-ccc7-418e-bc89-2f37d8ed6cd4 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:41.236489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:41.237605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:41.238023 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:41.238447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] PATH_INFO: `/v3/projects/25097639c7804401ba7f5bdb92074047` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:41.241518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25097639c7804401ba7f5bdb92074047)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:41.247980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:41.369430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25097639c7804401ba7f5bdb92074047', 'request_id': 'req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:41.376492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25097639c7804401ba7f5bdb92074047', 'request_id': 'req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:41.384277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25097639c7804401ba7f5bdb92074047', 'request_id': 'req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:41.466286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:41.476730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] The token cache is being invalidate because project 25097639c7804401ba7f5bdb92074047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:41.477020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:41.477751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:41.479867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 975/1983] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:41 2022] DELETE /identity/v3/projects/25097639c7804401ba7f5bdb92074047 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:41.484424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ff5f1-d0ad-4982-b39c-ea707939cc25 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:41.495510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ff5f1-d0ad-4982-b39c-ea707939cc25 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:41.561112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:41.561835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:41.562177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:41.562510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] PATH_INFO: `/v3/users/348104ff08004d2db7c5e61294f56486` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:41.563865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] RBAC: Authorizing `identity:delete_user(user_id=348104ff08004d2db7c5e61294f56486)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:41.565840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:41.769503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348104ff08004d2db7c5e61294f56486'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:41.770183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348104ff08004d2db7c5e61294f56486'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:41.888166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348104ff08004d2db7c5e61294f56486'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:41.888781 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348104ff08004d2db7c5e61294f56486'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:41.896404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348104ff08004d2db7c5e61294f56486'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:41.917995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1009/1984] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:41 2022] DELETE /identity/v3/users/348104ff08004d2db7c5e61294f56486 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:42.060635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:42.062148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:42.076642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdc2f5-5526-479f-9cb1-e9cb7cf01a95 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:42.135316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead41c2-d1c1-4c17-a236-02cac73d4c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:42.135481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead41c2-d1c1-4c17-a236-02cac73d4c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:42.135824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead41c2-d1c1-4c17-a236-02cac73d4c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:42.136015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead41c2-d1c1-4c17-a236-02cac73d4c45 admin admin] PATH_INFO: `/v3/users/2f1f8be15d1c49b2b18af4e5bedce7f5` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:42.137795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead41c2-d1c1-4c17-a236-02cac73d4c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1f8be15d1c49b2b18af4e5bedce7f5)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:42.140224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead41c2-d1c1-4c17-a236-02cac73d4c45 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:42.249117 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:42.393464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:42.394949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:42.408727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a7f74-dc29-41f7-a8a6-f24600c3881b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:42.413910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:42.414557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:42.414898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:42.415698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] PATH_INFO: `/v3/projects/d1188ece172f411ea651cb14c023c95b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:42.416524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1188ece172f411ea651cb14c023c95b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:42.418912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:42.444416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1ead41c2-d1c1-4c17-a236-02cac73d4c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1f8be15d1c49b2b18af4e5bedce7f5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:42.445815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1ead41c2-d1c1-4c17-a236-02cac73d4c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1f8be15d1c49b2b18af4e5bedce7f5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:42.568544 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1ead41c2-d1c1-4c17-a236-02cac73d4c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1f8be15d1c49b2b18af4e5bedce7f5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:42.569100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1ead41c2-d1c1-4c17-a236-02cac73d4c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1f8be15d1c49b2b18af4e5bedce7f5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:42.577154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1ead41c2-d1c1-4c17-a236-02cac73d4c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1f8be15d1c49b2b18af4e5bedce7f5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:42.586337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1188ece172f411ea651cb14c023c95b', 'request_id': 'req-17a6c872-5e45-45ac-9e95-dd000983bb8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:42.593443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1188ece172f411ea651cb14c023c95b', 'request_id': 'req-17a6c872-5e45-45ac-9e95-dd000983bb8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:42.595314 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 976/1985] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:42 2022] DELETE /identity/v3/users/2f1f8be15d1c49b2b18af4e5bedce7f5 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:42.599754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d5c46-c5d1-419e-9775-56318f51b4be None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:42.600219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d5c46-c5d1-419e-9775-56318f51b4be None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:42.600704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d5c46-c5d1-419e-9775-56318f51b4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:42.603085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1188ece172f411ea651cb14c023c95b', 'request_id': 'req-17a6c872-5e45-45ac-9e95-dd000983bb8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:42.625671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-496d5c46-c5d1-419e-9775-56318f51b4be None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:42.626914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-496d5c46-c5d1-419e-9775-56318f51b4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:42.691350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 977/1986] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:42.701569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d5c46-c5d1-419e-9775-56318f51b4be None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:42.702952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-496d5c46-c5d1-419e-9775-56318f51b4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:42.756455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] The token cache is being invalidate because project d1188ece172f411ea651cb14c023c95b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:42.756748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:42.757381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:42.757668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d5c46-c5d1-419e-9775-56318f51b4be None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:42.760561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1010/1987] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:42 2022] DELETE /identity/v3/projects/d1188ece172f411ea651cb14c023c95b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:42.763473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd727-d826-446a-a4af-e1140c419a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:42.763473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd727-d826-446a-a4af-e1140c419a38 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:42.763473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd727-d826-446a-a4af-e1140c419a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:42.763473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dd727-d826-446a-a4af-e1140c419a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:42.765146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7d5dd727-d826-446a-a4af-e1140c419a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:42.765582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:42.768055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:42.777360 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dd727-d826-446a-a4af-e1140c419a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:42.779290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dd727-d826-446a-a4af-e1140c419a38 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:42.793575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 978/1988] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:42.868376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6c872-5e45-45ac-9e95-dd000983bb8b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:42.874595 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:42.875387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:42.875729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:42.876051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] PATH_INFO: `/v3/users/6c8c79423d434d6ba16281f0d38926d4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:42.877669 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8c79423d434d6ba16281f0d38926d4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:42.880144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:43.024919 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:43.107853 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8c79423d434d6ba16281f0d38926d4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:43.108657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8c79423d434d6ba16281f0d38926d4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:43.162612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8c79423d434d6ba16281f0d38926d4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:43.163589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8c79423d434d6ba16281f0d38926d4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:43.173886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8c79423d434d6ba16281f0d38926d4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:43.195560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1011/1989] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:42 2022] DELETE /identity/v3/users/6c8c79423d434d6ba16281f0d38926d4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:43.317707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd727-d826-446a-a4af-e1140c419a38 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:43.319703 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7d5dd727-d826-446a-a4af-e1140c419a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:43.332755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dd727-d826-446a-a4af-e1140c419a38 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:43.397160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:43.397993 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:43.398403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:43.398885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] PATH_INFO: `/v3/projects/04fbfd6109b8464faa57709624c4b7f1` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:43.400383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04fbfd6109b8464faa57709624c4b7f1)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:43.403329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:43.555670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04fbfd6109b8464faa57709624c4b7f1', 'request_id': 'req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:43.562538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04fbfd6109b8464faa57709624c4b7f1', 'request_id': 'req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:43.569033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04fbfd6109b8464faa57709624c4b7f1', 'request_id': 'req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:43.668342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:43.673551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] The token cache is being invalidate because project 04fbfd6109b8464faa57709624c4b7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:43.673999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:43.674762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:43.679143 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 979/1990] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:43 2022] DELETE /identity/v3/projects/04fbfd6109b8464faa57709624c4b7f1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:43.680515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:43.682024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:43.699449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218ffe0-94ac-406d-8f2c-fbc803b72c13 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:43.746683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:43.749276 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:43.775842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed95dfd-c2a4-4f66-af3d-cf5ee998ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:43.776775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed95dfd-c2a4-4f66-af3d-cf5ee998ac32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:43.777371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed95dfd-c2a4-4f66-af3d-cf5ee998ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:43.778228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed95dfd-c2a4-4f66-af3d-cf5ee998ac32 admin admin] PATH_INFO: `/v3/users/63255abedcc340abacc4b347e6781cbc` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:43.779555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed95dfd-c2a4-4f66-af3d-cf5ee998ac32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63255abedcc340abacc4b347e6781cbc)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:43.781531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed95dfd-c2a4-4f66-af3d-cf5ee998ac32 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:43.825621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624ba3f-eb4a-4d3d-b640-6a36e0bb81c8 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:43.830251 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:43.830889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:43.831161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:43.831428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] PATH_INFO: `/v3/projects/337e638b197748b5ae21e49999197080` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:43.832546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=337e638b197748b5ae21e49999197080)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:43.834466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:44.063728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bed95dfd-c2a4-4f66-af3d-cf5ee998ac32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63255abedcc340abacc4b347e6781cbc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:44.064482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bed95dfd-c2a4-4f66-af3d-cf5ee998ac32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63255abedcc340abacc4b347e6781cbc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:44.071743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337e638b197748b5ae21e49999197080', 'request_id': 'req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:44.083975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337e638b197748b5ae21e49999197080', 'request_id': 'req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:44.103067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337e638b197748b5ae21e49999197080', 'request_id': 'req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:44.131160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:44.172904 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bed95dfd-c2a4-4f66-af3d-cf5ee998ac32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63255abedcc340abacc4b347e6781cbc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:44.173544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bed95dfd-c2a4-4f66-af3d-cf5ee998ac32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63255abedcc340abacc4b347e6781cbc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:44.182738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bed95dfd-c2a4-4f66-af3d-cf5ee998ac32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63255abedcc340abacc4b347e6781cbc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:44.218501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1012/1991] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:43 2022] DELETE /identity/v3/users/63255abedcc340abacc4b347e6781cbc => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:44.274910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] The token cache is being invalidate because project 337e638b197748b5ae21e49999197080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:44.278123 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:44.278123 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6eac7dc6-61fd-4f81-8a44-ebdd72273d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:44.280030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 980/1992] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:43 2022] DELETE /identity/v3/projects/337e638b197748b5ae21e49999197080 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:44.285893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdbb34-23a1-4b36-8b4f-360a34a61652 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:44.286252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdbb34-23a1-4b36-8b4f-360a34a61652 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:44.286483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdbb34-23a1-4b36-8b4f-360a34a61652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:44.331967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-74cdbb34-23a1-4b36-8b4f-360a34a61652 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:44.333889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-74cdbb34-23a1-4b36-8b4f-360a34a61652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:44.432226 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1013/1993] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:44.443593 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f56ee-f802-4fe0-9eeb-c56322042ee6 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:44.456037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f56ee-f802-4fe0-9eeb-c56322042ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:44.456037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f56ee-f802-4fe0-9eeb-c56322042ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:44.468706 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-1b7f56ee-f802-4fe0-9eeb-c56322042ee6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:44.469950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1b7f56ee-f802-4fe0-9eeb-c56322042ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:44.484165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 981/1994] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:44.501772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdbb34-23a1-4b36-8b4f-360a34a61652 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:44.526414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdbb34-23a1-4b36-8b4f-360a34a61652 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:44.535134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf248837-e49a-4e28-95a3-ccf5298cb502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:44.535899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf248837-e49a-4e28-95a3-ccf5298cb502 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:44.537416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf248837-e49a-4e28-95a3-ccf5298cb502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:44.538093 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf248837-e49a-4e28-95a3-ccf5298cb502 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:44.539432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf248837-e49a-4e28-95a3-ccf5298cb502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:44.540131 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf248837-e49a-4e28-95a3-ccf5298cb502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:44.542869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf248837-e49a-4e28-95a3-ccf5298cb502 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:44.559891 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1014/1995] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:44.564379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f56ee-f802-4fe0-9eeb-c56322042ee6 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:44.574661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f56ee-f802-4fe0-9eeb-c56322042ee6 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:44.579888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d845a76-641e-4363-b274-af5e4e33c351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:44.580510 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d845a76-641e-4363-b274-af5e4e33c351 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:44.580792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d845a76-641e-4363-b274-af5e4e33c351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:44.581072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d845a76-641e-4363-b274-af5e4e33c351 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:44.581712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d845a76-641e-4363-b274-af5e4e33c351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:44.583685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d845a76-641e-4363-b274-af5e4e33c351 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:45.143560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 982/1996] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:44 2022] POST /identity/v3/projects => generated 381 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:45.144697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf248837-e49a-4e28-95a3-ccf5298cb502 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:45.145454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d845a76-641e-4363-b274-af5e4e33c351 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:45.150771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5d845a76-641e-4363-b274-af5e4e33c351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:45.163996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf248837-e49a-4e28-95a3-ccf5298cb502 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:45.262895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d268-ff3c-4101-9946-baf08723b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:45.262895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d268-ff3c-4101-9946-baf08723b63e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:45.262895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d268-ff3c-4101-9946-baf08723b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:45.262895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d268-ff3c-4101-9946-baf08723b63e admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:45.263228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d268-ff3c-4101-9946-baf08723b63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:45.263228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d268-ff3c-4101-9946-baf08723b63e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:45.277298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d845a76-641e-4363-b274-af5e4e33c351 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:45.283788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:45.284627 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:45.284906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:45.285175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] PATH_INFO: `/v3/projects/59ffbaf73cc946168958f6c84592b29e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:45.286365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ffbaf73cc946168958f6c84592b29e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:45.288572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:45.787007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1015/1997] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:45 2022] POST /identity/v3/users => generated 291 bytes in 649 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:45.791761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d268-ff3c-4101-9946-baf08723b63e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:45.802599 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ffbaf73cc946168958f6c84592b29e', 'request_id': 'req-ebddf53f-efc5-4a3a-b96e-39f586ab5105'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:45.803204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d268-ff3c-4101-9946-baf08723b63e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:45.813553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ffbaf73cc946168958f6c84592b29e', 'request_id': 'req-ebddf53f-efc5-4a3a-b96e-39f586ab5105'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:45.820032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ffbaf73cc946168958f6c84592b29e', 'request_id': 'req-ebddf53f-efc5-4a3a-b96e-39f586ab5105'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:45.860549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23366c-cbb5-4930-abab-cdc7e65db8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:45.861172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23366c-cbb5-4930-abab-cdc7e65db8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:45.861446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23366c-cbb5-4930-abab-cdc7e65db8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:45.861715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23366c-cbb5-4930-abab-cdc7e65db8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:45.862360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23366c-cbb5-4930-abab-cdc7e65db8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:45.864193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23366c-cbb5-4930-abab-cdc7e65db8e5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:45.874607 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1016/1998] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:45.875878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23366c-cbb5-4930-abab-cdc7e65db8e5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:45.878790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7b23366c-cbb5-4930-abab-cdc7e65db8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:45.884141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] The token cache is being invalidate because project 59ffbaf73cc946168958f6c84592b29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:45.884605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:45.885243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:45.886864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 983/1999] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:45 2022] DELETE /identity/v3/projects/59ffbaf73cc946168958f6c84592b29e => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:45.887644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:45.890752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:45.891678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23366c-cbb5-4930-abab-cdc7e65db8e5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:45.896426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:45.899569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:45.900066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:45.900170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] PATH_INFO: `/v3/users/ef357e3f09754d1782c04bfcbee18559` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:45.902561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef357e3f09754d1782c04bfcbee18559)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:45.904442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddf53f-efc5-4a3a-b96e-39f586ab5105 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:45.904751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:45.910203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551eb9c-f2d2-44b6-936a-356641cc1bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:45.912239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551eb9c-f2d2-44b6-936a-356641cc1bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:45.912239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551eb9c-f2d2-44b6-936a-356641cc1bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:45.912239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551eb9c-f2d2-44b6-936a-356641cc1bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:45.912742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551eb9c-f2d2-44b6-936a-356641cc1bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:45.914916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551eb9c-f2d2-44b6-936a-356641cc1bc4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:45.927423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 984/2000] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:45.931649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551eb9c-f2d2-44b6-936a-356641cc1bc4 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:45.934600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d551eb9c-f2d2-44b6-936a-356641cc1bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:45.960867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551eb9c-f2d2-44b6-936a-356641cc1bc4 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:45.970231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb9710-3925-4111-bb1f-390f82243f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:45.971915 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb9710-3925-4111-bb1f-390f82243f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:45.972666 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb9710-3925-4111-bb1f-390f82243f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:45.979554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb9710-3925-4111-bb1f-390f82243f8c admin admin] PATH_INFO: `/v3/users/4baabec637a94b53818f0a00fd79759d` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:45.981836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb9710-3925-4111-bb1f-390f82243f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4baabec637a94b53818f0a00fd79759d)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:45.984376 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb9710-3925-4111-bb1f-390f82243f8c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:46.155772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef357e3f09754d1782c04bfcbee18559'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:46.156888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef357e3f09754d1782c04bfcbee18559'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:46.227946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3cbb9710-3925-4111-bb1f-390f82243f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4baabec637a94b53818f0a00fd79759d'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:46.228613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3cbb9710-3925-4111-bb1f-390f82243f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4baabec637a94b53818f0a00fd79759d'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:46.245172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef357e3f09754d1782c04bfcbee18559'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:46.245172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef357e3f09754d1782c04bfcbee18559'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:46.250408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef357e3f09754d1782c04bfcbee18559'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:46.269796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1017/2001] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:45 2022] DELETE /identity/v3/users/ef357e3f09754d1782c04bfcbee18559 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:46.273159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:46.273159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:46.337810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdbc1e-d7e6-43cc-865b-5dc0e47b5b61 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:46.344535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723b08e-4c4f-4bd6-91b8-298123e264b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:46.345207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b08e-4c4f-4bd6-91b8-298123e264b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:46.345480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b08e-4c4f-4bd6-91b8-298123e264b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:46.345750 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b08e-4c4f-4bd6-91b8-298123e264b9 admin admin] PATH_INFO: `/v3/projects/d98127c24e584b9eb24c810380719736/users/fe4bbfe058f84bcca810410041e635f6/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:46.355196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3cbb9710-3925-4111-bb1f-390f82243f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4baabec637a94b53818f0a00fd79759d'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:46.356453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3cbb9710-3925-4111-bb1f-390f82243f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4baabec637a94b53818f0a00fd79759d'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:46.362387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723b08e-4c4f-4bd6-91b8-298123e264b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98127c24e584b9eb24c810380719736, user_id=fe4bbfe058f84bcca810410041e635f6, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:46.369706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723b08e-4c4f-4bd6-91b8-298123e264b9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:46.369859 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3cbb9710-3925-4111-bb1f-390f82243f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4baabec637a94b53818f0a00fd79759d'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:46.385843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 985/2002] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:45 2022] DELETE /identity/v3/users/4baabec637a94b53818f0a00fd79759d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:46.387178 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1677e94-b6b2-4d54-aee3-dda7c2343d00 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:46.387462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1677e94-b6b2-4d54-aee3-dda7c2343d00 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:46.387729 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1677e94-b6b2-4d54-aee3-dda7c2343d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:46.409111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c1677e94-b6b2-4d54-aee3-dda7c2343d00 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:46.410626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c1677e94-b6b2-4d54-aee3-dda7c2343d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:46.456642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1018/2003] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:46 2022] PUT /identity/v3/projects/d98127c24e584b9eb24c810380719736/users/fe4bbfe058f84bcca810410041e635f6/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:46.470373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16298f1d-2454-49c3-b3b9-398a6ae838cb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:46.470950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16298f1d-2454-49c3-b3b9-398a6ae838cb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:46.471578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16298f1d-2454-49c3-b3b9-398a6ae838cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:46.483881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 986/2004] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:46.493932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1677e94-b6b2-4d54-aee3-dda7c2343d00 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:46.500143 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c1677e94-b6b2-4d54-aee3-dda7c2343d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:46.501966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-16298f1d-2454-49c3-b3b9-398a6ae838cb None None] MFA Rules not processed for user `fe4bbfe058f84bcca810410041e635f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:46.503222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-16298f1d-2454-49c3-b3b9-398a6ae838cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:46.567994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1677e94-b6b2-4d54-aee3-dda7c2343d00 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:46.576972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1019/2005] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:46.581965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16298f1d-2454-49c3-b3b9-398a6ae838cb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:46.583585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-16298f1d-2454-49c3-b3b9-398a6ae838cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:46.632914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447bc3d-4d09-4344-a310-488da88c33f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:46.634392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447bc3d-4d09-4344-a310-488da88c33f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:46.634702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447bc3d-4d09-4344-a310-488da88c33f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:46.635040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447bc3d-4d09-4344-a310-488da88c33f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:46.673052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16298f1d-2454-49c3-b3b9-398a6ae838cb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:46.679756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9b0db-8899-47ad-a1ca-052da703d6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:46.680123 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b0db-8899-47ad-a1ca-052da703d6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:46.680978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b0db-8899-47ad-a1ca-052da703d6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:46.681270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b0db-8899-47ad-a1ca-052da703d6e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:46.681922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9b0db-8899-47ad-a1ca-052da703d6e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:46.684624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9b0db-8899-47ad-a1ca-052da703d6e0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:46.704878 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447bc3d-4d09-4344-a310-488da88c33f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:46.706331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447bc3d-4d09-4344-a310-488da88c33f8 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:46.717118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 987/2006] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:46.744837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:46.781597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1020/2007] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:46 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:46.785962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447bc3d-4d09-4344-a310-488da88c33f8 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:46.796319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447bc3d-4d09-4344-a310-488da88c33f8 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:46.854572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80f665-d315-41e2-9d96-d55dbc311a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:46.855219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80f665-d315-41e2-9d96-d55dbc311a1c admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:46.855472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80f665-d315-41e2-9d96-d55dbc311a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:46.855833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80f665-d315-41e2-9d96-d55dbc311a1c admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:46.856536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80f665-d315-41e2-9d96-d55dbc311a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:46.858449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80f665-d315-41e2-9d96-d55dbc311a1c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:46.869717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9b0db-8899-47ad-a1ca-052da703d6e0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:46.871380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7ca9b0db-8899-47ad-a1ca-052da703d6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:46.884162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9b0db-8899-47ad-a1ca-052da703d6e0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:46.889835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:46.890547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:46.890905 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:46.891187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] PATH_INFO: `/v3/projects/a26a677de3e8435f9fee6ea432bfcfa3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:46.892344 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26a677de3e8435f9fee6ea432bfcfa3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:46.894538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:46.945133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 988/2008] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:46 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:46.948999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80f665-d315-41e2-9d96-d55dbc311a1c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:46.959165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80f665-d315-41e2-9d96-d55dbc311a1c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:46.965363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafbb63-c17e-4359-af32-06be8f3c9b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:46.968848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafbb63-c17e-4359-af32-06be8f3c9b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:46.968848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafbb63-c17e-4359-af32-06be8f3c9b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:46.968848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafbb63-c17e-4359-af32-06be8f3c9b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:46.968848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafbb63-c17e-4359-af32-06be8f3c9b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:46.968848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafbb63-c17e-4359-af32-06be8f3c9b20 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:46.978454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 989/2009] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:46.982448 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafbb63-c17e-4359-af32-06be8f3c9b20 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:46.992232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafbb63-c17e-4359-af32-06be8f3c9b20 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:46.997407 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75498306-0855-4642-a43d-acd2aa684168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:46.998024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75498306-0855-4642-a43d-acd2aa684168 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:46.998301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75498306-0855-4642-a43d-acd2aa684168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:46.998572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75498306-0855-4642-a43d-acd2aa684168 admin admin] PATH_INFO: `/v3/projects/745c0037fdc94b98b4d7d03bf5a0f1fb/users/20f6f0ef858349d3a60c6ca3f7395c3d/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.013571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75498306-0855-4642-a43d-acd2aa684168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745c0037fdc94b98b4d7d03bf5a0f1fb, user_id=20f6f0ef858349d3a60c6ca3f7395c3d, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:47.016329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75498306-0855-4642-a43d-acd2aa684168 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:47.034192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26a677de3e8435f9fee6ea432bfcfa3', 'request_id': 'req-79e54782-a3a4-42aa-ab71-c311d426871e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.041142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26a677de3e8435f9fee6ea432bfcfa3', 'request_id': 'req-79e54782-a3a4-42aa-ab71-c311d426871e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.048190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26a677de3e8435f9fee6ea432bfcfa3', 'request_id': 'req-79e54782-a3a4-42aa-ab71-c311d426871e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.132853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 990/2010] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:46 2022] PUT /identity/v3/projects/745c0037fdc94b98b4d7d03bf5a0f1fb/users/20f6f0ef858349d3a60c6ca3f7395c3d/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:47.136388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] The token cache is being invalidate because project a26a677de3e8435f9fee6ea432bfcfa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:47.136388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.136388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79e54782-a3a4-42aa-ab71-c311d426871e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.136640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1021/2011] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:46 2022] DELETE /identity/v3/projects/a26a677de3e8435f9fee6ea432bfcfa3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:47.137609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75498306-0855-4642-a43d-acd2aa684168 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:47.139408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-75498306-0855-4642-a43d-acd2aa684168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:47.141342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840d763-e417-4bfa-b756-be8ed4c81c93 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:47.141700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840d763-e417-4bfa-b756-be8ed4c81c93 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:47.142048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840d763-e417-4bfa-b756-be8ed4c81c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.163871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6840d763-e417-4bfa-b756-be8ed4c81c93 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:47.167337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6840d763-e417-4bfa-b756-be8ed4c81c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:47.223805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75498306-0855-4642-a43d-acd2aa684168 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:47.229770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285dea9-8ca5-4271-858e-1b7c37dbc932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:47.230543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285dea9-8ca5-4271-858e-1b7c37dbc932 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:47.230973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285dea9-8ca5-4271-858e-1b7c37dbc932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:47.231362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285dea9-8ca5-4271-858e-1b7c37dbc932 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.232074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285dea9-8ca5-4271-858e-1b7c37dbc932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:47.233814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285dea9-8ca5-4271-858e-1b7c37dbc932 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:47.247916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 991/2012] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:47.248967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285dea9-8ca5-4271-858e-1b7c37dbc932 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:47.258298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1022/2013] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:47.260862 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285dea9-8ca5-4271-858e-1b7c37dbc932 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:47.263326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d4ace-01d3-4f44-86ab-7c15715692c0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:47.263703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d4ace-01d3-4f44-86ab-7c15715692c0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:47.263995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d4ace-01d3-4f44-86ab-7c15715692c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.267192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c417d1-0106-400d-908e-88dd66cbba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:47.267887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c417d1-0106-400d-908e-88dd66cbba43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:47.268171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c417d1-0106-400d-908e-88dd66cbba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:47.268448 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c417d1-0106-400d-908e-88dd66cbba43 admin admin] PATH_INFO: `/v3/projects/745c0037fdc94b98b4d7d03bf5a0f1fb/users/20f6f0ef858349d3a60c6ca3f7395c3d/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.270624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c417d1-0106-400d-908e-88dd66cbba43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745c0037fdc94b98b4d7d03bf5a0f1fb, user_id=20f6f0ef858349d3a60c6ca3f7395c3d, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:47.273397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c417d1-0106-400d-908e-88dd66cbba43 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:47.286770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 992/2014] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:47 2022] PUT /identity/v3/projects/745c0037fdc94b98b4d7d03bf5a0f1fb/users/20f6f0ef858349d3a60c6ca3f7395c3d/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:47.294854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c417d1-0106-400d-908e-88dd66cbba43 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:47.297124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-05c417d1-0106-400d-908e-88dd66cbba43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:47.297238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7d5d4ace-01d3-4f44-86ab-7c15715692c0 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:47.298635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7d5d4ace-01d3-4f44-86ab-7c15715692c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:47.358273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:47.370842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1023/2015] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:47.372770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fd700-6243-4163-be4e-c205df021002 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:47.373144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fd700-6243-4163-be4e-c205df021002 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:47.373470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fd700-6243-4163-be4e-c205df021002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.397949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c417d1-0106-400d-908e-88dd66cbba43 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:47.402121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:47.403165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:47.403290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:47.403641 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] PATH_INFO: `/v3/projects/de41eb5b2e0849888c1bc4aadae97833` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.404800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de41eb5b2e0849888c1bc4aadae97833)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:47.406898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:47.412959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-669fd700-6243-4163-be4e-c205df021002 None None] MFA Rules not processed for user `20f6f0ef858349d3a60c6ca3f7395c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:47.414480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-669fd700-6243-4163-be4e-c205df021002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:47.502260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1024/2016] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:47.502260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fd700-6243-4163-be4e-c205df021002 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:47.503714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-669fd700-6243-4163-be4e-c205df021002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:47.535921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de41eb5b2e0849888c1bc4aadae97833', 'request_id': 'req-1c36e284-c1ce-4465-9c65-d2582ad59a8b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.541877 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de41eb5b2e0849888c1bc4aadae97833', 'request_id': 'req-1c36e284-c1ce-4465-9c65-d2582ad59a8b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.548968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de41eb5b2e0849888c1bc4aadae97833', 'request_id': 'req-1c36e284-c1ce-4465-9c65-d2582ad59a8b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.564572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fd700-6243-4163-be4e-c205df021002 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:47.612231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fb10e-f393-42e4-a827-428cd155bc29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:47.612836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fb10e-f393-42e4-a827-428cd155bc29 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:47.613110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fb10e-f393-42e4-a827-428cd155bc29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:47.613377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fb10e-f393-42e4-a827-428cd155bc29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.615129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-468fb10e-f393-42e4-a827-428cd155bc29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:47.624742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] The token cache is being invalidate because project de41eb5b2e0849888c1bc4aadae97833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:47.625256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.625784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.627656 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 993/2017] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:47 2022] DELETE /identity/v3/projects/de41eb5b2e0849888c1bc4aadae97833 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:47.632135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:47.632135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:47.688834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fb10e-f393-42e4-a827-428cd155bc29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:47.691178 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fb10e-f393-42e4-a827-428cd155bc29 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:47.698863 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36e284-c1ce-4465-9c65-d2582ad59a8b admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:47.703634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53007be-99ed-43ad-b290-9a305ba688e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:47.704246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53007be-99ed-43ad-b290-9a305ba688e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:47.704524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53007be-99ed-43ad-b290-9a305ba688e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:47.704796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53007be-99ed-43ad-b290-9a305ba688e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.705442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53007be-99ed-43ad-b290-9a305ba688e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:47.705672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1025/2018] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:47.705872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53007be-99ed-43ad-b290-9a305ba688e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:47.706595 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fb10e-f393-42e4-a827-428cd155bc29 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:47.707384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53007be-99ed-43ad-b290-9a305ba688e9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:47.708005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-468fb10e-f393-42e4-a827-428cd155bc29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:47.720941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fb10e-f393-42e4-a827-428cd155bc29 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:47.721884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 994/2019] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:47.726419 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53007be-99ed-43ad-b290-9a305ba688e9 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:47.727513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858cf8a-e093-4e20-ab57-2cc9b21306ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:47.728240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858cf8a-e093-4e20-ab57-2cc9b21306ea service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:47.728347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f53007be-99ed-43ad-b290-9a305ba688e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:47.728523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858cf8a-e093-4e20-ab57-2cc9b21306ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:47.728928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858cf8a-e093-4e20-ab57-2cc9b21306ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.731369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0858cf8a-e093-4e20-ab57-2cc9b21306ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:47.745369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53007be-99ed-43ad-b290-9a305ba688e9 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:47.750932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:47.751567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:47.751864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:47.752152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] PATH_INFO: `/v3/users/8dfae0eb360e45968406aa98ccc3e0b5` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.753399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dfae0eb360e45968406aa98ccc3e0b5)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:47.755405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:47.805802 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858cf8a-e093-4e20-ab57-2cc9b21306ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:47.807300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858cf8a-e093-4e20-ab57-2cc9b21306ea service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:47.817195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1026/2020] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:47.817980 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858cf8a-e093-4e20-ab57-2cc9b21306ea service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:47.827910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858cf8a-e093-4e20-ab57-2cc9b21306ea service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:47.833095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788a44e-7e83-435d-b5ad-091f85291d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:47.834203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a44e-7e83-435d-b5ad-091f85291d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:47.834477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a44e-7e83-435d-b5ad-091f85291d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:47.834778 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a44e-7e83-435d-b5ad-091f85291d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:47.835557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788a44e-7e83-435d-b5ad-091f85291d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:47.840678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788a44e-7e83-435d-b5ad-091f85291d4c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:47.978362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dfae0eb360e45968406aa98ccc3e0b5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.979147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dfae0eb360e45968406aa98ccc3e0b5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:47.983761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1027/2021] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:47 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:47.988351 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788a44e-7e83-435d-b5ad-091f85291d4c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:48.065905 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788a44e-7e83-435d-b5ad-091f85291d4c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:48.073278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dfae0eb360e45968406aa98ccc3e0b5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:48.073278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dfae0eb360e45968406aa98ccc3e0b5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:48.073639 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9176cf-780e-46f0-8ce3-a70f587eec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:48.073639 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9176cf-780e-46f0-8ce3-a70f587eec63 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:48.073639 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9176cf-780e-46f0-8ce3-a70f587eec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:48.073639 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9176cf-780e-46f0-8ce3-a70f587eec63 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:48.073985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9176cf-780e-46f0-8ce3-a70f587eec63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:48.076453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9176cf-780e-46f0-8ce3-a70f587eec63 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:48.082184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dfae0eb360e45968406aa98ccc3e0b5'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:48.106882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 995/2022] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:47 2022] DELETE /identity/v3/users/8dfae0eb360e45968406aa98ccc3e0b5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:48.169735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1028/2023] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:47 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:48.173757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:48.175956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:48.261415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb42ee-1842-4237-822d-dcf84a53945d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:48.266200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cecd5-2a67-4b72-9f53-961ad86d251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:48.266837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cecd5-2a67-4b72-9f53-961ad86d251c admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:48.267115 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cecd5-2a67-4b72-9f53-961ad86d251c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:48.267381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cecd5-2a67-4b72-9f53-961ad86d251c admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:48.268015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cecd5-2a67-4b72-9f53-961ad86d251c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:48.269617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cecd5-2a67-4b72-9f53-961ad86d251c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:48.282383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 996/2024] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:48.283795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9176cf-780e-46f0-8ce3-a70f587eec63 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:48.295051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9176cf-780e-46f0-8ce3-a70f587eec63 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:48.299769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63045241-a278-4ca0-bb42-982f3c91e71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:48.300386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63045241-a278-4ca0-bb42-982f3c91e71a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:48.303075 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63045241-a278-4ca0-bb42-982f3c91e71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:48.303075 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63045241-a278-4ca0-bb42-982f3c91e71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:48.303075 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63045241-a278-4ca0-bb42-982f3c91e71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:48.303362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63045241-a278-4ca0-bb42-982f3c91e71a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:48.314276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1029/2025] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:48.318621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cecd5-2a67-4b72-9f53-961ad86d251c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:48.337262 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cecd5-2a67-4b72-9f53-961ad86d251c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:48.343225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b89e0a-91b5-4b12-8e2e-c473a7d19a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:48.344043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89e0a-91b5-4b12-8e2e-c473a7d19a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:48.344436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89e0a-91b5-4b12-8e2e-c473a7d19a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:48.345591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b89e0a-91b5-4b12-8e2e-c473a7d19a59 admin admin] PATH_INFO: `/v3/projects/75d8356d96a04e85beea0e09a492e3c9/users/394e704d41eb4b1c9b4d83474acf9981/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:48.363439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b89e0a-91b5-4b12-8e2e-c473a7d19a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d8356d96a04e85beea0e09a492e3c9, user_id=394e704d41eb4b1c9b4d83474acf9981, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:48.366146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b89e0a-91b5-4b12-8e2e-c473a7d19a59 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:48.454269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63045241-a278-4ca0-bb42-982f3c91e71a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:48.464748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-63045241-a278-4ca0-bb42-982f3c91e71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:48.467500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 997/2026] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:48 2022] PUT /identity/v3/projects/75d8356d96a04e85beea0e09a492e3c9/users/394e704d41eb4b1c9b4d83474acf9981/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:48.469018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0665bf-b95d-4627-9521-37859094108c None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:48.469310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0665bf-b95d-4627-9521-37859094108c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:48.469584 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0665bf-b95d-4627-9521-37859094108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:48.491984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63045241-a278-4ca0-bb42-982f3c91e71a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:48.518179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-5b0665bf-b95d-4627-9521-37859094108c None None] MFA Rules not processed for user `394e704d41eb4b1c9b4d83474acf9981`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:48.519609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5b0665bf-b95d-4627-9521-37859094108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:48.560644 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:48.561291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:48.561570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:48.561886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] PATH_INFO: `/v3/users/fe4bbfe058f84bcca810410041e635f6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:48.563117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4bbfe058f84bcca810410041e635f6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:48.565239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:48.631991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 998/2027] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:48.632892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0665bf-b95d-4627-9521-37859094108c None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:48.634809 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5b0665bf-b95d-4627-9521-37859094108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:48.656784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0665bf-b95d-4627-9521-37859094108c None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:48.661578 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:48.662356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:48.662644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:48.662954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] PATH_INFO: `/v3/projects/988e532ac3af46b1b9e36a785d17f261` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:48.664441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988e532ac3af46b1b9e36a785d17f261)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:48.666890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:48.885390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4bbfe058f84bcca810410041e635f6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:48.885937 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988e532ac3af46b1b9e36a785d17f261', 'request_id': 'req-2aa65d91-e21c-470d-8545-530991ec9ff1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:48.886087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4bbfe058f84bcca810410041e635f6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:48.891714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988e532ac3af46b1b9e36a785d17f261', 'request_id': 'req-2aa65d91-e21c-470d-8545-530991ec9ff1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:48.898068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988e532ac3af46b1b9e36a785d17f261', 'request_id': 'req-2aa65d91-e21c-470d-8545-530991ec9ff1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:48.899586 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:48.979797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4bbfe058f84bcca810410041e635f6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:48.980421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4bbfe058f84bcca810410041e635f6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:48.989951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4bbfe058f84bcca810410041e635f6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:49.008038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1030/2028] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:48 2022] DELETE /identity/v3/users/fe4bbfe058f84bcca810410041e635f6 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:49.008937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.010312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:49.075786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf3602-c963-4b05-b581-1d7ff96d1ca8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.082367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34693fa-617b-4d9e-afaa-f0152794bbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.083013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34693fa-617b-4d9e-afaa-f0152794bbbd admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.083292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34693fa-617b-4d9e-afaa-f0152794bbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.083586 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34693fa-617b-4d9e-afaa-f0152794bbbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.084645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34693fa-617b-4d9e-afaa-f0152794bbbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.086497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34693fa-617b-4d9e-afaa-f0152794bbbd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.089067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] The token cache is being invalidate because project 988e532ac3af46b1b9e36a785d17f261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:49.089574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:49.090326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2aa65d91-e21c-470d-8545-530991ec9ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:49.095892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 999/2029] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:48 2022] DELETE /identity/v3/projects/988e532ac3af46b1b9e36a785d17f261 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:49.097275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b645f7-1031-468a-8fd9-cc9aabab8607 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.097662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b645f7-1031-468a-8fd9-cc9aabab8607 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.098095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b645f7-1031-468a-8fd9-cc9aabab8607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.118365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-20b645f7-1031-468a-8fd9-cc9aabab8607 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:49.119620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-20b645f7-1031-468a-8fd9-cc9aabab8607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:49.128133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1000/2030] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:49.129485 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f0bf-6c2a-48d7-94f7-dcd4b5fd9b9f None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.129765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f0bf-6c2a-48d7-94f7-dcd4b5fd9b9f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.130030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5f0bf-6c2a-48d7-94f7-dcd4b5fd9b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.149234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-10d5f0bf-6c2a-48d7-94f7-dcd4b5fd9b9f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:49.150428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-10d5f0bf-6c2a-48d7-94f7-dcd4b5fd9b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:49.158524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1001/2031] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:49.159158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5f0bf-6c2a-48d7-94f7-dcd4b5fd9b9f None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.160337 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-10d5f0bf-6c2a-48d7-94f7-dcd4b5fd9b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:49.190218 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:49.193723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1031/2032] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:49 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:49.195289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d28cd-4933-4931-ab50-1aafd75abfb9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.195581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d28cd-4933-4931-ab50-1aafd75abfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.195980 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d28cd-4933-4931-ab50-1aafd75abfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.220574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-849d28cd-4933-4931-ab50-1aafd75abfb9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:49.220574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-849d28cd-4933-4931-ab50-1aafd75abfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:49.223695 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5f0bf-6c2a-48d7-94f7-dcd4b5fd9b9f None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.273936 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbea8c1-2382-41b9-ba67-3d853fc690ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.274557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea8c1-2382-41b9-ba67-3d853fc690ad service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.274880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea8c1-2382-41b9-ba67-3d853fc690ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.275154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea8c1-2382-41b9-ba67-3d853fc690ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.276847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1032/2033] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:49.278387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d28cd-4933-4931-ab50-1aafd75abfb9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.279908 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-849d28cd-4933-4931-ab50-1aafd75abfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:49.288550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbea8c1-2382-41b9-ba67-3d853fc690ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.290010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbea8c1-2382-41b9-ba67-3d853fc690ad service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.292378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d28cd-4933-4931-ab50-1aafd75abfb9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.297888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3479c5-e422-44af-9c2d-dfa1da684b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.298491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3479c5-e422-44af-9c2d-dfa1da684b98 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.298807 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3479c5-e422-44af-9c2d-dfa1da684b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.299079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3479c5-e422-44af-9c2d-dfa1da684b98 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.299736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3479c5-e422-44af-9c2d-dfa1da684b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.300363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1002/2034] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:49.301160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbea8c1-2382-41b9-ba67-3d853fc690ad service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.301887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3479c5-e422-44af-9c2d-dfa1da684b98 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.310227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbea8c1-2382-41b9-ba67-3d853fc690ad service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.316423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92aa09-3f45-4ec1-9ce9-5267cb18cc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.317188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92aa09-3f45-4ec1-9ce9-5267cb18cc7f admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.317827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92aa09-3f45-4ec1-9ce9-5267cb18cc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.317827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92aa09-3f45-4ec1-9ce9-5267cb18cc7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.318346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92aa09-3f45-4ec1-9ce9-5267cb18cc7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:49.318684 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92aa09-3f45-4ec1-9ce9-5267cb18cc7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.320294 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92aa09-3f45-4ec1-9ce9-5267cb18cc7f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.331997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1003/2035] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:49.336298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92aa09-3f45-4ec1-9ce9-5267cb18cc7f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.346884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92aa09-3f45-4ec1-9ce9-5267cb18cc7f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.351928 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bd95a-3a11-44ea-9055-6a6883cddb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.352613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bd95a-3a11-44ea-9055-6a6883cddb43 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.352891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bd95a-3a11-44ea-9055-6a6883cddb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.353169 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bd95a-3a11-44ea-9055-6a6883cddb43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.353818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bd95a-3a11-44ea-9055-6a6883cddb43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.356465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bd95a-3a11-44ea-9055-6a6883cddb43 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.424347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1033/2036] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:49 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:49.428168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3479c5-e422-44af-9c2d-dfa1da684b98 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.437703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3479c5-e422-44af-9c2d-dfa1da684b98 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.442262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be937c8-3f9a-4baa-9201-f3839da27bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.442859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be937c8-3f9a-4baa-9201-f3839da27bef admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.443135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be937c8-3f9a-4baa-9201-f3839da27bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.443401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be937c8-3f9a-4baa-9201-f3839da27bef admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.444022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be937c8-3f9a-4baa-9201-f3839da27bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.445630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be937c8-3f9a-4baa-9201-f3839da27bef admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.457140 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1004/2037] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:49 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:49.457349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1034/2038] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:49.459998 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bd95a-3a11-44ea-9055-6a6883cddb43 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.460118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be937c8-3f9a-4baa-9201-f3839da27bef admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.470704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be937c8-3f9a-4baa-9201-f3839da27bef admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.525677 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bd95a-3a11-44ea-9055-6a6883cddb43 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.531969 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbce47-ac6a-40a8-ba41-a1da8963dc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.532801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbce47-ac6a-40a8-ba41-a1da8963dc26 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.535022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbce47-ac6a-40a8-ba41-a1da8963dc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.535314 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbce47-ac6a-40a8-ba41-a1da8963dc26 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.535994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbce47-ac6a-40a8-ba41-a1da8963dc26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.538031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbce47-ac6a-40a8-ba41-a1da8963dc26 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.542810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af9d79-53f8-465c-b0f2-e201351acc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.544208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af9d79-53f8-465c-b0f2-e201351acc53 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.544583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af9d79-53f8-465c-b0f2-e201351acc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.544956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af9d79-53f8-465c-b0f2-e201351acc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.545794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af9d79-53f8-465c-b0f2-e201351acc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.547814 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af9d79-53f8-465c-b0f2-e201351acc53 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.560611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1035/2039] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:49.564778 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af9d79-53f8-465c-b0f2-e201351acc53 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.577078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af9d79-53f8-465c-b0f2-e201351acc53 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.583084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5f082-8acb-46fd-a669-4e9bad9edbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.583748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f082-8acb-46fd-a669-4e9bad9edbb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.584027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f082-8acb-46fd-a669-4e9bad9edbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.584353 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5f082-8acb-46fd-a669-4e9bad9edbb6 admin admin] PATH_INFO: `/v3/projects/285f6ef75a8c45f2945b9f51b4f5d279/users/c7f341c8fc7d48f3a86020d1b865831a/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.606818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5f082-8acb-46fd-a669-4e9bad9edbb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285f6ef75a8c45f2945b9f51b4f5d279, user_id=c7f341c8fc7d48f3a86020d1b865831a, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.607538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5f082-8acb-46fd-a669-4e9bad9edbb6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.683565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1005/2040] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:49 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:49.684086 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1036/2041] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:49 2022] PUT /identity/v3/projects/285f6ef75a8c45f2945b9f51b4f5d279/users/c7f341c8fc7d48f3a86020d1b865831a/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:49.687756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbce47-ac6a-40a8-ba41-a1da8963dc26 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.694237 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361c7b-1cb9-4063-ad27-e68b109f9a61 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.694582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361c7b-1cb9-4063-ad27-e68b109f9a61 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.694880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86361c7b-1cb9-4063-ad27-e68b109f9a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.700845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbce47-ac6a-40a8-ba41-a1da8963dc26 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.729376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-86361c7b-1cb9-4063-ad27-e68b109f9a61 None None] MFA Rules not processed for user `c7f341c8fc7d48f3a86020d1b865831a`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:49.730707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-86361c7b-1cb9-4063-ad27-e68b109f9a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:49.769019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5593926-0add-4bb9-8007-bbcf45911431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.769728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593926-0add-4bb9-8007-bbcf45911431 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.770334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593926-0add-4bb9-8007-bbcf45911431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.770453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5593926-0add-4bb9-8007-bbcf45911431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.771188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5593926-0add-4bb9-8007-bbcf45911431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.772989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5593926-0add-4bb9-8007-bbcf45911431 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.791233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1006/2042] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:49.791677 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5593926-0add-4bb9-8007-bbcf45911431 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.793628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f5593926-0add-4bb9-8007-bbcf45911431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:49.806329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5593926-0add-4bb9-8007-bbcf45911431 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.807142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1037/2043] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:49.808255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361c7b-1cb9-4063-ad27-e68b109f9a61 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.819655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.819655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.819655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.819655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] PATH_INFO: `/v3/projects/d98127c24e584b9eb24c810380719736` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.820357 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98127c24e584b9eb24c810380719736)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.820357 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.820612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86361c7b-1cb9-4063-ad27-e68b109f9a61 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.825698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790ce3e-4aba-4e6e-8929-2b589207ad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.826296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790ce3e-4aba-4e6e-8929-2b589207ad3b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.826572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790ce3e-4aba-4e6e-8929-2b589207ad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.826962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790ce3e-4aba-4e6e-8929-2b589207ad3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.827604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790ce3e-4aba-4e6e-8929-2b589207ad3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.829234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790ce3e-4aba-4e6e-8929-2b589207ad3b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.841122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1038/2044] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:49.841122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790ce3e-4aba-4e6e-8929-2b589207ad3b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:49.851312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790ce3e-4aba-4e6e-8929-2b589207ad3b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:49.856309 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f5588-a294-4496-9034-70babbc9f681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:49.856901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f5588-a294-4496-9034-70babbc9f681 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:49.857182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f5588-a294-4496-9034-70babbc9f681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:49.857458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f5588-a294-4496-9034-70babbc9f681 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:49.858112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f5588-a294-4496-9034-70babbc9f681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:49.860050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f5588-a294-4496-9034-70babbc9f681 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:49.950353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98127c24e584b9eb24c810380719736', 'request_id': 'req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:49.955799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98127c24e584b9eb24c810380719736', 'request_id': 'req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:49.961903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98127c24e584b9eb24c810380719736', 'request_id': 'req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:49.986256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1039/2045] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:49 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:49.992899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f5588-a294-4496-9034-70babbc9f681 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:50.046340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] The token cache is being invalidate because project d98127c24e584b9eb24c810380719736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:50.046634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:50.047515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:50.049186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1007/2046] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:49 2022] DELETE /identity/v3/projects/d98127c24e584b9eb24c810380719736 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:50.049938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:50.050685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f5588-a294-4496-9034-70babbc9f681 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:50.051392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:50.056273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a5ec-c2ea-4cd6-adbf-d251c0544577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:50.056960 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a5ec-c2ea-4cd6-adbf-d251c0544577 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:50.057816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a5ec-c2ea-4cd6-adbf-d251c0544577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:50.058100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376a5ec-c2ea-4cd6-adbf-d251c0544577 admin admin] PATH_INFO: `/v3/projects/47a76b04ca2e4e8d9a552ac086e01b8c/users/5e143ef3733a40efa2b2b5385b42e1a7/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:50.074064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376a5ec-c2ea-4cd6-adbf-d251c0544577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a76b04ca2e4e8d9a552ac086e01b8c, user_id=5e143ef3733a40efa2b2b5385b42e1a7, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:50.077484 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376a5ec-c2ea-4cd6-adbf-d251c0544577 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:50.116335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2f42e-18d1-49a1-aa2d-a642ab5486a7 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:50.121802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca15e51-6419-4c4b-941b-fcdb2f95babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:50.122454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15e51-6419-4c4b-941b-fcdb2f95babc admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:50.122767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15e51-6419-4c4b-941b-fcdb2f95babc admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:50.123057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca15e51-6419-4c4b-941b-fcdb2f95babc admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:50.123713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15e51-6419-4c4b-941b-fcdb2f95babc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:50.125651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca15e51-6419-4c4b-941b-fcdb2f95babc admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:50.194656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1040/2047] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:49 2022] PUT /identity/v3/projects/47a76b04ca2e4e8d9a552ac086e01b8c/users/5e143ef3733a40efa2b2b5385b42e1a7/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:50.196300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a5ec-c2ea-4cd6-adbf-d251c0544577 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:50.197241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8376a5ec-c2ea-4cd6-adbf-d251c0544577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:50.224875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1008/2048] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:50 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:50.224875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6298515-0d15-4c05-a44e-f2c6d4ef0231 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:50.224875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6298515-0d15-4c05-a44e-f2c6d4ef0231 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:50.224875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6298515-0d15-4c05-a44e-f2c6d4ef0231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:50.264445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-f6298515-0d15-4c05-a44e-f2c6d4ef0231 None None] MFA Rules not processed for user `5e143ef3733a40efa2b2b5385b42e1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:50.265854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f6298515-0d15-4c05-a44e-f2c6d4ef0231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:50.285492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376a5ec-c2ea-4cd6-adbf-d251c0544577 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:50.290938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:50.291596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:50.291992 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:50.292275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] PATH_INFO: `/v3/users/20f6f0ef858349d3a60c6ca3f7395c3d` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:50.293606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f6f0ef858349d3a60c6ca3f7395c3d)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:50.295654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:50.342070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1009/2049] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:50.342967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6298515-0d15-4c05-a44e-f2c6d4ef0231 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:50.353280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6298515-0d15-4c05-a44e-f2c6d4ef0231 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:50.358434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63b5a1-02e2-4dff-a513-e531f595f3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:50.359072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b5a1-02e2-4dff-a513-e531f595f3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:50.359356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b5a1-02e2-4dff-a513-e531f595f3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:50.359638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b5a1-02e2-4dff-a513-e531f595f3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:50.360281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63b5a1-02e2-4dff-a513-e531f595f3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:50.361895 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63b5a1-02e2-4dff-a513-e531f595f3b6 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:50.372514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1010/2050] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:50.373311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63b5a1-02e2-4dff-a513-e531f595f3b6 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:50.375027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-8b63b5a1-02e2-4dff-a513-e531f595f3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:50.387511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63b5a1-02e2-4dff-a513-e531f595f3b6 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:50.392276 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f812897-b8d5-42fd-b2e2-743df68c28b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:50.392882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f812897-b8d5-42fd-b2e2-743df68c28b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:50.393163 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f812897-b8d5-42fd-b2e2-743df68c28b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:50.393439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f812897-b8d5-42fd-b2e2-743df68c28b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:50.394064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f812897-b8d5-42fd-b2e2-743df68c28b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:50.396047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f812897-b8d5-42fd-b2e2-743df68c28b2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:50.425672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:50.483489 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1011/2051] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:50 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:50.484686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f812897-b8d5-42fd-b2e2-743df68c28b2 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:50.519987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f6f0ef858349d3a60c6ca3f7395c3d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:50.520659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f6f0ef858349d3a60c6ca3f7395c3d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:50.552166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f812897-b8d5-42fd-b2e2-743df68c28b2 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:50.557056 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3bad1-1c7a-4f4b-9247-17b8c9cb842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:50.557719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bad1-1c7a-4f4b-9247-17b8c9cb842c admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:50.558002 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bad1-1c7a-4f4b-9247-17b8c9cb842c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:50.558279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bad1-1c7a-4f4b-9247-17b8c9cb842c admin admin] PATH_INFO: `/v3/projects/f14ea67ec336456b96bd9f68f3424f4c/users/13b37df040bc429aaf784b81b974762d/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:50.574045 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3bad1-1c7a-4f4b-9247-17b8c9cb842c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14ea67ec336456b96bd9f68f3424f4c, user_id=13b37df040bc429aaf784b81b974762d, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:50.588593 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3bad1-1c7a-4f4b-9247-17b8c9cb842c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:50.637680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f6f0ef858349d3a60c6ca3f7395c3d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:50.638460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f6f0ef858349d3a60c6ca3f7395c3d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:50.648394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f6f0ef858349d3a60c6ca3f7395c3d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:50.667581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1041/2052] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:50 2022] DELETE /identity/v3/users/20f6f0ef858349d3a60c6ca3f7395c3d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:50.669222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:50.672486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:50.677040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1012/2053] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:50 2022] PUT /identity/v3/projects/f14ea67ec336456b96bd9f68f3424f4c/users/13b37df040bc429aaf784b81b974762d/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:50.682125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3bad1-1c7a-4f4b-9247-17b8c9cb842c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:50.686986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c7c3bad1-1c7a-4f4b-9247-17b8c9cb842c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:50.757870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519b150-94b5-4254-9325-655b9433883c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:50.762683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c3565-b05b-48a4-a3de-b0252a7363f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:50.763307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c3565-b05b-48a4-a3de-b0252a7363f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:50.763578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c3565-b05b-48a4-a3de-b0252a7363f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:50.763844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c3565-b05b-48a4-a3de-b0252a7363f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:50.764736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c3565-b05b-48a4-a3de-b0252a7363f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:50.766759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c3565-b05b-48a4-a3de-b0252a7363f7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:50.782557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3bad1-1c7a-4f4b-9247-17b8c9cb842c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:50.787642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b94a-7b5f-4772-a64f-0b53b443026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:50.789519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b94a-7b5f-4772-a64f-0b53b443026e admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:50.789519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b94a-7b5f-4772-a64f-0b53b443026e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:50.789519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b94a-7b5f-4772-a64f-0b53b443026e admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:50.789816 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988b94a-7b5f-4772-a64f-0b53b443026e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:50.791552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988b94a-7b5f-4772-a64f-0b53b443026e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:50.802743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1013/2054] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:50.807171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b94a-7b5f-4772-a64f-0b53b443026e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:50.816760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b94a-7b5f-4772-a64f-0b53b443026e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:50.821562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65886eba-9732-4dfe-94bf-d8af488fc3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:50.822219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65886eba-9732-4dfe-94bf-d8af488fc3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:50.822498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65886eba-9732-4dfe-94bf-d8af488fc3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:50.822808 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65886eba-9732-4dfe-94bf-d8af488fc3c4 admin admin] PATH_INFO: `/v3/projects/f14ea67ec336456b96bd9f68f3424f4c/users/13b37df040bc429aaf784b81b974762d/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:50.824775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65886eba-9732-4dfe-94bf-d8af488fc3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14ea67ec336456b96bd9f68f3424f4c, user_id=13b37df040bc429aaf784b81b974762d, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:50.827478 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65886eba-9732-4dfe-94bf-d8af488fc3c4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:50.837845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1014/2055] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:50 2022] PUT /identity/v3/projects/f14ea67ec336456b96bd9f68f3424f4c/users/13b37df040bc429aaf784b81b974762d/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:50.849231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe717-b20a-485b-8da4-a6ecf651774d None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:50.849514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe717-b20a-485b-8da4-a6ecf651774d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:50.849786 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe717-b20a-485b-8da4-a6ecf651774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:50.877945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-f7fbe717-b20a-485b-8da4-a6ecf651774d None None] MFA Rules not processed for user `13b37df040bc429aaf784b81b974762d`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:50.879203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f7fbe717-b20a-485b-8da4-a6ecf651774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:50.967396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1015/2056] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:50.978473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbe717-b20a-485b-8da4-a6ecf651774d None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:50.983636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f7fbe717-b20a-485b-8da4-a6ecf651774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:50.994457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1042/2057] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:50 2022] POST /identity/v3/users => generated 298 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:50.995730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c3565-b05b-48a4-a3de-b0252a7363f7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:51.013430 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c3565-b05b-48a4-a3de-b0252a7363f7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:51.062628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbe717-b20a-485b-8da4-a6ecf651774d None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:51.066965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac466bd-39fb-4a32-a54f-9b5a98e6264c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:51.067937 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac466bd-39fb-4a32-a54f-9b5a98e6264c service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.068104 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac466bd-39fb-4a32-a54f-9b5a98e6264c service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.068501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac466bd-39fb-4a32-a54f-9b5a98e6264c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.070791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-8ac466bd-39fb-4a32-a54f-9b5a98e6264c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:51.090910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6808b3-14fe-4de7-970e-02045540dd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:51.091720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6808b3-14fe-4de7-970e-02045540dd26 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.095132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6808b3-14fe-4de7-970e-02045540dd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.095132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6808b3-14fe-4de7-970e-02045540dd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.095132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6808b3-14fe-4de7-970e-02045540dd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:51.095132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6808b3-14fe-4de7-970e-02045540dd26 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:51.108892 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1043/2058] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:51.112900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6808b3-14fe-4de7-970e-02045540dd26 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:51.124505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6808b3-14fe-4de7-970e-02045540dd26 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:51.130218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8b15-6623-4710-aa43-ba3e36580038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:51.131307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8b15-6623-4710-aa43-ba3e36580038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.131585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8b15-6623-4710-aa43-ba3e36580038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.131858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8b15-6623-4710-aa43-ba3e36580038 admin admin] PATH_INFO: `/v3/projects/249138cd04f74861b3c7737ae014f375/users/5fe56bef8fc94c98b967fe2a8edc72f4/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.149338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8b15-6623-4710-aa43-ba3e36580038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249138cd04f74861b3c7737ae014f375, user_id=5fe56bef8fc94c98b967fe2a8edc72f4, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:51.153273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8b15-6623-4710-aa43-ba3e36580038 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:51.158301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac466bd-39fb-4a32-a54f-9b5a98e6264c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:51.158301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac466bd-39fb-4a32-a54f-9b5a98e6264c service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:51.166042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1016/2059] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:51.221771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac466bd-39fb-4a32-a54f-9b5a98e6264c service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:51.223342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-8ac466bd-39fb-4a32-a54f-9b5a98e6264c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:51.256770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac466bd-39fb-4a32-a54f-9b5a98e6264c service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:51.257443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1044/2060] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:51 2022] PUT /identity/v3/projects/249138cd04f74861b3c7737ae014f375/users/5fe56bef8fc94c98b967fe2a8edc72f4/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:51.259044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8b15-6623-4710-aa43-ba3e36580038 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:51.319311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:51.350457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8b15-6623-4710-aa43-ba3e36580038 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:51.355895 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:51.356690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.356979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.357241 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] PATH_INFO: `/v3/projects/745c0037fdc94b98b4d7d03bf5a0f1fb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.358553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=745c0037fdc94b98b4d7d03bf5a0f1fb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:51.360506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:51.362119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe467ac-465f-477e-9de9-ffd35ac59a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:51.362774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe467ac-465f-477e-9de9-ffd35ac59a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.363385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe467ac-465f-477e-9de9-ffd35ac59a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.363681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe467ac-465f-477e-9de9-ffd35ac59a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.364327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe467ac-465f-477e-9de9-ffd35ac59a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:51.365918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe467ac-465f-477e-9de9-ffd35ac59a69 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:51.381370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1045/2061] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:51.388040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe467ac-465f-477e-9de9-ffd35ac59a69 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:51.393064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe467ac-465f-477e-9de9-ffd35ac59a69 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:51.397899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6ce36-84c6-4130-a4e3-110e2556ab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:51.398686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6ce36-84c6-4130-a4e3-110e2556ab3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.398971 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6ce36-84c6-4130-a4e3-110e2556ab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.399261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6ce36-84c6-4130-a4e3-110e2556ab3b admin admin] PATH_INFO: `/v3/projects/249138cd04f74861b3c7737ae014f375/users/5fe56bef8fc94c98b967fe2a8edc72f4/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.401148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6ce36-84c6-4130-a4e3-110e2556ab3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=249138cd04f74861b3c7737ae014f375, user_id=5fe56bef8fc94c98b967fe2a8edc72f4, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:51.404449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6ce36-84c6-4130-a4e3-110e2556ab3b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:51.415816 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1046/2062] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:51 2022] PUT /identity/v3/projects/249138cd04f74861b3c7737ae014f375/users/5fe56bef8fc94c98b967fe2a8edc72f4/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:51.435034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d603292-d5fe-4907-987a-644981209d60 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.435314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d603292-d5fe-4907-987a-644981209d60 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.436128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d603292-d5fe-4907-987a-644981209d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.467314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0d603292-d5fe-4907-987a-644981209d60 None None] MFA Rules not processed for user `5fe56bef8fc94c98b967fe2a8edc72f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:51.468530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0d603292-d5fe-4907-987a-644981209d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:51.504460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '745c0037fdc94b98b4d7d03bf5a0f1fb', 'request_id': 'req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:51.510029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '745c0037fdc94b98b4d7d03bf5a0f1fb', 'request_id': 'req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:51.516965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '745c0037fdc94b98b4d7d03bf5a0f1fb', 'request_id': 'req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:51.524512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:51.554701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1047/2063] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:51.590893 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] The token cache is being invalidate because project 745c0037fdc94b98b4d7d03bf5a0f1fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:51.591189 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:51.591943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:51.593444 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1017/2064] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:51 2022] DELETE /identity/v3/projects/745c0037fdc94b98b4d7d03bf5a0f1fb => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:51.599915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaa7bb-4aa0-4176-9cbb-e07fbf9a19b9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.600198 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaa7bb-4aa0-4176-9cbb-e07fbf9a19b9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.600473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaa7bb-4aa0-4176-9cbb-e07fbf9a19b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.603961 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:51.606974 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:51.621977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-daeaa7bb-4aa0-4176-9cbb-e07fbf9a19b9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:51.623644 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-daeaa7bb-4aa0-4176-9cbb-e07fbf9a19b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:51.699980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765bc3b-3b6c-4987-b03c-9c37b45a3f03 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:51.711193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1048/2065] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:51.711457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184eef6-eabe-442d-9491-29c9ed68e407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:51.713330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ae0d6-22f3-446a-a3a5-5064cded0e45 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.713453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184eef6-eabe-442d-9491-29c9ed68e407 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.713906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184eef6-eabe-442d-9491-29c9ed68e407 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.714155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ae0d6-22f3-446a-a3a5-5064cded0e45 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.714491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184eef6-eabe-442d-9491-29c9ed68e407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.714867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ae0d6-22f3-446a-a3a5-5064cded0e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.717600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b184eef6-eabe-442d-9491-29c9ed68e407 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:51.736818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8e7ae0d6-22f3-446a-a3a5-5064cded0e45 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:51.738162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8e7ae0d6-22f3-446a-a3a5-5064cded0e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:51.752601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1049/2066] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:51.753540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ae0d6-22f3-446a-a3a5-5064cded0e45 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:51.771772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ae0d6-22f3-446a-a3a5-5064cded0e45 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:51.780543 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4049-f7c1-4287-8d01-a7cd42246e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:51.781876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4049-f7c1-4287-8d01-a7cd42246e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.782041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4049-f7c1-4287-8d01-a7cd42246e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.782546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4049-f7c1-4287-8d01-a7cd42246e37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.784161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca4049-f7c1-4287-8d01-a7cd42246e37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:51.786912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca4049-f7c1-4287-8d01-a7cd42246e37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:51.787019 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca4049-f7c1-4287-8d01-a7cd42246e37 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:51.807026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184eef6-eabe-442d-9491-29c9ed68e407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:51.813435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184eef6-eabe-442d-9491-29c9ed68e407 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:51.813598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1050/2067] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:51.816207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4049-f7c1-4287-8d01-a7cd42246e37 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:51.821092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1018/2068] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:51.830498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4049-f7c1-4287-8d01-a7cd42246e37 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:51.837322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e73fbd-6994-4f0e-baf8-b10e7a200782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:51.838230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e73fbd-6994-4f0e-baf8-b10e7a200782 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:51.838782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e73fbd-6994-4f0e-baf8-b10e7a200782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:51.839257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e73fbd-6994-4f0e-baf8-b10e7a200782 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:51.840190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e73fbd-6994-4f0e-baf8-b10e7a200782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:51.842385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e73fbd-6994-4f0e-baf8-b10e7a200782 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:51.983187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1051/2069] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:51 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:51.986874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184eef6-eabe-442d-9491-29c9ed68e407 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:51.998251 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184eef6-eabe-442d-9491-29c9ed68e407 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:52.007147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:52.029161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e73fbd-6994-4f0e-baf8-b10e7a200782 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:52.034842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e1e73fbd-6994-4f0e-baf8-b10e7a200782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:52.086330 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109479ea-3fc5-4fc5-bdc5-7d9f5842abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:52.087335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109479ea-3fc5-4fc5-bdc5-7d9f5842abeb admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:52.087619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109479ea-3fc5-4fc5-bdc5-7d9f5842abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:52.087896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109479ea-3fc5-4fc5-bdc5-7d9f5842abeb admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:52.089249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109479ea-3fc5-4fc5-bdc5-7d9f5842abeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:52.092338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109479ea-3fc5-4fc5-bdc5-7d9f5842abeb admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:52.115893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e73fbd-6994-4f0e-baf8-b10e7a200782 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:52.119906 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ff652-a272-44a2-8ec5-477cf7ee0e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:52.120558 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ff652-a272-44a2-8ec5-477cf7ee0e97 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:52.120841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ff652-a272-44a2-8ec5-477cf7ee0e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:52.121810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ff652-a272-44a2-8ec5-477cf7ee0e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:52.123716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-061ff652-a272-44a2-8ec5-477cf7ee0e97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:52.195626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1019/2070] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:51 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:52.197171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109479ea-3fc5-4fc5-bdc5-7d9f5842abeb admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:52.205729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ff652-a272-44a2-8ec5-477cf7ee0e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:52.207464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ff652-a272-44a2-8ec5-477cf7ee0e97 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:52.208225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109479ea-3fc5-4fc5-bdc5-7d9f5842abeb admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:52.213792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180b2a0-e1bf-49c7-9f4b-807bd1b4d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:52.215359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180b2a0-e1bf-49c7-9f4b-807bd1b4d595 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:52.216003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180b2a0-e1bf-49c7-9f4b-807bd1b4d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:52.216488 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180b2a0-e1bf-49c7-9f4b-807bd1b4d595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:52.217406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180b2a0-e1bf-49c7-9f4b-807bd1b4d595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:52.219268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180b2a0-e1bf-49c7-9f4b-807bd1b4d595 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:52.222451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1052/2071] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:52.236306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1020/2072] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:52.236703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ff652-a272-44a2-8ec5-477cf7ee0e97 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:52.250287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ff652-a272-44a2-8ec5-477cf7ee0e97 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:52.255290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d87d10-6119-4534-9597-be72acda9d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:52.256485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87d10-6119-4534-9597-be72acda9d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:52.256485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87d10-6119-4534-9597-be72acda9d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:52.259674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87d10-6119-4534-9597-be72acda9d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:52.260416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d87d10-6119-4534-9597-be72acda9d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:52.262099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d87d10-6119-4534-9597-be72acda9d9e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:52.278309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180b2a0-e1bf-49c7-9f4b-807bd1b4d595 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:52.285365 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1053/2073] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:52.293455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180b2a0-e1bf-49c7-9f4b-807bd1b4d595 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:52.302959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b6d8-cc1b-4b6e-b23e-21b425f80abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:52.303671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b6d8-cc1b-4b6e-b23e-21b425f80abd admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:52.310970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b6d8-cc1b-4b6e-b23e-21b425f80abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:52.310970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b6d8-cc1b-4b6e-b23e-21b425f80abd admin admin] PATH_INFO: `/v3/projects/c45d5d252aaf4123ac50ca1df9cf0a2c/users/457bfd566a1d4e9eb7ff5e9c703a445c/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:52.319957 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95b6d8-cc1b-4b6e-b23e-21b425f80abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45d5d252aaf4123ac50ca1df9cf0a2c, user_id=457bfd566a1d4e9eb7ff5e9c703a445c, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:52.322840 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95b6d8-cc1b-4b6e-b23e-21b425f80abd admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:52.425060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1021/2074] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:52 2022] PUT /identity/v3/projects/c45d5d252aaf4123ac50ca1df9cf0a2c/users/457bfd566a1d4e9eb7ff5e9c703a445c/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:52.437771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1ff08-b7e4-4f5d-aa56-9781f717d48d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:52.438331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1ff08-b7e4-4f5d-aa56-9781f717d48d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:52.438830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1ff08-b7e4-4f5d-aa56-9781f717d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:52.496986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-31d1ff08-b7e4-4f5d-aa56-9781f717d48d None None] MFA Rules not processed for user `457bfd566a1d4e9eb7ff5e9c703a445c`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:52.498234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-31d1ff08-b7e4-4f5d-aa56-9781f717d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:52.588613 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1054/2075] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:52.603852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b6d8-cc1b-4b6e-b23e-21b425f80abd admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:52.682475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b6d8-cc1b-4b6e-b23e-21b425f80abd admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:52.687041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d7b70-d0c5-4c19-9d55-56185c1dad78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:52.687858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d7b70-d0c5-4c19-9d55-56185c1dad78 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:52.688077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d7b70-d0c5-4c19-9d55-56185c1dad78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:52.688432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d7b70-d0c5-4c19-9d55-56185c1dad78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:52.701624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d7b70-d0c5-4c19-9d55-56185c1dad78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:52.703545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d7b70-d0c5-4c19-9d55-56185c1dad78 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:52.714747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1022/2076] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:53.087044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:53.147129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1ff08-b7e4-4f5d-aa56-9781f717d48d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:53.148623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-31d1ff08-b7e4-4f5d-aa56-9781f717d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:53.225189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1ff08-b7e4-4f5d-aa56-9781f717d48d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:53.229661 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:53.230322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:53.230599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:53.230932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] PATH_INFO: `/v3/users/5e143ef3733a40efa2b2b5385b42e1a7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:53.232041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e143ef3733a40efa2b2b5385b42e1a7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:53.233945 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:53.295289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:53.422319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d7b70-d0c5-4c19-9d55-56185c1dad78 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:53.438505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d7b70-d0c5-4c19-9d55-56185c1dad78 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:53.442302 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f885a5-6c8b-45b2-8450-50d2f3188623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:53.442919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f885a5-6c8b-45b2-8450-50d2f3188623 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:53.443199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f885a5-6c8b-45b2-8450-50d2f3188623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:53.443475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f885a5-6c8b-45b2-8450-50d2f3188623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:53.445411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a8f885a5-6c8b-45b2-8450-50d2f3188623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:53.456409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:53.471306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e143ef3733a40efa2b2b5385b42e1a7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:53.472078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e143ef3733a40efa2b2b5385b42e1a7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:53.515111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f885a5-6c8b-45b2-8450-50d2f3188623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:53.516569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f885a5-6c8b-45b2-8450-50d2f3188623 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:53.526852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1023/2077] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:53.636627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e143ef3733a40efa2b2b5385b42e1a7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:53.637266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e143ef3733a40efa2b2b5385b42e1a7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:53.645446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e143ef3733a40efa2b2b5385b42e1a7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:53.678373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1055/2078] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:53 2022] DELETE /identity/v3/users/5e143ef3733a40efa2b2b5385b42e1a7 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:53.687794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f778a-a1bf-4642-a882-e1f2d8799f02 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:53.688740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f778a-a1bf-4642-a882-e1f2d8799f02 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:53.689099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f778a-a1bf-4642-a882-e1f2d8799f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:53.714109 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-cf4f778a-a1bf-4642-a882-e1f2d8799f02 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:53.716106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-cf4f778a-a1bf-4642-a882-e1f2d8799f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:53.798125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1024/2079] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:53.810051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:53.812864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:53.905583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b828cbf-3de6-4c96-af8f-4b92f405a1ac admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:53.910650 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e64f38-7b7d-42ed-8cba-98f488153cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:53.911489 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64f38-7b7d-42ed-8cba-98f488153cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:53.911883 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64f38-7b7d-42ed-8cba-98f488153cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:53.912251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e64f38-7b7d-42ed-8cba-98f488153cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:53.927392 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e64f38-7b7d-42ed-8cba-98f488153cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:53.928851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e64f38-7b7d-42ed-8cba-98f488153cb4 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:53.941163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1056/2080] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:53.951017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:54.114682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f778a-a1bf-4642-a882-e1f2d8799f02 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:54.116230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-cf4f778a-a1bf-4642-a882-e1f2d8799f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:54.130379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f778a-a1bf-4642-a882-e1f2d8799f02 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:54.135508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8013-7805-47c0-ad33-0c92dbd792a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:54.136231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8013-7805-47c0-ad33-0c92dbd792a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:54.137145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8013-7805-47c0-ad33-0c92dbd792a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:54.137458 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8013-7805-47c0-ad33-0c92dbd792a1 admin admin] PATH_INFO: `/v3/users/473d07ba4c404fb59cbb61d52b04fdcd` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:54.138774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8013-7805-47c0-ad33-0c92dbd792a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473d07ba4c404fb59cbb61d52b04fdcd)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:54.140819 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8013-7805-47c0-ad33-0c92dbd792a1 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:54.235211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:54.437932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9bed8013-7805-47c0-ad33-0c92dbd792a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473d07ba4c404fb59cbb61d52b04fdcd'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:54.438573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9bed8013-7805-47c0-ad33-0c92dbd792a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473d07ba4c404fb59cbb61d52b04fdcd'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:54.456188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e64f38-7b7d-42ed-8cba-98f488153cb4 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:54.457922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-41e64f38-7b7d-42ed-8cba-98f488153cb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:54.475841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e64f38-7b7d-42ed-8cba-98f488153cb4 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:54.493556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:54.494446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:54.494941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:54.495255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] PATH_INFO: `/v3/projects/47a76b04ca2e4e8d9a552ac086e01b8c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:54.497150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a76b04ca2e4e8d9a552ac086e01b8c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:54.499464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:54.534329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9bed8013-7805-47c0-ad33-0c92dbd792a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473d07ba4c404fb59cbb61d52b04fdcd'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:54.535237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9bed8013-7805-47c0-ad33-0c92dbd792a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473d07ba4c404fb59cbb61d52b04fdcd'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:54.549256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9bed8013-7805-47c0-ad33-0c92dbd792a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473d07ba4c404fb59cbb61d52b04fdcd'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:54.576585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1025/2081] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:54 2022] DELETE /identity/v3/users/473d07ba4c404fb59cbb61d52b04fdcd => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:54.585171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a57571-e69d-4b1b-90e6-1d458b1e59dc None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:54.585677 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a57571-e69d-4b1b-90e6-1d458b1e59dc None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:54.586145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a57571-e69d-4b1b-90e6-1d458b1e59dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:54.622201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-03a57571-e69d-4b1b-90e6-1d458b1e59dc None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:54.626193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-03a57571-e69d-4b1b-90e6-1d458b1e59dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:54.675817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a76b04ca2e4e8d9a552ac086e01b8c', 'request_id': 'req-c17649bb-1bf4-4228-9645-6df572be5db9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:54.681452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a76b04ca2e4e8d9a552ac086e01b8c', 'request_id': 'req-c17649bb-1bf4-4228-9645-6df572be5db9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:54.690162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a76b04ca2e4e8d9a552ac086e01b8c', 'request_id': 'req-c17649bb-1bf4-4228-9645-6df572be5db9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:54.699935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1026/2082] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:54.701337 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63db3-48bb-4ea9-9074-5c9f51856e47 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:54.701651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63db3-48bb-4ea9-9074-5c9f51856e47 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:54.701922 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63db3-48bb-4ea9-9074-5c9f51856e47 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:54.707215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1027/2083] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:18:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:18:54.710697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de63db3-48bb-4ea9-9074-5c9f51856e47 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:54.712635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1de63db3-48bb-4ea9-9074-5c9f51856e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:54.772504 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de63db3-48bb-4ea9-9074-5c9f51856e47 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:54.776226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9851-647b-4e2d-8f5f-0e24f50cb649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:54.776847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9851-647b-4e2d-8f5f-0e24f50cb649 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:54.777669 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9851-647b-4e2d-8f5f-0e24f50cb649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:54.777948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9851-647b-4e2d-8f5f-0e24f50cb649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:54.781047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] The token cache is being invalidate because project 47a76b04ca2e4e8d9a552ac086e01b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:54.781342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:54.782018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c17649bb-1bf4-4228-9645-6df572be5db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:54.783574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1057/2084] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:54 2022] DELETE /identity/v3/projects/47a76b04ca2e4e8d9a552ac086e01b8c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:54.785003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edfb9b-af85-4d3e-8a10-b99f9082422c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:54.785342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edfb9b-af85-4d3e-8a10-b99f9082422c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:54.785616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edfb9b-af85-4d3e-8a10-b99f9082422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:54.806354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-37edfb9b-af85-4d3e-8a10-b99f9082422c None None] MFA Rules not processed for user `7e6c855e2692410d83c78cc95cb4f37e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:54.807585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-37edfb9b-af85-4d3e-8a10-b99f9082422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:54.841607 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa9851-647b-4e2d-8f5f-0e24f50cb649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:54.843090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa9851-647b-4e2d-8f5f-0e24f50cb649 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:54.852847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1028/2085] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:18:54.859673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9851-647b-4e2d-8f5f-0e24f50cb649 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:54.861438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-18fa9851-647b-4e2d-8f5f-0e24f50cb649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:54.871280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1058/2086] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:18:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:54.872140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edfb9b-af85-4d3e-8a10-b99f9082422c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:54.873512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-37edfb9b-af85-4d3e-8a10-b99f9082422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:54.879431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9851-647b-4e2d-8f5f-0e24f50cb649 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:54.887320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dbff6-d8f6-47d8-b64d-c75e51bddfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:54.891026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dbff6-d8f6-47d8-b64d-c75e51bddfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:54.891026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dbff6-d8f6-47d8-b64d-c75e51bddfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:54.891026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dbff6-d8f6-47d8-b64d-c75e51bddfef admin admin] PATH_INFO: `/v3/users/f0a14aa4ab2241ea95b430653598c4be` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:54.891026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dbff6-d8f6-47d8-b64d-c75e51bddfef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a14aa4ab2241ea95b430653598c4be)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:54.892305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dbff6-d8f6-47d8-b64d-c75e51bddfef admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:54.898997 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edfb9b-af85-4d3e-8a10-b99f9082422c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:54.905569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f4cbe-0c8a-4197-a4dc-6d789f60ed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:54.906347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f4cbe-0c8a-4197-a4dc-6d789f60ed2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:54.906747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f4cbe-0c8a-4197-a4dc-6d789f60ed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:54.907096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f4cbe-0c8a-4197-a4dc-6d789f60ed2f admin admin] PATH_INFO: `/v3/users/5fe56bef8fc94c98b967fe2a8edc72f4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:54.908349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f4cbe-0c8a-4197-a4dc-6d789f60ed2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe56bef8fc94c98b967fe2a8edc72f4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:54.910478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f4cbe-0c8a-4197-a4dc-6d789f60ed2f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:55.162813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-527dbff6-d8f6-47d8-b64d-c75e51bddfef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a14aa4ab2241ea95b430653598c4be'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.164106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-527dbff6-d8f6-47d8-b64d-c75e51bddfef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a14aa4ab2241ea95b430653598c4be'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.165218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-900f4cbe-0c8a-4197-a4dc-6d789f60ed2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe56bef8fc94c98b967fe2a8edc72f4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.166394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-900f4cbe-0c8a-4197-a4dc-6d789f60ed2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe56bef8fc94c98b967fe2a8edc72f4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.293817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-527dbff6-d8f6-47d8-b64d-c75e51bddfef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a14aa4ab2241ea95b430653598c4be'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.294525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-527dbff6-d8f6-47d8-b64d-c75e51bddfef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a14aa4ab2241ea95b430653598c4be'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.302095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-527dbff6-d8f6-47d8-b64d-c75e51bddfef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a14aa4ab2241ea95b430653598c4be'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.323460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1029/2087] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:54 2022] DELETE /identity/v3/users/f0a14aa4ab2241ea95b430653598c4be => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:55.325473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813746-6a6b-43c3-80b6-8a3b8ae50419 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:55.325831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813746-6a6b-43c3-80b6-8a3b8ae50419 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:55.326374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1813746-6a6b-43c3-80b6-8a3b8ae50419 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:55.328524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1030/2088] 10.222.0.23 () {54 vars in 961 bytes} [Thu Sep 8 16:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:18:55.329227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1813746-6a6b-43c3-80b6-8a3b8ae50419 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:55.338715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c1813746-6a6b-43c3-80b6-8a3b8ae50419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:55.367636 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-900f4cbe-0c8a-4197-a4dc-6d789f60ed2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe56bef8fc94c98b967fe2a8edc72f4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.368335 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-900f4cbe-0c8a-4197-a4dc-6d789f60ed2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe56bef8fc94c98b967fe2a8edc72f4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.378565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-900f4cbe-0c8a-4197-a4dc-6d789f60ed2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe56bef8fc94c98b967fe2a8edc72f4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.409441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1059/2089] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:54 2022] DELETE /identity/v3/users/5fe56bef8fc94c98b967fe2a8edc72f4 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:55.411222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace529f-a8fe-4307-85fc-4d71cf9ba9cf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:55.411688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace529f-a8fe-4307-85fc-4d71cf9ba9cf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:55.412119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace529f-a8fe-4307-85fc-4d71cf9ba9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:55.448508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6ace529f-a8fe-4307-85fc-4d71cf9ba9cf None None] MFA Rules not processed for user `7e6c855e2692410d83c78cc95cb4f37e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:55.450569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6ace529f-a8fe-4307-85fc-4d71cf9ba9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:55.472735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:55.485265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1813746-6a6b-43c3-80b6-8a3b8ae50419 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:55.548994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1060/2090] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Sep 8 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:55.550640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace529f-a8fe-4307-85fc-4d71cf9ba9cf None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:55.552686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6ace529f-a8fe-4307-85fc-4d71cf9ba9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:55.567871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:55.568507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:55.568788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:55.569090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] PATH_INFO: `/v3/projects/be79d0294e52407ea63fb1a1fae2ff4c` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:55.570353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=be79d0294e52407ea63fb1a1fae2ff4c)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:55.577772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:55.613741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace529f-a8fe-4307-85fc-4d71cf9ba9cf None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:55.617416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151eb8b-4ecc-49e7-8cc6-b02ce1129a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:55.618046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151eb8b-4ecc-49e7-8cc6-b02ce1129a39 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:55.618325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151eb8b-4ecc-49e7-8cc6-b02ce1129a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:55.618592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151eb8b-4ecc-49e7-8cc6-b02ce1129a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:55.620375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9151eb8b-4ecc-49e7-8cc6-b02ce1129a39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:55.656710 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:55.688225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151eb8b-4ecc-49e7-8cc6-b02ce1129a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:55.690376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151eb8b-4ecc-49e7-8cc6-b02ce1129a39 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:55.704640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1061/2091] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:55.705663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151eb8b-4ecc-49e7-8cc6-b02ce1129a39 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:55.720320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151eb8b-4ecc-49e7-8cc6-b02ce1129a39 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:55.721798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be79d0294e52407ea63fb1a1fae2ff4c', 'request_id': 'req-7a0d73a7-2574-4e28-82a3-175f922e4d9a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.729927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be79d0294e52407ea63fb1a1fae2ff4c', 'request_id': 'req-7a0d73a7-2574-4e28-82a3-175f922e4d9a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.738595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be79d0294e52407ea63fb1a1fae2ff4c', 'request_id': 'req-7a0d73a7-2574-4e28-82a3-175f922e4d9a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.786747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d57e19-6230-4656-8458-c58c77deb6ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:55.787359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57e19-6230-4656-8458-c58c77deb6ea service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:55.787672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57e19-6230-4656-8458-c58c77deb6ea service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:55.788051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57e19-6230-4656-8458-c58c77deb6ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:55.790425 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-99d57e19-6230-4656-8458-c58c77deb6ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:55.804836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d57e19-6230-4656-8458-c58c77deb6ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:55.806421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d57e19-6230-4656-8458-c58c77deb6ea service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:55.816691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1062/2092] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:55.817550 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d57e19-6230-4656-8458-c58c77deb6ea service placement] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:55.819480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-99d57e19-6230-4656-8458-c58c77deb6ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:55.825453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] The token cache is being invalidate because project be79d0294e52407ea63fb1a1fae2ff4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:55.826231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.826933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:55.831771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1031/2093] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:55 2022] DELETE /identity/v3/projects/be79d0294e52407ea63fb1a1fae2ff4c => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:55.832843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:55.834405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:55.892268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d57e19-6230-4656-8458-c58c77deb6ea service placement] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:55.897373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:55.898009 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:55.898285 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:55.898564 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] PATH_INFO: `/v3/projects/b050456e54af416c90e154e8e8210ef6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:55.899764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b050456e54af416c90e154e8e8210ef6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:55.901672 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:55.902285 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d73a7-2574-4e28-82a3-175f922e4d9a admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:55.906999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:55.907619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:55.907890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:55.908160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] PATH_INFO: `/v3/users/d35728f853764dde96944ddce174e165` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:55.909313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35728f853764dde96944ddce174e165)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:55.911252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:56.148236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35728f853764dde96944ddce174e165'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.148442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b050456e54af416c90e154e8e8210ef6', 'request_id': 'req-dab4ca06-fc0e-4ce2-baef-985cb3a24816'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.148952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35728f853764dde96944ddce174e165'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.154454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b050456e54af416c90e154e8e8210ef6', 'request_id': 'req-dab4ca06-fc0e-4ce2-baef-985cb3a24816'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.161053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b050456e54af416c90e154e8e8210ef6', 'request_id': 'req-dab4ca06-fc0e-4ce2-baef-985cb3a24816'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.213658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35728f853764dde96944ddce174e165'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.214284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35728f853764dde96944ddce174e165'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.222137 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35728f853764dde96944ddce174e165'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.239933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1032/2094] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:55 2022] DELETE /identity/v3/users/d35728f853764dde96944ddce174e165 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:56.240739 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:56.249346 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:56.314855 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b3e13-ff04-4a29-9202-61509d51cf1f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:56.323654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] The token cache is being invalidate because project b050456e54af416c90e154e8e8210ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:56.324619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.325567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-dab4ca06-fc0e-4ce2-baef-985cb3a24816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.327751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:56.331897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:56.331897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:56.331897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] PATH_INFO: `/v3/projects/249138cd04f74861b3c7737ae014f375` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:56.331897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249138cd04f74861b3c7737ae014f375)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:56.332666 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1063/2095] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:55 2022] DELETE /identity/v3/projects/b050456e54af416c90e154e8e8210ef6 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:56.332780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:56.334305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a93d2-4494-441f-b15d-142e8649a296 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:56.334951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a93d2-4494-441f-b15d-142e8649a296 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:56.335408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a93d2-4494-441f-b15d-142e8649a296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:56.359348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6d1a93d2-4494-441f-b15d-142e8649a296 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:56.360700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6d1a93d2-4494-441f-b15d-142e8649a296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:56.369134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1064/2096] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:56.376793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd643220-900a-4581-b294-acbcc8e8a914 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:56.377078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd643220-900a-4581-b294-acbcc8e8a914 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:56.382739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd643220-900a-4581-b294-acbcc8e8a914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:56.398200 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cd643220-900a-4581-b294-acbcc8e8a914 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:56.399511 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cd643220-900a-4581-b294-acbcc8e8a914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:56.409111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1065/2097] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:56.413585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd643220-900a-4581-b294-acbcc8e8a914 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:56.422860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd643220-900a-4581-b294-acbcc8e8a914 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:56.427583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b38bcd-1e25-4a45-b257-c2ab7d1d4649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:56.428170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b38bcd-1e25-4a45-b257-c2ab7d1d4649 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:56.428448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b38bcd-1e25-4a45-b257-c2ab7d1d4649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:56.428718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b38bcd-1e25-4a45-b257-c2ab7d1d4649 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:56.429459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b38bcd-1e25-4a45-b257-c2ab7d1d4649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:56.432362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b38bcd-1e25-4a45-b257-c2ab7d1d4649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:56.434013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b38bcd-1e25-4a45-b257-c2ab7d1d4649 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:56.457742 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1066/2098] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:18:56.459923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b38bcd-1e25-4a45-b257-c2ab7d1d4649 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:56.461885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249138cd04f74861b3c7737ae014f375', 'request_id': 'req-7246f3d7-bb5f-4275-b3d5-4b3721896034'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.470194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249138cd04f74861b3c7737ae014f375', 'request_id': 'req-7246f3d7-bb5f-4275-b3d5-4b3721896034'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.473693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b38bcd-1e25-4a45-b257-c2ab7d1d4649 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:56.480451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249138cd04f74861b3c7737ae014f375', 'request_id': 'req-7246f3d7-bb5f-4275-b3d5-4b3721896034'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.543460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081b2cf-6186-4525-b193-eceec43267c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:56.546948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081b2cf-6186-4525-b193-eceec43267c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:56.546948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081b2cf-6186-4525-b193-eceec43267c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:56.546948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081b2cf-6186-4525-b193-eceec43267c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:56.546948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081b2cf-6186-4525-b193-eceec43267c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:56.547348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081b2cf-6186-4525-b193-eceec43267c9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:56.567007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:56.634889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] The token cache is being invalidate because project 249138cd04f74861b3c7737ae014f375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:56.635185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.635862 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7246f3d7-bb5f-4275-b3d5-4b3721896034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.638010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1033/2099] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:56 2022] DELETE /identity/v3/projects/249138cd04f74861b3c7737ae014f375 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:56.642742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf5802-0a16-4ef0-959f-90878b1a306d None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:56.643027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf5802-0a16-4ef0-959f-90878b1a306d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:56.643307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf5802-0a16-4ef0-959f-90878b1a306d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:56.665485 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-dcdf5802-0a16-4ef0-959f-90878b1a306d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:56.666791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dcdf5802-0a16-4ef0-959f-90878b1a306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:56.677932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1034/2100] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:56.687072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5590-4ecc-4995-bb84-6c1dcff484a1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:56.687351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5590-4ecc-4995-bb84-6c1dcff484a1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:56.687691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5590-4ecc-4995-bb84-6c1dcff484a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:56.690167 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1067/2101] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:56 2022] POST /identity/v3/projects => generated 393 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:56.691609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081b2cf-6186-4525-b193-eceec43267c9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:56.693628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e081b2cf-6186-4525-b193-eceec43267c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:56.712839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-d4ed5590-4ecc-4995-bb84-6c1dcff484a1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:56.714322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d4ed5590-4ecc-4995-bb84-6c1dcff484a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:56.771926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081b2cf-6186-4525-b193-eceec43267c9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:56.777161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa87e3-fbcb-45c0-8e7b-b50550ba5c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:56.777968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa87e3-fbcb-45c0-8e7b-b50550ba5c1d admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:56.778315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa87e3-fbcb-45c0-8e7b-b50550ba5c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:56.778758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa87e3-fbcb-45c0-8e7b-b50550ba5c1d admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:56.779591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa87e3-fbcb-45c0-8e7b-b50550ba5c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:56.781852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa87e3-fbcb-45c0-8e7b-b50550ba5c1d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:56.785498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1035/2102] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:18:56.786543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed5590-4ecc-4995-bb84-6c1dcff484a1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:56.788026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d4ed5590-4ecc-4995-bb84-6c1dcff484a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:56.804662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed5590-4ecc-4995-bb84-6c1dcff484a1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:56.810379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:56.811097 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:56.811401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:56.811673 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] PATH_INFO: `/v3/projects/de27ccc9e2e042a29af1de26a8cb02eb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:56.812807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=de27ccc9e2e042a29af1de26a8cb02eb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:56.814911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:56.891787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1068/2103] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:56 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:56.891787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa87e3-fbcb-45c0-8e7b-b50550ba5c1d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:56.899328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa87e3-fbcb-45c0-8e7b-b50550ba5c1d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:56.904027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1250ac-0230-490e-983c-d788633511f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:56.904611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1250ac-0230-490e-983c-d788633511f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:56.904880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1250ac-0230-490e-983c-d788633511f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:56.905148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1250ac-0230-490e-983c-d788633511f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:56.905781 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1250ac-0230-490e-983c-d788633511f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:56.906081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1250ac-0230-490e-983c-d788633511f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:56.907694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1250ac-0230-490e-983c-d788633511f8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:56.928810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1069/2104] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:56.928810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1250ac-0230-490e-983c-d788633511f8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:56.937159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de27ccc9e2e042a29af1de26a8cb02eb', 'request_id': 'req-e3e99879-df9d-4338-b181-2f24a05003ad'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.938455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1250ac-0230-490e-983c-d788633511f8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:56.943093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de27ccc9e2e042a29af1de26a8cb02eb', 'request_id': 'req-e3e99879-df9d-4338-b181-2f24a05003ad'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.955443 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de27ccc9e2e042a29af1de26a8cb02eb', 'request_id': 'req-e3e99879-df9d-4338-b181-2f24a05003ad'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:56.997164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6c871-d60a-40e3-b650-84c7d18e9769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:56.997775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6c871-d60a-40e3-b650-84c7d18e9769 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:56.998050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6c871-d60a-40e3-b650-84c7d18e9769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:56.998348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6c871-d60a-40e3-b650-84c7d18e9769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:56.999019 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6c871-d60a-40e3-b650-84c7d18e9769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.000656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6c871-d60a-40e3-b650-84c7d18e9769 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.010529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1070/2105] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:57.011278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6c871-d60a-40e3-b650-84c7d18e9769 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.021707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6c871-d60a-40e3-b650-84c7d18e9769 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.026561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c2a51-d420-49cc-8990-05d5e55e3178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.027262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c2a51-d420-49cc-8990-05d5e55e3178 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.031859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c2a51-d420-49cc-8990-05d5e55e3178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.031859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c2a51-d420-49cc-8990-05d5e55e3178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.031859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c2a51-d420-49cc-8990-05d5e55e3178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.031859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c2a51-d420-49cc-8990-05d5e55e3178 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.058263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] The token cache is being invalidate because project de27ccc9e2e042a29af1de26a8cb02eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:57.058690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:57.059947 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:57.061554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1036/2106] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:56 2022] DELETE /identity/v3/projects/de27ccc9e2e042a29af1de26a8cb02eb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:57.062342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.066860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:57.080446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e99879-df9d-4338-b181-2f24a05003ad admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.085170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e424454-2d4d-4f9e-bb45-eb9bcefa0c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.085794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424454-2d4d-4f9e-bb45-eb9bcefa0c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.086703 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424454-2d4d-4f9e-bb45-eb9bcefa0c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.086990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424454-2d4d-4f9e-bb45-eb9bcefa0c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.087833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e424454-2d4d-4f9e-bb45-eb9bcefa0c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.089983 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e424454-2d4d-4f9e-bb45-eb9bcefa0c09 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.106927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1037/2107] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:57.106927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34189a7-f398-4fce-b7d3-7ba25374bb58 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.106927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34189a7-f398-4fce-b7d3-7ba25374bb58 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.106927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34189a7-f398-4fce-b7d3-7ba25374bb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.126115 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a34189a7-f398-4fce-b7d3-7ba25374bb58 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:57.127417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a34189a7-f398-4fce-b7d3-7ba25374bb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:57.137855 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1038/2108] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:57.138621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34189a7-f398-4fce-b7d3-7ba25374bb58 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.151590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34189a7-f398-4fce-b7d3-7ba25374bb58 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.156995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93371c-4ea8-45b8-bb5e-6893899dea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.157764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93371c-4ea8-45b8-bb5e-6893899dea86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.158052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93371c-4ea8-45b8-bb5e-6893899dea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.158938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93371c-4ea8-45b8-bb5e-6893899dea86 admin admin] PATH_INFO: `/v3/projects/27fc80566150466580ab9881260bf299/users/f3ca84526cc8440ab332292c2fb4e73e/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.161078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1071/2109] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:57 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:57.162652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283519c-2e52-4a32-af9c-d15ed6747ae2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.163805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283519c-2e52-4a32-af9c-d15ed6747ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.164166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283519c-2e52-4a32-af9c-d15ed6747ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.177869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93371c-4ea8-45b8-bb5e-6893899dea86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fc80566150466580ab9881260bf299, user_id=f3ca84526cc8440ab332292c2fb4e73e, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.180835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93371c-4ea8-45b8-bb5e-6893899dea86 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.185376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b283519c-2e52-4a32-af9c-d15ed6747ae2 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:57.186612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b283519c-2e52-4a32-af9c-d15ed6747ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:57.244865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1072/2110] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:57.245630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283519c-2e52-4a32-af9c-d15ed6747ae2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.247648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b283519c-2e52-4a32-af9c-d15ed6747ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:57.259380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283519c-2e52-4a32-af9c-d15ed6747ae2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.264064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcf9b1-ab47-423f-9084-2a7a52b0e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.264603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf9b1-ab47-423f-9084-2a7a52b0e672 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.264864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf9b1-ab47-423f-9084-2a7a52b0e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.265187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf9b1-ab47-423f-9084-2a7a52b0e672 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.265812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcf9b1-ab47-423f-9084-2a7a52b0e672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.267757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcf9b1-ab47-423f-9084-2a7a52b0e672 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.305939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1039/2111] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:57 2022] PUT /identity/v3/projects/27fc80566150466580ab9881260bf299/users/f3ca84526cc8440ab332292c2fb4e73e/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:57.307333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93371c-4ea8-45b8-bb5e-6893899dea86 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.370880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93371c-4ea8-45b8-bb5e-6893899dea86 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.376216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de198c-552d-4d27-b9c8-2d2feb2bde78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.376815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de198c-552d-4d27-b9c8-2d2feb2bde78 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.377094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de198c-552d-4d27-b9c8-2d2feb2bde78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.377369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de198c-552d-4d27-b9c8-2d2feb2bde78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.378011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de198c-552d-4d27-b9c8-2d2feb2bde78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:57.378314 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de198c-552d-4d27-b9c8-2d2feb2bde78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.379958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de198c-552d-4d27-b9c8-2d2feb2bde78 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.391142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1040/2112] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:57.392416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca389f-2e66-4994-92fa-b82ad2d64133 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.392700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca389f-2e66-4994-92fa-b82ad2d64133 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.392999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca389f-2e66-4994-92fa-b82ad2d64133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.403779 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1073/2113] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:57 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:57.404714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcf9b1-ab47-423f-9084-2a7a52b0e672 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.417257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-80ca389f-2e66-4994-92fa-b82ad2d64133 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:57.421221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-80ca389f-2e66-4994-92fa-b82ad2d64133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:57.421657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcf9b1-ab47-423f-9084-2a7a52b0e672 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.426528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f029d-2550-4bf7-ade8-e0ba6acf6f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.427005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f029d-2550-4bf7-ade8-e0ba6acf6f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.427282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f029d-2550-4bf7-ade8-e0ba6acf6f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.427555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f029d-2550-4bf7-ade8-e0ba6acf6f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.428191 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f029d-2550-4bf7-ade8-e0ba6acf6f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.430152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f029d-2550-4bf7-ade8-e0ba6acf6f10 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.430268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1041/2114] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:57.431115 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca389f-2e66-4994-92fa-b82ad2d64133 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.441165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca389f-2e66-4994-92fa-b82ad2d64133 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.445913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10e800-e1b3-47d5-bf7e-713848f7dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.446515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e800-e1b3-47d5-bf7e-713848f7dbbc admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.446829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e800-e1b3-47d5-bf7e-713848f7dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.447101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e800-e1b3-47d5-bf7e-713848f7dbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.447741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10e800-e1b3-47d5-bf7e-713848f7dbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.449341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10e800-e1b3-47d5-bf7e-713848f7dbbc admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.459377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1042/2115] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:57.460155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10e800-e1b3-47d5-bf7e-713848f7dbbc admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.461755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ec10e800-e1b3-47d5-bf7e-713848f7dbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:57.499637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:57.529477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10e800-e1b3-47d5-bf7e-713848f7dbbc admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.533207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556d139-8305-4f24-ba7c-c2981cb99047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.533805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556d139-8305-4f24-ba7c-c2981cb99047 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.535853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556d139-8305-4f24-ba7c-c2981cb99047 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.535853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556d139-8305-4f24-ba7c-c2981cb99047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.544633 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556d139-8305-4f24-ba7c-c2981cb99047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.546152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556d139-8305-4f24-ba7c-c2981cb99047 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.556450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1043/2116] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:57.557322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556d139-8305-4f24-ba7c-c2981cb99047 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.567260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1074/2117] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:57 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:18:57.567440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556d139-8305-4f24-ba7c-c2981cb99047 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.568827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f029d-2550-4bf7-ade8-e0ba6acf6f10 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.626851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783bda1-8456-48f0-b0ed-9da89bc7bcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.627455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783bda1-8456-48f0-b0ed-9da89bc7bcbf admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.627732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783bda1-8456-48f0-b0ed-9da89bc7bcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.628001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783bda1-8456-48f0-b0ed-9da89bc7bcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.628630 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783bda1-8456-48f0-b0ed-9da89bc7bcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.630294 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783bda1-8456-48f0-b0ed-9da89bc7bcbf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.640705 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f029d-2550-4bf7-ade8-e0ba6acf6f10 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.640873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1044/2118] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:18:57.644992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783bda1-8456-48f0-b0ed-9da89bc7bcbf admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.646017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f238f-4075-48f6-9e4b-09c34d47fcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.646685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f238f-4075-48f6-9e4b-09c34d47fcfc admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.646969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f238f-4075-48f6-9e4b-09c34d47fcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.647282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f238f-4075-48f6-9e4b-09c34d47fcfc admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.647909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f238f-4075-48f6-9e4b-09c34d47fcfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.649854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f238f-4075-48f6-9e4b-09c34d47fcfc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.654829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783bda1-8456-48f0-b0ed-9da89bc7bcbf admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.660021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e0135-d6e9-4326-a2c4-d3791173355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.660664 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e0135-d6e9-4326-a2c4-d3791173355b admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.660945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e0135-d6e9-4326-a2c4-d3791173355b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.661220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e0135-d6e9-4326-a2c4-d3791173355b admin admin] PATH_INFO: `/v3/projects/e54fa4d5170e4ca3a7832a989b73daf8/users/1cf778a14d2c43489617f84125a18b74/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.680731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e0135-d6e9-4326-a2c4-d3791173355b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54fa4d5170e4ca3a7832a989b73daf8, user_id=1cf778a14d2c43489617f84125a18b74, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.683888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e0135-d6e9-4326-a2c4-d3791173355b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.752915 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1045/2119] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:57 2022] PUT /identity/v3/projects/e54fa4d5170e4ca3a7832a989b73daf8/users/1cf778a14d2c43489617f84125a18b74/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:18:57.761497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1075/2120] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:18:57 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:18:57.763771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e0135-d6e9-4326-a2c4-d3791173355b admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.765732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98702eb5-bc9a-4d24-87a8-1383e484e5cb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.767653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98702eb5-bc9a-4d24-87a8-1383e484e5cb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.767862 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98702eb5-bc9a-4d24-87a8-1383e484e5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.804470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-98702eb5-bc9a-4d24-87a8-1383e484e5cb None None] MFA Rules not processed for user `1cf778a14d2c43489617f84125a18b74`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:57.805709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-98702eb5-bc9a-4d24-87a8-1383e484e5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:57.845607 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e0135-d6e9-4326-a2c4-d3791173355b admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.850883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738469cf-ceb0-496d-9705-a92b0a15d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.852281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738469cf-ceb0-496d-9705-a92b0a15d876 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.852281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738469cf-ceb0-496d-9705-a92b0a15d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.852281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738469cf-ceb0-496d-9705-a92b0a15d876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.852906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738469cf-ceb0-496d-9705-a92b0a15d876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.854530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738469cf-ceb0-496d-9705-a92b0a15d876 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.865791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1046/2121] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:57.869472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738469cf-ceb0-496d-9705-a92b0a15d876 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.875365 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1076/2122] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:57.880298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738469cf-ceb0-496d-9705-a92b0a15d876 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.893442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98702eb5-bc9a-4d24-87a8-1383e484e5cb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.894570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2ef77-2128-4918-9546-e7a2baedc2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.895232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2ef77-2128-4918-9546-e7a2baedc2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.895509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2ef77-2128-4918-9546-e7a2baedc2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.895784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2ef77-2128-4918-9546-e7a2baedc2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.896429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2ef77-2128-4918-9546-e7a2baedc2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.898034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2ef77-2128-4918-9546-e7a2baedc2c7 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.898230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-98702eb5-bc9a-4d24-87a8-1383e484e5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:57.911238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1047/2123] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:18:57.914751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2ef77-2128-4918-9546-e7a2baedc2c7 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:57.925547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2ef77-2128-4918-9546-e7a2baedc2c7 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.931195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98709556-5372-4f87-9bb4-86aebcd1aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.931948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98709556-5372-4f87-9bb4-86aebcd1aaec admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.932612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98709556-5372-4f87-9bb4-86aebcd1aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.932719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98709556-5372-4f87-9bb4-86aebcd1aaec admin admin] PATH_INFO: `/v3/projects/4dcfc584ea054dc2b84e7daa8cc6bbb5/users/a92d4b5f90164a5893b896a656c446a1/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.949856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98709556-5372-4f87-9bb4-86aebcd1aaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcfc584ea054dc2b84e7daa8cc6bbb5, user_id=a92d4b5f90164a5893b896a656c446a1, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.952646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98709556-5372-4f87-9bb4-86aebcd1aaec admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.967522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98702eb5-bc9a-4d24-87a8-1383e484e5cb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:57.971369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95484bab-e143-40d5-a204-4bc60df213e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:57.978496 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95484bab-e143-40d5-a204-4bc60df213e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:57.978496 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95484bab-e143-40d5-a204-4bc60df213e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:57.978496 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95484bab-e143-40d5-a204-4bc60df213e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:57.982889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95484bab-e143-40d5-a204-4bc60df213e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:57.984886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95484bab-e143-40d5-a204-4bc60df213e8 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:57.995514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1077/2124] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:58.031543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1048/2125] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:18:57 2022] PUT /identity/v3/projects/4dcfc584ea054dc2b84e7daa8cc6bbb5/users/a92d4b5f90164a5893b896a656c446a1/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:58.050708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a16c8d-f770-4884-8562-5c3178146bbe None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:58.050924 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a16c8d-f770-4884-8562-5c3178146bbe None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:58.051245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a16c8d-f770-4884-8562-5c3178146bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:58.081246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-57a16c8d-f770-4884-8562-5c3178146bbe None None] MFA Rules not processed for user `a92d4b5f90164a5893b896a656c446a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:58.082704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-57a16c8d-f770-4884-8562-5c3178146bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:58.147933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1078/2126] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:58.160276 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98709556-5372-4f87-9bb4-86aebcd1aaec admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:58.162244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-98709556-5372-4f87-9bb4-86aebcd1aaec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:58.228699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98709556-5372-4f87-9bb4-86aebcd1aaec admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:58.233257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df304d81-adaa-48ee-add5-b7d8adcc2710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:58.233870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304d81-adaa-48ee-add5-b7d8adcc2710 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:58.234146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304d81-adaa-48ee-add5-b7d8adcc2710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:58.234417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df304d81-adaa-48ee-add5-b7d8adcc2710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:58.244318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df304d81-adaa-48ee-add5-b7d8adcc2710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:58.245800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df304d81-adaa-48ee-add5-b7d8adcc2710 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:58.255343 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1049/2127] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:58.274823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a16c8d-f770-4884-8562-5c3178146bbe None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:58.338636 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a16c8d-f770-4884-8562-5c3178146bbe None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:58.343958 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:58.344591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:58.344864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:58.345132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] PATH_INFO: `/v3/users/a92d4b5f90164a5893b896a656c446a1` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:58.346258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a92d4b5f90164a5893b896a656c446a1)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:58.348230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:58.395770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:58.554111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92d4b5f90164a5893b896a656c446a1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:58.554812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92d4b5f90164a5893b896a656c446a1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:58.562363 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:58.669480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92d4b5f90164a5893b896a656c446a1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:58.670225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92d4b5f90164a5893b896a656c446a1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:58.679647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92d4b5f90164a5893b896a656c446a1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:58.698743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1079/2128] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:18:58 2022] DELETE /identity/v3/users/a92d4b5f90164a5893b896a656c446a1 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:58.703866 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed6c7-7dd4-4093-bb12-700601b25d3a None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:58.712289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed6c7-7dd4-4093-bb12-700601b25d3a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:58.712289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed6c7-7dd4-4093-bb12-700601b25d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:58.724356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-f7eed6c7-7dd4-4093-bb12-700601b25d3a None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:58.727702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f7eed6c7-7dd4-4093-bb12-700601b25d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:58.792453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1050/2129] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:58.802800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:58.805452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:58.869967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3c279-3fe8-4884-9496-44469e15571e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:58.874047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574a0e5-0552-4485-9135-fa71c4a2c148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:58.874740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574a0e5-0552-4485-9135-fa71c4a2c148 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:58.875196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574a0e5-0552-4485-9135-fa71c4a2c148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:58.875735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574a0e5-0552-4485-9135-fa71c4a2c148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:58.886499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574a0e5-0552-4485-9135-fa71c4a2c148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:58.888724 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574a0e5-0552-4485-9135-fa71c4a2c148 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:58.899024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1080/2130] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:18:59.463041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eed6c7-7dd4-4093-bb12-700601b25d3a None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:59.464512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f7eed6c7-7dd4-4093-bb12-700601b25d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:59.485817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eed6c7-7dd4-4093-bb12-700601b25d3a None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:59.492313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:59.500428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:59.500428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:59.500428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] PATH_INFO: `/v3/projects/4dcfc584ea054dc2b84e7daa8cc6bbb5` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:59.500428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dcfc584ea054dc2b84e7daa8cc6bbb5)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:59.500428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:59.642188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dcfc584ea054dc2b84e7daa8cc6bbb5', 'request_id': 'req-42d15945-2920-4633-967c-5ad8b0151fb0'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:59.648118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dcfc584ea054dc2b84e7daa8cc6bbb5', 'request_id': 'req-42d15945-2920-4633-967c-5ad8b0151fb0'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:59.654936 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dcfc584ea054dc2b84e7daa8cc6bbb5', 'request_id': 'req-42d15945-2920-4633-967c-5ad8b0151fb0'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:59.729142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] The token cache is being invalidate because project 4dcfc584ea054dc2b84e7daa8cc6bbb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:18:59.731780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:59.732279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-42d15945-2920-4633-967c-5ad8b0151fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:18:59.735316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1051/2131] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:18:59 2022] DELETE /identity/v3/projects/4dcfc584ea054dc2b84e7daa8cc6bbb5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:18:59.743034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04296f-3a11-4b08-ba57-d3eac85faa0c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:59.743552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04296f-3a11-4b08-ba57-d3eac85faa0c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:59.744485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04296f-3a11-4b08-ba57-d3eac85faa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:59.782042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7d04296f-3a11-4b08-ba57-d3eac85faa0c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:59.784206 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7d04296f-3a11-4b08-ba57-d3eac85faa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:59.785587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:59.885437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1081/2132] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:59.887975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906c71-9f35-4af8-8c3d-b5d837a45f00 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:59.888253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906c71-9f35-4af8-8c3d-b5d837a45f00 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:59.888528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906c71-9f35-4af8-8c3d-b5d837a45f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:59.911965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0a906c71-9f35-4af8-8c3d-b5d837a45f00 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:18:59.913378 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0a906c71-9f35-4af8-8c3d-b5d837a45f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:18:59.922362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1052/2133] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:18:59.927104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04296f-3a11-4b08-ba57-d3eac85faa0c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:59.939022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04296f-3a11-4b08-ba57-d3eac85faa0c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:18:59.944734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f9f46-68ba-446f-a7e5-c7f3d9e715aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:18:59.945727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9f46-68ba-446f-a7e5-c7f3d9e715aa admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:18:59.946070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9f46-68ba-446f-a7e5-c7f3d9e715aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:18:59.946381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9f46-68ba-446f-a7e5-c7f3d9e715aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:18:59.947091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f9f46-68ba-446f-a7e5-c7f3d9e715aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:18:59.947396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f9f46-68ba-446f-a7e5-c7f3d9e715aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:18:59.949925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f9f46-68ba-446f-a7e5-c7f3d9e715aa admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:18:59.972893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1082/2134] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:18:59.977347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906c71-9f35-4af8-8c3d-b5d837a45f00 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:18:59.993006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906c71-9f35-4af8-8c3d-b5d837a45f00 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:00.000160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070b66d-de0a-4faa-bb67-d5b73caada14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:00.000921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b66d-de0a-4faa-bb67-d5b73caada14 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:00.001201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b66d-de0a-4faa-bb67-d5b73caada14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:00.001474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b66d-de0a-4faa-bb67-d5b73caada14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:00.002164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070b66d-de0a-4faa-bb67-d5b73caada14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:00.004176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070b66d-de0a-4faa-bb67-d5b73caada14 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:00.113837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1053/2135] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:18:59 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:19:00.118176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f9f46-68ba-446f-a7e5-c7f3d9e715aa admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:00.133150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f9f46-68ba-446f-a7e5-c7f3d9e715aa admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:00.198633 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048aef77-f1f9-462e-93e1-646dbb0993a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:00.199260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aef77-f1f9-462e-93e1-646dbb0993a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:00.199536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aef77-f1f9-462e-93e1-646dbb0993a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:00.200363 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aef77-f1f9-462e-93e1-646dbb0993a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:00.201034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048aef77-f1f9-462e-93e1-646dbb0993a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:00.202975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048aef77-f1f9-462e-93e1-646dbb0993a7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:00.231175 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:00.289376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1083/2136] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:19:00 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:19:00.295066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070b66d-de0a-4faa-bb67-d5b73caada14 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:00.305602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070b66d-de0a-4faa-bb67-d5b73caada14 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:00.310378 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51c049-bc17-428f-8389-6ad7c65008c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:00.311020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c049-bc17-428f-8389-6ad7c65008c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:00.311792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c049-bc17-428f-8389-6ad7c65008c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:00.311792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c049-bc17-428f-8389-6ad7c65008c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:00.312186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51c049-bc17-428f-8389-6ad7c65008c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:00.313882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51c049-bc17-428f-8389-6ad7c65008c9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:00.324084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1054/2137] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:19:00.328662 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048aef77-f1f9-462e-93e1-646dbb0993a7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:00.339071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048aef77-f1f9-462e-93e1-646dbb0993a7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:00.344352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0951b-5aba-40fb-a62a-a2b72ad167a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:00.345032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0951b-5aba-40fb-a62a-a2b72ad167a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:00.345211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0951b-5aba-40fb-a62a-a2b72ad167a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:00.345480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0951b-5aba-40fb-a62a-a2b72ad167a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:00.346115 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0951b-5aba-40fb-a62a-a2b72ad167a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:00.347739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0951b-5aba-40fb-a62a-a2b72ad167a1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:00.362043 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1084/2138] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:19:00.367507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51c049-bc17-428f-8389-6ad7c65008c9 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:00.367620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0951b-5aba-40fb-a62a-a2b72ad167a1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:00.367698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-8f51c049-bc17-428f-8389-6ad7c65008c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:00.373423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0951b-5aba-40fb-a62a-a2b72ad167a1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:00.379144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be424cfe-2c77-4fbf-ae57-1421ee7ede00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:00.379574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51c049-bc17-428f-8389-6ad7c65008c9 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:00.379842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be424cfe-2c77-4fbf-ae57-1421ee7ede00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:00.380118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be424cfe-2c77-4fbf-ae57-1421ee7ede00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:00.380391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be424cfe-2c77-4fbf-ae57-1421ee7ede00 admin admin] PATH_INFO: `/v3/projects/82d52e0b1ddf4735a0e7980d11a1dead/users/3252bd3cb18b4a2fa47b2d7b15b436b6/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:00.386738 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:00.388606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:00.388943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:00.389163 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] PATH_INFO: `/v3/users/457bfd566a1d4e9eb7ff5e9c703a445c` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:00.392383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=457bfd566a1d4e9eb7ff5e9c703a445c)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:00.392495 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:00.409797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be424cfe-2c77-4fbf-ae57-1421ee7ede00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d52e0b1ddf4735a0e7980d11a1dead, user_id=3252bd3cb18b4a2fa47b2d7b15b436b6, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:00.416606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be424cfe-2c77-4fbf-ae57-1421ee7ede00 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:00.521679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1085/2139] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:19:00 2022] PUT /identity/v3/projects/82d52e0b1ddf4735a0e7980d11a1dead/users/3252bd3cb18b4a2fa47b2d7b15b436b6/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:19:00.526517 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f85c-6d79-4dae-b119-09a0f1d61af8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:00.526912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f85c-6d79-4dae-b119-09a0f1d61af8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:00.527293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f85c-6d79-4dae-b119-09a0f1d61af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:00.551653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1ac3f85c-6d79-4dae-b119-09a0f1d61af8 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:00.553505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1ac3f85c-6d79-4dae-b119-09a0f1d61af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:00.629143 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457bfd566a1d4e9eb7ff5e9c703a445c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:00.630828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457bfd566a1d4e9eb7ff5e9c703a445c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:00.641205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1086/2140] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:00.652077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3f85c-6d79-4dae-b119-09a0f1d61af8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:00.653506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1ac3f85c-6d79-4dae-b119-09a0f1d61af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:00.759145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457bfd566a1d4e9eb7ff5e9c703a445c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:00.759945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457bfd566a1d4e9eb7ff5e9c703a445c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:00.772278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457bfd566a1d4e9eb7ff5e9c703a445c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:00.779371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3f85c-6d79-4dae-b119-09a0f1d61af8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:00.791323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275de0a6-00b3-49e0-a3d0-5873aa5f4e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:00.792189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de0a6-00b3-49e0-a3d0-5873aa5f4e61 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:00.792550 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de0a6-00b3-49e0-a3d0-5873aa5f4e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:00.792820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de0a6-00b3-49e0-a3d0-5873aa5f4e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:00.796855 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-275de0a6-00b3-49e0-a3d0-5873aa5f4e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:00.804881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1055/2141] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:19:00 2022] DELETE /identity/v3/users/457bfd566a1d4e9eb7ff5e9c703a445c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:19:00.806078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:00.808067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:00.829461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275de0a6-00b3-49e0-a3d0-5873aa5f4e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:00.831249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275de0a6-00b3-49e0-a3d0-5873aa5f4e61 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:00.843229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1087/2142] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:19:00.845368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fe4ef-1390-4c27-918c-08ce549d002d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:00.845751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fe4ef-1390-4c27-918c-08ce549d002d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:00.846229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fe4ef-1390-4c27-918c-08ce549d002d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:00.870891 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d77fe4ef-1390-4c27-918c-08ce549d002d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:00.873041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d77fe4ef-1390-4c27-918c-08ce549d002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:00.909972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574caf1-0618-4907-ad5f-03b6c672bfdf admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:00.915715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:00.916350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:00.916623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:00.917041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] PATH_INFO: `/v3/users/394e704d41eb4b1c9b4d83474acf9981` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:00.920034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=394e704d41eb4b1c9b4d83474acf9981)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:00.922581 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:00.955087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1088/2143] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:00.967979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fe4ef-1390-4c27-918c-08ce549d002d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:00.970231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d77fe4ef-1390-4c27-918c-08ce549d002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:01.046918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fe4ef-1390-4c27-918c-08ce549d002d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:01.051062 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fb841-4098-46b7-97ac-25fb9641f6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:01.051830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fb841-4098-46b7-97ac-25fb9641f6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:01.052107 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fb841-4098-46b7-97ac-25fb9641f6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:01.052383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fb841-4098-46b7-97ac-25fb9641f6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:01.067762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fb841-4098-46b7-97ac-25fb9641f6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:01.073113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fb841-4098-46b7-97ac-25fb9641f6a3 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:01.085333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1089/2144] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:19:01.152666 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394e704d41eb4b1c9b4d83474acf9981'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:01.153429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394e704d41eb4b1c9b4d83474acf9981'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:01.248415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394e704d41eb4b1c9b4d83474acf9981'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:01.249252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394e704d41eb4b1c9b4d83474acf9981'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:01.258645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394e704d41eb4b1c9b4d83474acf9981'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:01.279298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1056/2145] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:19:00 2022] DELETE /identity/v3/users/394e704d41eb4b1c9b4d83474acf9981 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:01.283950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed6662-14fb-42e4-b88e-0038b4fc94a7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:01.284234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed6662-14fb-42e4-b88e-0038b4fc94a7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:01.284533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed6662-14fb-42e4-b88e-0038b4fc94a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:01.307561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-46ed6662-14fb-42e4-b88e-0038b4fc94a7 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:01.308798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-46ed6662-14fb-42e4-b88e-0038b4fc94a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:01.374315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1090/2146] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:01.397268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:01.399637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:01.509847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e1f57-45d2-4c91-b5a0-e36aba2832ab admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:01.514066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be3f9c-7e2a-4cdb-80db-cb0349beb50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:01.519181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3f9c-7e2a-4cdb-80db-cb0349beb50a service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:01.519931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3f9c-7e2a-4cdb-80db-cb0349beb50a service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:01.525551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3f9c-7e2a-4cdb-80db-cb0349beb50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:01.548427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be3f9c-7e2a-4cdb-80db-cb0349beb50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:01.548427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be3f9c-7e2a-4cdb-80db-cb0349beb50a service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:01.562175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1057/2147] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:01.637640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:01.845333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed6662-14fb-42e4-b88e-0038b4fc94a7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:01.846844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-46ed6662-14fb-42e4-b88e-0038b4fc94a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:01.869911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed6662-14fb-42e4-b88e-0038b4fc94a7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:01.878913 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:01.879638 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:01.879837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:01.880111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] PATH_INFO: `/v3/projects/c45d5d252aaf4123ac50ca1df9cf0a2c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:01.881280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45d5d252aaf4123ac50ca1df9cf0a2c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:01.883238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:02.048859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45d5d252aaf4123ac50ca1df9cf0a2c', 'request_id': 'req-c8315b06-e1de-466c-b404-b53b2e19e1a3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:02.058188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45d5d252aaf4123ac50ca1df9cf0a2c', 'request_id': 'req-c8315b06-e1de-466c-b404-b53b2e19e1a3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:02.067433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45d5d252aaf4123ac50ca1df9cf0a2c', 'request_id': 'req-c8315b06-e1de-466c-b404-b53b2e19e1a3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:02.140306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:02.148894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] The token cache is being invalidate because project c45d5d252aaf4123ac50ca1df9cf0a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:19:02.149511 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:02.150379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c8315b06-e1de-466c-b404-b53b2e19e1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:02.155602 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1091/2148] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:19:01 2022] DELETE /identity/v3/projects/c45d5d252aaf4123ac50ca1df9cf0a2c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:02.157266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebaeb-0b07-4501-83f0-ea39039b4e3b None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:02.157719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebaeb-0b07-4501-83f0-ea39039b4e3b None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:02.157920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebaeb-0b07-4501-83f0-ea39039b4e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:02.185619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-ca2ebaeb-0b07-4501-83f0-ea39039b4e3b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:02.187875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ca2ebaeb-0b07-4501-83f0-ea39039b4e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:02.303028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1058/2149] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:02.306487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbeff0-b6ee-4d03-9abd-70402364d20e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:02.306984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbeff0-b6ee-4d03-9abd-70402364d20e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:02.307453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbeff0-b6ee-4d03-9abd-70402364d20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:02.336455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-21fbeff0-b6ee-4d03-9abd-70402364d20e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:02.337930 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-21fbeff0-b6ee-4d03-9abd-70402364d20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:02.351737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1092/2150] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:02.353686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ebaeb-0b07-4501-83f0-ea39039b4e3b None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:02.367184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ebaeb-0b07-4501-83f0-ea39039b4e3b None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:02.374337 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706dcef-42f6-4a02-85de-da97d9285043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:02.375443 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706dcef-42f6-4a02-85de-da97d9285043 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:02.377505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706dcef-42f6-4a02-85de-da97d9285043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:02.377853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706dcef-42f6-4a02-85de-da97d9285043 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:02.378631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706dcef-42f6-4a02-85de-da97d9285043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:19:02.379060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706dcef-42f6-4a02-85de-da97d9285043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:02.381317 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706dcef-42f6-4a02-85de-da97d9285043 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:02.430077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1059/2151] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:19:02.430888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbeff0-b6ee-4d03-9abd-70402364d20e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:02.441440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbeff0-b6ee-4d03-9abd-70402364d20e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:02.447406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f924348-ba1d-4f7d-83a3-7fa750b3fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:02.448138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f924348-ba1d-4f7d-83a3-7fa750b3fa92 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:02.448413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f924348-ba1d-4f7d-83a3-7fa750b3fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:02.448682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f924348-ba1d-4f7d-83a3-7fa750b3fa92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:02.449360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f924348-ba1d-4f7d-83a3-7fa750b3fa92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:02.451384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f924348-ba1d-4f7d-83a3-7fa750b3fa92 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:02.532960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706dcef-42f6-4a02-85de-da97d9285043 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:02.535246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f706dcef-42f6-4a02-85de-da97d9285043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:02.550798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706dcef-42f6-4a02-85de-da97d9285043 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:02.561444 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:02.562238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:02.562604 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:02.563042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] PATH_INFO: `/v3/projects/75d8356d96a04e85beea0e09a492e3c9` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:02.564446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d8356d96a04e85beea0e09a492e3c9)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:02.566555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:02.591578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1093/2152] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:19:02 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:19:02.592063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f924348-ba1d-4f7d-83a3-7fa750b3fa92 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:02.707283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f924348-ba1d-4f7d-83a3-7fa750b3fa92 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:02.713856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da9710-f241-4c7e-b77d-014e81345bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:02.714601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9710-f241-4c7e-b77d-014e81345bea admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:02.715025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9710-f241-4c7e-b77d-014e81345bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:02.716067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9710-f241-4c7e-b77d-014e81345bea admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:02.717410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da9710-f241-4c7e-b77d-014e81345bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:02.720220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da9710-f241-4c7e-b77d-014e81345bea admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:02.760432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d8356d96a04e85beea0e09a492e3c9', 'request_id': 'req-e3a3a5b1-6033-4670-bca6-12a754c3de92'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:02.779543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d8356d96a04e85beea0e09a492e3c9', 'request_id': 'req-e3a3a5b1-6033-4670-bca6-12a754c3de92'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:02.788520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d8356d96a04e85beea0e09a492e3c9', 'request_id': 'req-e3a3a5b1-6033-4670-bca6-12a754c3de92'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:02.834380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1094/2153] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:19:02 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:19:02.834380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437001d-bafa-4b58-8829-50359be78d98 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:02.834380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437001d-bafa-4b58-8829-50359be78d98 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:02.834380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437001d-bafa-4b58-8829-50359be78d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:02.869962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d437001d-bafa-4b58-8829-50359be78d98 None None] MFA Rules not processed for user `3252bd3cb18b4a2fa47b2d7b15b436b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:02.871238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d437001d-bafa-4b58-8829-50359be78d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:02.890891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] The token cache is being invalidate because project 75d8356d96a04e85beea0e09a492e3c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:19:02.892044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:02.892895 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:02.895244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1060/2154] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:19:02 2022] DELETE /identity/v3/projects/75d8356d96a04e85beea0e09a492e3c9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:02.898269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:02.898269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:02.962724 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1095/2155] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:02.963841 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437001d-bafa-4b58-8829-50359be78d98 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:02.965969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d437001d-bafa-4b58-8829-50359be78d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:02.972366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:02.993811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3a5b1-6033-4670-bca6-12a754c3de92 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:03.002207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d4b8c-5797-4a6e-8ab2-d1e4b855993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:03.002928 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d4b8c-5797-4a6e-8ab2-d1e4b855993f admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:03.003267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d4b8c-5797-4a6e-8ab2-d1e4b855993f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:03.003599 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d4b8c-5797-4a6e-8ab2-d1e4b855993f admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:03.006221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d4b8c-5797-4a6e-8ab2-d1e4b855993f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:03.006221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d4b8c-5797-4a6e-8ab2-d1e4b855993f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:03.018840 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1061/2156] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:19:03.019987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d4b8c-5797-4a6e-8ab2-d1e4b855993f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:03.025960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-911d4b8c-5797-4a6e-8ab2-d1e4b855993f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:03.070140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437001d-bafa-4b58-8829-50359be78d98 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:03.083104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:03.084325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:03.084705 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:03.084979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] PATH_INFO: `/v3/users/c7f341c8fc7d48f3a86020d1b865831a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:03.086499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f341c8fc7d48f3a86020d1b865831a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:03.088960 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:03.121662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d4b8c-5797-4a6e-8ab2-d1e4b855993f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:03.125677 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bd17d-9bd8-40df-bc5e-64c7dc375967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:03.129798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd17d-9bd8-40df-bc5e-64c7dc375967 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:03.129798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd17d-9bd8-40df-bc5e-64c7dc375967 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:03.129798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bd17d-9bd8-40df-bc5e-64c7dc375967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:03.143621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bd17d-9bd8-40df-bc5e-64c7dc375967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:03.145257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bd17d-9bd8-40df-bc5e-64c7dc375967 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:03.155602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1062/2157] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:03.156443 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bd17d-9bd8-40df-bc5e-64c7dc375967 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:03.169568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bd17d-9bd8-40df-bc5e-64c7dc375967 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:03.175538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5e18d-e9bd-4b74-b316-acbcc6794193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:03.176153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e18d-e9bd-4b74-b316-acbcc6794193 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:03.176794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e18d-e9bd-4b74-b316-acbcc6794193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:03.177134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e18d-e9bd-4b74-b316-acbcc6794193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:03.177961 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5e18d-e9bd-4b74-b316-acbcc6794193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:03.179766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5e18d-e9bd-4b74-b316-acbcc6794193 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:03.193475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1063/2158] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:19:03.197521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5e18d-e9bd-4b74-b316-acbcc6794193 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:03.212960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5e18d-e9bd-4b74-b316-acbcc6794193 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:03.220318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464cf0c-23dd-42c4-8ecd-4f0b9dac56a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:03.221557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464cf0c-23dd-42c4-8ecd-4f0b9dac56a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:03.221850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464cf0c-23dd-42c4-8ecd-4f0b9dac56a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:03.222187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464cf0c-23dd-42c4-8ecd-4f0b9dac56a1 admin admin] PATH_INFO: `/v3/projects/daf538e298ce4bb1ba4d5a4ce45fbb5e/users/61c5fea9761d4cc69f33e5b3259a08f4/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:03.253948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464cf0c-23dd-42c4-8ecd-4f0b9dac56a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf538e298ce4bb1ba4d5a4ce45fbb5e, user_id=61c5fea9761d4cc69f33e5b3259a08f4, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:03.256918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464cf0c-23dd-42c4-8ecd-4f0b9dac56a1 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:03.325207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f341c8fc7d48f3a86020d1b865831a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:03.326692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f341c8fc7d48f3a86020d1b865831a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:03.345884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1064/2159] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:19:03 2022] PUT /identity/v3/projects/daf538e298ce4bb1ba4d5a4ce45fbb5e/users/61c5fea9761d4cc69f33e5b3259a08f4/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:19:03.347672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30fdd8-eeb6-432e-a922-dce2fe2ab4be None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:03.348082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30fdd8-eeb6-432e-a922-dce2fe2ab4be None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:03.348959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30fdd8-eeb6-432e-a922-dce2fe2ab4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:03.391230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-6b30fdd8-eeb6-432e-a922-dce2fe2ab4be None None] MFA Rules not processed for user `61c5fea9761d4cc69f33e5b3259a08f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:03.393009 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6b30fdd8-eeb6-432e-a922-dce2fe2ab4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:03.657142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f341c8fc7d48f3a86020d1b865831a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:03.657142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f341c8fc7d48f3a86020d1b865831a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:03.657142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f341c8fc7d48f3a86020d1b865831a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:03.657142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1096/2160] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:19:02 2022] DELETE /identity/v3/users/c7f341c8fc7d48f3a86020d1b865831a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:03.689341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1065/2161] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:03.690156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:03.690156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:03.690156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c267f-f91b-4e61-b886-6350f697b5f8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:03.690549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd822b-1990-41a2-9690-61e3257c2923 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0892bfab3ce435b90b93b0786899f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:03.690549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd822b-1990-41a2-9690-61e3257c2923 service glance] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:03.690549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd822b-1990-41a2-9690-61e3257c2923 service glance] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:03.690549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd822b-1990-41a2-9690-61e3257c2923 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:03.796821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd822b-1990-41a2-9690-61e3257c2923 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:03.798505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd822b-1990-41a2-9690-61e3257c2923 service glance] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:03.811776 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1097/2162] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:04.061332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b0b55-de63-48ee-9550-95bf3e8c1b72 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:04.061626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b0b55-de63-48ee-9550-95bf3e8c1b72 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:04.061957 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b0b55-de63-48ee-9550-95bf3e8c1b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:04.111054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a68b0b55-de63-48ee-9550-95bf3e8c1b72 None None] MFA Rules not processed for user `f3ca84526cc8440ab332292c2fb4e73e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:04.112298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a68b0b55-de63-48ee-9550-95bf3e8c1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:04.156165 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd822b-1990-41a2-9690-61e3257c2923 service glance] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:04.160412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dcfd822b-1990-41a2-9690-61e3257c2923 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:04.260105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1066/2163] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:04.271810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecdbbe-ba99-4a4e-838f-bb2b0012e6ee None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:04.272132 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecdbbe-ba99-4a4e-838f-bb2b0012e6ee None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:04.272411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecdbbe-ba99-4a4e-838f-bb2b0012e6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:04.288886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:04.298807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c7ecdbbe-ba99-4a4e-838f-bb2b0012e6ee None None] MFA Rules not processed for user `f3ca84526cc8440ab332292c2fb4e73e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:04.302432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c7ecdbbe-ba99-4a4e-838f-bb2b0012e6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:04.309249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd822b-1990-41a2-9690-61e3257c2923 service glance] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:04.312721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1067/2164] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:04.322975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:04.322975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:04.322975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:04.322975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] PATH_INFO: `/v3/projects/285f6ef75a8c45f2945b9f51b4f5d279` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:04.323482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285f6ef75a8c45f2945b9f51b4f5d279)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:04.323482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:04.333831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecdbbe-ba99-4a4e-838f-bb2b0012e6ee None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:04.335276 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c7ecdbbe-ba99-4a4e-838f-bb2b0012e6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:04.419748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecdbbe-ba99-4a4e-838f-bb2b0012e6ee None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:04.428403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35beb11-2cfd-4a42-b89f-09aef5998042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:04.428403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35beb11-2cfd-4a42-b89f-09aef5998042 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:04.428805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35beb11-2cfd-4a42-b89f-09aef5998042 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:04.429086 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35beb11-2cfd-4a42-b89f-09aef5998042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:04.437691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35beb11-2cfd-4a42-b89f-09aef5998042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:04.439430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35beb11-2cfd-4a42-b89f-09aef5998042 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:04.447761 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285f6ef75a8c45f2945b9f51b4f5d279', 'request_id': 'req-842ed107-c981-4b9d-8241-56b2c266b9b1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:04.451541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1068/2165] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:04.457079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285f6ef75a8c45f2945b9f51b4f5d279', 'request_id': 'req-842ed107-c981-4b9d-8241-56b2c266b9b1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:04.460495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285f6ef75a8c45f2945b9f51b4f5d279', 'request_id': 'req-842ed107-c981-4b9d-8241-56b2c266b9b1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:04.548938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] The token cache is being invalidate because project 285f6ef75a8c45f2945b9f51b4f5d279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:19:04.549298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:04.550040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-842ed107-c981-4b9d-8241-56b2c266b9b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:04.554456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1098/2166] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:19:04 2022] DELETE /identity/v3/projects/285f6ef75a8c45f2945b9f51b4f5d279 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:19:04.556018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35beb11-2cfd-4a42-b89f-09aef5998042 service nova] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:04.570861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35beb11-2cfd-4a42-b89f-09aef5998042 service nova] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:04.663413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:04.664435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:04.664909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:04.665382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] PATH_INFO: `/v3/users/13b37df040bc429aaf784b81b974762d` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:04.666611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b37df040bc429aaf784b81b974762d)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:04.668703 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:04.922591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b37df040bc429aaf784b81b974762d'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:04.923233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b37df040bc429aaf784b81b974762d'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:05.046901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b37df040bc429aaf784b81b974762d'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:05.049757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b37df040bc429aaf784b81b974762d'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:05.055799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b37df040bc429aaf784b81b974762d'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:05.076901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1069/2167] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:19:04 2022] DELETE /identity/v3/users/13b37df040bc429aaf784b81b974762d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:05.351454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ea79-1977-4ac1-aac2-2c21cced7f73 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:05.351998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ea79-1977-4ac1-aac2-2c21cced7f73 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:05.351998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ea79-1977-4ac1-aac2-2c21cced7f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:05.376827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4f99ea79-1977-4ac1-aac2-2c21cced7f73 None None] MFA Rules not processed for user `f3ca84526cc8440ab332292c2fb4e73e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:05.378414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4f99ea79-1977-4ac1-aac2-2c21cced7f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:05.396893 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:05.469421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1099/2168] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:05.547148 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:05.548612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:05.634633 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57fe32-544d-4588-8c22-09a8eaba95ae admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:05.640129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:05.640890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:05.641263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:05.641604 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] PATH_INFO: `/v3/projects/f14ea67ec336456b96bd9f68f3424f4c` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:05.642906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14ea67ec336456b96bd9f68f3424f4c)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:05.645061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:05.784406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14ea67ec336456b96bd9f68f3424f4c', 'request_id': 'req-4e641346-6c92-4c2a-b9cd-80145996cf97'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:05.795595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14ea67ec336456b96bd9f68f3424f4c', 'request_id': 'req-4e641346-6c92-4c2a-b9cd-80145996cf97'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:05.802615 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14ea67ec336456b96bd9f68f3424f4c', 'request_id': 'req-4e641346-6c92-4c2a-b9cd-80145996cf97'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:05.925507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] The token cache is being invalidate because project f14ea67ec336456b96bd9f68f3424f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:19:05.925507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:05.925507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e641346-6c92-4c2a-b9cd-80145996cf97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:05.925507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1070/2169] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:19:05 2022] DELETE /identity/v3/projects/f14ea67ec336456b96bd9f68f3424f4c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:05.927112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18414b-2c99-403c-be8f-a054d0243dab None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:05.927507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18414b-2c99-403c-be8f-a054d0243dab None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:05.927671 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18414b-2c99-403c-be8f-a054d0243dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:05.952975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1c18414b-2c99-403c-be8f-a054d0243dab None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:05.954400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1c18414b-2c99-403c-be8f-a054d0243dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:06.028596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1100/2170] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:06.037749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3364fd-c42d-4dee-9c2f-40d575b7db36 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:06.037749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3364fd-c42d-4dee-9c2f-40d575b7db36 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:06.037749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3364fd-c42d-4dee-9c2f-40d575b7db36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:06.082080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3f3364fd-c42d-4dee-9c2f-40d575b7db36 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:06.083389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3f3364fd-c42d-4dee-9c2f-40d575b7db36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:06.093411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1071/2171] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:06.107428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18414b-2c99-403c-be8f-a054d0243dab None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:06.119297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18414b-2c99-403c-be8f-a054d0243dab None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:06.125469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cae0d7-7776-401a-a7d5-9bc8682365ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:06.126094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae0d7-7776-401a-a7d5-9bc8682365ed admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:06.126373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae0d7-7776-401a-a7d5-9bc8682365ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:06.126648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae0d7-7776-401a-a7d5-9bc8682365ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:06.127386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cae0d7-7776-401a-a7d5-9bc8682365ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:19:06.127714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cae0d7-7776-401a-a7d5-9bc8682365ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:06.129442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cae0d7-7776-401a-a7d5-9bc8682365ed admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:06.145606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1101/2172] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:19:06.150045 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3364fd-c42d-4dee-9c2f-40d575b7db36 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:06.160467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3364fd-c42d-4dee-9c2f-40d575b7db36 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:06.166487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceba525-67d1-4e88-b0a6-051a48846691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:06.167472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba525-67d1-4e88-b0a6-051a48846691 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:06.168128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba525-67d1-4e88-b0a6-051a48846691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:06.168603 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba525-67d1-4e88-b0a6-051a48846691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:06.169432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceba525-67d1-4e88-b0a6-051a48846691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:06.171713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceba525-67d1-4e88-b0a6-051a48846691 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:06.295850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1072/2173] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:19:06 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:19:06.297197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cae0d7-7776-401a-a7d5-9bc8682365ed admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:06.334368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cae0d7-7776-401a-a7d5-9bc8682365ed admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:06.362348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a675b62-8a36-4945-b0dc-d1c49a673af8 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:06.362630 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a675b62-8a36-4945-b0dc-d1c49a673af8 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:06.362940 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a675b62-8a36-4945-b0dc-d1c49a673af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:06.385630 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0a675b62-8a36-4945-b0dc-d1c49a673af8 None None] MFA Rules not processed for user `3252bd3cb18b4a2fa47b2d7b15b436b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:06.388995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0a675b62-8a36-4945-b0dc-d1c49a673af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:06.434552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c494b-24d2-4c38-a27f-3f08359a5b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:06.436034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c494b-24d2-4c38-a27f-3f08359a5b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:06.438213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c494b-24d2-4c38-a27f-3f08359a5b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:06.438720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c494b-24d2-4c38-a27f-3f08359a5b84 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:06.439616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c494b-24d2-4c38-a27f-3f08359a5b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:06.442533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c494b-24d2-4c38-a27f-3f08359a5b84 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:06.461655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1073/2174] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:19:06.547879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1102/2175] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:19:06 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:19:06.549602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a675b62-8a36-4945-b0dc-d1c49a673af8 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:06.561750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a675b62-8a36-4945-b0dc-d1c49a673af8 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:06.567219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef3473-cc2f-4fdf-ad2e-55431c39e656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:06.573672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3473-cc2f-4fdf-ad2e-55431c39e656 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:06.573672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3473-cc2f-4fdf-ad2e-55431c39e656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:06.573672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3473-cc2f-4fdf-ad2e-55431c39e656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:06.573672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef3473-cc2f-4fdf-ad2e-55431c39e656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:06.573672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef3473-cc2f-4fdf-ad2e-55431c39e656 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:06.582234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1074/2176] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:19:06.586243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c494b-24d2-4c38-a27f-3f08359a5b84 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:06.618885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c494b-24d2-4c38-a27f-3f08359a5b84 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:06.632160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a838ca-8d58-465b-899a-009a9701e668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:06.633297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a838ca-8d58-465b-899a-009a9701e668 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:06.633793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a838ca-8d58-465b-899a-009a9701e668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:06.634348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a838ca-8d58-465b-899a-009a9701e668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:06.635293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a838ca-8d58-465b-899a-009a9701e668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:06.638174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a838ca-8d58-465b-899a-009a9701e668 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:06.656916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef3473-cc2f-4fdf-ad2e-55431c39e656 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:06.658277 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1103/2177] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:19:06.678533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef3473-cc2f-4fdf-ad2e-55431c39e656 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:06.685299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bd744-0669-4b88-aee2-059d46773ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:06.686732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bd744-0669-4b88-aee2-059d46773ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:06.687013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bd744-0669-4b88-aee2-059d46773ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:06.687288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bd744-0669-4b88-aee2-059d46773ab5 admin admin] PATH_INFO: `/v3/projects/67eb307a9e964ffc8623c2794aac4980/users/409459ce579d41719ac69044bc143c6b/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:06.710195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bd744-0669-4b88-aee2-059d46773ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67eb307a9e964ffc8623c2794aac4980, user_id=409459ce579d41719ac69044bc143c6b, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:06.713814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bd744-0669-4b88-aee2-059d46773ab5 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:06.840316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1075/2178] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:19:06 2022] PUT /identity/v3/projects/67eb307a9e964ffc8623c2794aac4980/users/409459ce579d41719ac69044bc143c6b/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:19:06.849127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9cdda-aa38-495d-8151-7444a9167b31 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:06.849403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9cdda-aa38-495d-8151-7444a9167b31 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:06.850457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9cdda-aa38-495d-8151-7444a9167b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:06.891918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f4e9cdda-aa38-495d-8151-7444a9167b31 None None] MFA Rules not processed for user `409459ce579d41719ac69044bc143c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:06.893509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f4e9cdda-aa38-495d-8151-7444a9167b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:06.994332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:07.036965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1104/2179] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:07.044974 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bd744-0669-4b88-aee2-059d46773ab5 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:07.046816 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dd8bd744-0669-4b88-aee2-059d46773ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:07.179450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bd744-0669-4b88-aee2-059d46773ab5 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:07.187339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f5a9-2d35-4c10-8f39-84fd07720f16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:07.190742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f5a9-2d35-4c10-8f39-84fd07720f16 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:07.192894 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f5a9-2d35-4c10-8f39-84fd07720f16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:07.193339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f5a9-2d35-4c10-8f39-84fd07720f16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:07.216829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86f5a9-2d35-4c10-8f39-84fd07720f16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:07.221564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86f5a9-2d35-4c10-8f39-84fd07720f16 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:07.238440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1076/2180] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:07.267288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9cdda-aa38-495d-8151-7444a9167b31 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:07.398825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9cdda-aa38-495d-8151-7444a9167b31 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:07.409389 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:07.410592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:07.411219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:07.411724 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] PATH_INFO: `/v3/users/409459ce579d41719ac69044bc143c6b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:07.413557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] RBAC: Authorizing `identity:delete_user(user_id=409459ce579d41719ac69044bc143c6b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:07.415955 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:07.688305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:07.706518 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409459ce579d41719ac69044bc143c6b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:07.707966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409459ce579d41719ac69044bc143c6b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:07.785243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409459ce579d41719ac69044bc143c6b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:07.785998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409459ce579d41719ac69044bc143c6b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:07.800235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409459ce579d41719ac69044bc143c6b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:07.827187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1105/2181] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:19:07 2022] DELETE /identity/v3/users/409459ce579d41719ac69044bc143c6b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:07.831572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3216a-10b3-4458-93cb-ee368d954efe None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:07.832091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3216a-10b3-4458-93cb-ee368d954efe None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:07.832625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3216a-10b3-4458-93cb-ee368d954efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:07.852819 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c0d3216a-10b3-4458-93cb-ee368d954efe None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:07.854138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c0d3216a-10b3-4458-93cb-ee368d954efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:07.917048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1077/2182] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:07.927654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:07.929814 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:08.008206 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e14f59-0c8f-4851-89f7-f1a56cd9122c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:08.012242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6697502-e117-48b6-9c2c-9b94be8bcea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:08.012923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697502-e117-48b6-9c2c-9b94be8bcea9 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:08.013403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697502-e117-48b6-9c2c-9b94be8bcea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:08.013847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6697502-e117-48b6-9c2c-9b94be8bcea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:08.023845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6697502-e117-48b6-9c2c-9b94be8bcea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:08.025338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6697502-e117-48b6-9c2c-9b94be8bcea9 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:08.041326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1106/2183] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:08.590871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3216a-10b3-4458-93cb-ee368d954efe None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:08.595359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c0d3216a-10b3-4458-93cb-ee368d954efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:08.618303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3216a-10b3-4458-93cb-ee368d954efe None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:08.624684 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:08.625563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:08.625912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:08.626879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] PATH_INFO: `/v3/projects/67eb307a9e964ffc8623c2794aac4980` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:08.638520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67eb307a9e964ffc8623c2794aac4980)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:08.641122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:08.875620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67eb307a9e964ffc8623c2794aac4980', 'request_id': 'req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:08.875620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67eb307a9e964ffc8623c2794aac4980', 'request_id': 'req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:08.888163 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67eb307a9e964ffc8623c2794aac4980', 'request_id': 'req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:09.002205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] The token cache is being invalidate because project 67eb307a9e964ffc8623c2794aac4980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:19:09.002488 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:09.003864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ccff568f-f83e-4ccb-ae5c-6a50a39a3154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:09.005452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1078/2184] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:19:08 2022] DELETE /identity/v3/projects/67eb307a9e964ffc8623c2794aac4980 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:09.010429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36c2b1-b2aa-4808-8c03-09036cfcf086 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:09.010927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36c2b1-b2aa-4808-8c03-09036cfcf086 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:09.011304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36c2b1-b2aa-4808-8c03-09036cfcf086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:09.032070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ed36c2b1-b2aa-4808-8c03-09036cfcf086 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:09.033307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ed36c2b1-b2aa-4808-8c03-09036cfcf086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:09.101915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1107/2185] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:09.110277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d66c-d7cb-4454-b466-42751a162b7e None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:09.110564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d66c-d7cb-4454-b466-42751a162b7e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:09.110860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d66c-d7cb-4454-b466-42751a162b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:09.127950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:09.144156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-6337d66c-d7cb-4454-b466-42751a162b7e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:09.145836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6337d66c-d7cb-4454-b466-42751a162b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:09.155980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1079/2186] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:19:09.160413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36c2b1-b2aa-4808-8c03-09036cfcf086 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:09.174845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36c2b1-b2aa-4808-8c03-09036cfcf086 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:09.180503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9fbda-e371-402a-a75a-d76c3f6fb2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:09.191248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9fbda-e371-402a-a75a-d76c3f6fb2bd admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:09.191782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9fbda-e371-402a-a75a-d76c3f6fb2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:09.192060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9fbda-e371-402a-a75a-d76c3f6fb2bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:09.192732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9fbda-e371-402a-a75a-d76c3f6fb2bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:19:09.193203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9fbda-e371-402a-a75a-d76c3f6fb2bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:09.194872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9fbda-e371-402a-a75a-d76c3f6fb2bd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:09.208421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1108/2187] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:19:09.213001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d66c-d7cb-4454-b466-42751a162b7e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:09.223306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d66c-d7cb-4454-b466-42751a162b7e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:09.228736 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaa428-c4fc-4ae3-9ee2-5992a918c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:09.230199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa428-c4fc-4ae3-9ee2-5992a918c56c admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:09.230199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa428-c4fc-4ae3-9ee2-5992a918c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:09.232634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaa428-c4fc-4ae3-9ee2-5992a918c56c admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:09.233756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaa428-c4fc-4ae3-9ee2-5992a918c56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:09.236078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaa428-c4fc-4ae3-9ee2-5992a918c56c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:09.319432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1080/2188] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:19:09 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:19:09.324790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9fbda-e371-402a-a75a-d76c3f6fb2bd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:09.334960 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9fbda-e371-402a-a75a-d76c3f6fb2bd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:09.399442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84344-14fb-46d6-ba99-802fdf7652d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:09.400097 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84344-14fb-46d6-ba99-802fdf7652d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:09.400376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84344-14fb-46d6-ba99-802fdf7652d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:09.400812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84344-14fb-46d6-ba99-802fdf7652d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:09.401455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d84344-14fb-46d6-ba99-802fdf7652d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:09.403445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d84344-14fb-46d6-ba99-802fdf7652d3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:09.530708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1109/2189] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:19:09 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:19:09.533522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaa428-c4fc-4ae3-9ee2-5992a918c56c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:09.545080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaa428-c4fc-4ae3-9ee2-5992a918c56c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:09.550405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb62b4-18d7-48c1-97c3-320f413fc905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:09.550992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb62b4-18d7-48c1-97c3-320f413fc905 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:09.551273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb62b4-18d7-48c1-97c3-320f413fc905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:09.551545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb62b4-18d7-48c1-97c3-320f413fc905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:09.552199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb62b4-18d7-48c1-97c3-320f413fc905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:09.553856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb62b4-18d7-48c1-97c3-320f413fc905 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:09.568210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1081/2190] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:19:09.569414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84344-14fb-46d6-ba99-802fdf7652d3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:09.580122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84344-14fb-46d6-ba99-802fdf7652d3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:09.584965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34187377-74c0-421f-8033-87fef2a36a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:09.585577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34187377-74c0-421f-8033-87fef2a36a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:09.585879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34187377-74c0-421f-8033-87fef2a36a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:09.586154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34187377-74c0-421f-8033-87fef2a36a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:09.586853 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34187377-74c0-421f-8033-87fef2a36a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:09.588652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34187377-74c0-421f-8033-87fef2a36a82 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:09.608378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1110/2191] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:19:09.609639 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb62b4-18d7-48c1-97c3-320f413fc905 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:09.623168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb62b4-18d7-48c1-97c3-320f413fc905 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:09.635941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c516a3-fe17-4c3c-8dc1-8cae12742ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:09.636827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c516a3-fe17-4c3c-8dc1-8cae12742ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:09.637191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c516a3-fe17-4c3c-8dc1-8cae12742ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:09.637531 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c516a3-fe17-4c3c-8dc1-8cae12742ed2 admin admin] PATH_INFO: `/v3/projects/c60c0bd816b5438caf1bca0a7f583efd/users/54cbb04918544f85a7719c31b44c40ab/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:09.660778 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c516a3-fe17-4c3c-8dc1-8cae12742ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60c0bd816b5438caf1bca0a7f583efd, user_id=54cbb04918544f85a7719c31b44c40ab, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:09.664222 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c516a3-fe17-4c3c-8dc1-8cae12742ed2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:09.772905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1082/2192] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:19:09 2022] PUT /identity/v3/projects/c60c0bd816b5438caf1bca0a7f583efd/users/54cbb04918544f85a7719c31b44c40ab/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:09.775461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eba3b3-acc1-4d1b-8782-17690219fefb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:09.775885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eba3b3-acc1-4d1b-8782-17690219fefb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:09.776381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eba3b3-acc1-4d1b-8782-17690219fefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:09.820392 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-81eba3b3-acc1-4d1b-8782-17690219fefb None None] MFA Rules not processed for user `54cbb04918544f85a7719c31b44c40ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:09.821554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-81eba3b3-acc1-4d1b-8782-17690219fefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:09.947284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:09.963586 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1111/2193] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:09.980258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c516a3-fe17-4c3c-8dc1-8cae12742ed2 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:09.984372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a6c516a3-fe17-4c3c-8dc1-8cae12742ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:10.080854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c516a3-fe17-4c3c-8dc1-8cae12742ed2 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:10.085593 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e197c-a728-4b72-afe8-7ef2886c55e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:10.086272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e197c-a728-4b72-afe8-7ef2886c55e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:10.086555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e197c-a728-4b72-afe8-7ef2886c55e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:10.086861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e197c-a728-4b72-afe8-7ef2886c55e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:10.099608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e197c-a728-4b72-afe8-7ef2886c55e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:10.101323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e197c-a728-4b72-afe8-7ef2886c55e1 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:10.112953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1083/2194] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:10.189393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:11.560823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:11.640477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:12.158094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:12.684796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:12.781587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:12.968081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:13.156307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:13.311453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:13.407461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:14.127534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:14.408320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:14.944876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:14.996754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:15.213365 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:15.311259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:15.333450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:15.562162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:15.623662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:15.865575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:15.918590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:16.225230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:16.268522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:16.823828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:16.858613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:17.057539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:17.297379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:17.538991 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:18.350085 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:18.408004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:18.436679 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eba3b3-acc1-4d1b-8782-17690219fefb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:18.438744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-81eba3b3-acc1-4d1b-8782-17690219fefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:18.507272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eba3b3-acc1-4d1b-8782-17690219fefb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:18.511902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:18.512536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:18.512843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:18.513716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] PATH_INFO: `/v3/users/1cf778a14d2c43489617f84125a18b74` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:18.514945 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf778a14d2c43489617f84125a18b74)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:18.516905 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:18.636612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:18.696415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf778a14d2c43489617f84125a18b74'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:18.697018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf778a14d2c43489617f84125a18b74'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:18.798287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf778a14d2c43489617f84125a18b74'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:18.798287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf778a14d2c43489617f84125a18b74'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:18.804166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf778a14d2c43489617f84125a18b74'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:18.824637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1112/2195] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:19:18 2022] DELETE /identity/v3/users/1cf778a14d2c43489617f84125a18b74 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:18.829111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92467e42-fe20-405d-ac4e-2203447c54aa None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:18.829498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92467e42-fe20-405d-ac4e-2203447c54aa None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:18.830033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92467e42-fe20-405d-ac4e-2203447c54aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:18.850956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:18.859239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-92467e42-fe20-405d-ac4e-2203447c54aa None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:18.860467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-92467e42-fe20-405d-ac4e-2203447c54aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:18.920355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1084/2196] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:18.933958 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:18.935957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:18.944895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:19.006617 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721a02-e89c-4afc-90f4-d98b9915dfeb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:19.010586 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6011a-d2a5-4192-b9f4-dd09ed4876e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:19.011225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6011a-d2a5-4192-b9f4-dd09ed4876e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:19.011499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6011a-d2a5-4192-b9f4-dd09ed4876e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:19.011766 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6011a-d2a5-4192-b9f4-dd09ed4876e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:19.021007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6011a-d2a5-4192-b9f4-dd09ed4876e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:19.022466 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6011a-d2a5-4192-b9f4-dd09ed4876e2 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:19.033472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1113/2197] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:19.462420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92467e42-fe20-405d-ac4e-2203447c54aa None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:19.467433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-92467e42-fe20-405d-ac4e-2203447c54aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:19.478951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92467e42-fe20-405d-ac4e-2203447c54aa None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:19.484516 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:19.485142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:19.485441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:19.485883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] PATH_INFO: `/v3/projects/e54fa4d5170e4ca3a7832a989b73daf8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:19.487224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54fa4d5170e4ca3a7832a989b73daf8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:19.489356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:19.616019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54fa4d5170e4ca3a7832a989b73daf8', 'request_id': 'req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:19.623991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54fa4d5170e4ca3a7832a989b73daf8', 'request_id': 'req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:19.631870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54fa4d5170e4ca3a7832a989b73daf8', 'request_id': 'req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:19.698632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] The token cache is being invalidate because project e54fa4d5170e4ca3a7832a989b73daf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:19:19.699005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:19.703914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7a1351fb-dfde-4118-a6f5-49cfbbf98f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:19.703914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1085/2198] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:19:19 2022] DELETE /identity/v3/projects/e54fa4d5170e4ca3a7832a989b73daf8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:19.707563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b21d8-b18e-4095-abe7-512b3280316e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:19.708109 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b21d8-b18e-4095-abe7-512b3280316e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:19.708364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b21d8-b18e-4095-abe7-512b3280316e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:19.727536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:19.732238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3d9b21d8-b18e-4095-abe7-512b3280316e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:19.733615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3d9b21d8-b18e-4095-abe7-512b3280316e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:19.790777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:19.807762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1114/2199] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:19.815947 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea99ae1-6f7c-45f5-930c-e5851e246380 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:19.816234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea99ae1-6f7c-45f5-930c-e5851e246380 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:19.816509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea99ae1-6f7c-45f5-930c-e5851e246380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:19.836506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0ea99ae1-6f7c-45f5-930c-e5851e246380 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:19.837733 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0ea99ae1-6f7c-45f5-930c-e5851e246380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:19.859375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1086/2200] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:19.861749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b21d8-b18e-4095-abe7-512b3280316e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:19.871819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b21d8-b18e-4095-abe7-512b3280316e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:19.876968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c6a1e-df8e-42e9-9f93-e4a4b2dc6a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:19.877564 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c6a1e-df8e-42e9-9f93-e4a4b2dc6a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:19.877835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c6a1e-df8e-42e9-9f93-e4a4b2dc6a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:19.878098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c6a1e-df8e-42e9-9f93-e4a4b2dc6a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:19.878764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c6a1e-df8e-42e9-9f93-e4a4b2dc6a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:19:19.879061 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c6a1e-df8e-42e9-9f93-e4a4b2dc6a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:19.880642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c6a1e-df8e-42e9-9f93-e4a4b2dc6a26 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:19.893678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1115/2201] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:19:19.902194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea99ae1-6f7c-45f5-930c-e5851e246380 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:19.912005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea99ae1-6f7c-45f5-930c-e5851e246380 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:19.917231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e002d85-a7c6-41a0-8938-400b3e235311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:19.917836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e002d85-a7c6-41a0-8938-400b3e235311 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:19.918114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e002d85-a7c6-41a0-8938-400b3e235311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:19.918386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e002d85-a7c6-41a0-8938-400b3e235311 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:19.919056 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e002d85-a7c6-41a0-8938-400b3e235311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:19.920995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e002d85-a7c6-41a0-8938-400b3e235311 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:20.050730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1087/2202] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:19:19 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:19:20.051890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c6a1e-df8e-42e9-9f93-e4a4b2dc6a26 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:20.063070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c6a1e-df8e-42e9-9f93-e4a4b2dc6a26 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:20.122973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4f1fe-7954-49f3-a352-6c337892631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:20.123437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4f1fe-7954-49f3-a352-6c337892631d admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:20.123876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4f1fe-7954-49f3-a352-6c337892631d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:20.124154 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4f1fe-7954-49f3-a352-6c337892631d admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:20.124796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4f1fe-7954-49f3-a352-6c337892631d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:20.127136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4f1fe-7954-49f3-a352-6c337892631d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:20.248328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1116/2203] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:19:20 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:19:20.253138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e002d85-a7c6-41a0-8938-400b3e235311 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:20.264866 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e002d85-a7c6-41a0-8938-400b3e235311 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:20.269551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14af9a-1396-4cd7-8087-92d88be1b2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:20.270156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14af9a-1396-4cd7-8087-92d88be1b2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:20.270436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14af9a-1396-4cd7-8087-92d88be1b2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:20.270738 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14af9a-1396-4cd7-8087-92d88be1b2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:20.271382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14af9a-1396-4cd7-8087-92d88be1b2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:20.272982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14af9a-1396-4cd7-8087-92d88be1b2c0 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:20.283049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1088/2204] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:19:20.287260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4f1fe-7954-49f3-a352-6c337892631d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:20.298998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4f1fe-7954-49f3-a352-6c337892631d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:20.305020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97a5b6-e6b4-4900-89ed-2cec82fff299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:20.305889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97a5b6-e6b4-4900-89ed-2cec82fff299 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:20.306181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97a5b6-e6b4-4900-89ed-2cec82fff299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:20.306475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97a5b6-e6b4-4900-89ed-2cec82fff299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:20.307440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97a5b6-e6b4-4900-89ed-2cec82fff299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:20.309107 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97a5b6-e6b4-4900-89ed-2cec82fff299 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:20.323280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1117/2205] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:19:20.328254 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14af9a-1396-4cd7-8087-92d88be1b2c0 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:20.349570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14af9a-1396-4cd7-8087-92d88be1b2c0 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:20.354891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e90920-ea85-4cad-b066-c00d8408afe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:20.355754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e90920-ea85-4cad-b066-c00d8408afe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:20.356362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e90920-ea85-4cad-b066-c00d8408afe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:20.357193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e90920-ea85-4cad-b066-c00d8408afe4 admin admin] PATH_INFO: `/v3/projects/717b152a720d4d5f9fc97c9099759987/users/aab9f30d59f1417184e6fa5bfb1c2bb1/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:20.375400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e90920-ea85-4cad-b066-c00d8408afe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717b152a720d4d5f9fc97c9099759987, user_id=aab9f30d59f1417184e6fa5bfb1c2bb1, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:20.379616 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e90920-ea85-4cad-b066-c00d8408afe4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:20.463128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1089/2206] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:19:20 2022] PUT /identity/v3/projects/717b152a720d4d5f9fc97c9099759987/users/aab9f30d59f1417184e6fa5bfb1c2bb1/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:20.473721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68c26-b93d-486a-bb78-f6d331044c74 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:20.474086 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68c26-b93d-486a-bb78-f6d331044c74 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:20.474283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68c26-b93d-486a-bb78-f6d331044c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:20.508220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-87c68c26-b93d-486a-bb78-f6d331044c74 None None] MFA Rules not processed for user `aab9f30d59f1417184e6fa5bfb1c2bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:20.508220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-87c68c26-b93d-486a-bb78-f6d331044c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:20.594030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1118/2207] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:20.606089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e90920-ea85-4cad-b066-c00d8408afe4 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:20.608135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-53e90920-ea85-4cad-b066-c00d8408afe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:20.659081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:20.668754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e90920-ea85-4cad-b066-c00d8408afe4 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:20.672416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fc05d-917e-4da3-860f-a0ec4a816715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:20.673021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc05d-917e-4da3-860f-a0ec4a816715 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:20.673299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc05d-917e-4da3-860f-a0ec4a816715 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:20.673564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc05d-917e-4da3-860f-a0ec4a816715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:20.685266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fc05d-917e-4da3-860f-a0ec4a816715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:20.686391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:20.686841 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fc05d-917e-4da3-860f-a0ec4a816715 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:20.696962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1090/2208] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:21.253330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:21.675603 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:22.344553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:22.378979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:22.778818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:22.864551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:23.384596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:23.503002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:23.824262 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:23.927628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:24.087333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:24.337496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:24.790223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:25.035834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:25.212827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:25.226090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c68c26-b93d-486a-bb78-f6d331044c74 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:25.227605 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-87c68c26-b93d-486a-bb78-f6d331044c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:25.296482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c68c26-b93d-486a-bb78-f6d331044c74 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:25.301052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:25.305703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:25.305703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:25.305703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] PATH_INFO: `/v3/users/54cbb04918544f85a7719c31b44c40ab` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:25.305703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54cbb04918544f85a7719c31b44c40ab)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:25.305703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:25.473895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54cbb04918544f85a7719c31b44c40ab'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:25.474821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54cbb04918544f85a7719c31b44c40ab'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:25.556072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54cbb04918544f85a7719c31b44c40ab'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:25.556773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54cbb04918544f85a7719c31b44c40ab'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:25.568631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54cbb04918544f85a7719c31b44c40ab'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:25.593953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1119/2209] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:19:25 2022] DELETE /identity/v3/users/54cbb04918544f85a7719c31b44c40ab => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:25.595600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2279ff-1891-48f6-8d85-fc1f01c2e749 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:25.595972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2279ff-1891-48f6-8d85-fc1f01c2e749 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:25.596214 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2279ff-1891-48f6-8d85-fc1f01c2e749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:25.622845 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-7b2279ff-1891-48f6-8d85-fc1f01c2e749 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:25.625001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7b2279ff-1891-48f6-8d85-fc1f01c2e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:25.721776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1091/2210] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:25.739879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:25.741859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:25.757699 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:25.811995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e49f0-94c9-4fac-8311-ac314485bc26 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:25.816035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3df37a-eedd-4b5e-b04f-15070954a805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:25.816673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3df37a-eedd-4b5e-b04f-15070954a805 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:25.816911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3df37a-eedd-4b5e-b04f-15070954a805 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:25.817182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3df37a-eedd-4b5e-b04f-15070954a805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:25.827756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3df37a-eedd-4b5e-b04f-15070954a805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:25.829274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3df37a-eedd-4b5e-b04f-15070954a805 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:25.839334 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1120/2211] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:25.878374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2279ff-1891-48f6-8d85-fc1f01c2e749 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:25.880987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7b2279ff-1891-48f6-8d85-fc1f01c2e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:25.892618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2279ff-1891-48f6-8d85-fc1f01c2e749 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:25.897473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836884d3-11ac-45a3-909c-ba19d7100879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:25.898108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836884d3-11ac-45a3-909c-ba19d7100879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:25.898449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836884d3-11ac-45a3-909c-ba19d7100879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:25.898762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836884d3-11ac-45a3-909c-ba19d7100879 admin admin] PATH_INFO: `/v3/users/aab9f30d59f1417184e6fa5bfb1c2bb1` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:25.899913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836884d3-11ac-45a3-909c-ba19d7100879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab9f30d59f1417184e6fa5bfb1c2bb1)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:25.901907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836884d3-11ac-45a3-909c-ba19d7100879 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:26.209994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-836884d3-11ac-45a3-909c-ba19d7100879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab9f30d59f1417184e6fa5bfb1c2bb1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:26.210649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-836884d3-11ac-45a3-909c-ba19d7100879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab9f30d59f1417184e6fa5bfb1c2bb1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:26.265989 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3df37a-eedd-4b5e-b04f-15070954a805 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:26.267513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6d3df37a-eedd-4b5e-b04f-15070954a805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:26.280707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3df37a-eedd-4b5e-b04f-15070954a805 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:26.281546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-836884d3-11ac-45a3-909c-ba19d7100879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab9f30d59f1417184e6fa5bfb1c2bb1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:26.284838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-836884d3-11ac-45a3-909c-ba19d7100879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab9f30d59f1417184e6fa5bfb1c2bb1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:26.286736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:26.287370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:26.288360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:26.288360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] PATH_INFO: `/v3/projects/c60c0bd816b5438caf1bca0a7f583efd` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:26.289582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60c0bd816b5438caf1bca0a7f583efd)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:26.291667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:26.292052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-836884d3-11ac-45a3-909c-ba19d7100879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab9f30d59f1417184e6fa5bfb1c2bb1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:26.314717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1092/2212] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:19:25 2022] DELETE /identity/v3/users/aab9f30d59f1417184e6fa5bfb1c2bb1 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:26.319171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e701-ce32-4b36-a82f-5ee886e2e517 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:26.319465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e701-ce32-4b36-a82f-5ee886e2e517 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:26.319744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e701-ce32-4b36-a82f-5ee886e2e517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:26.338381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-7a46e701-ce32-4b36-a82f-5ee886e2e517 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:26.339621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7a46e701-ce32-4b36-a82f-5ee886e2e517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:26.385674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60c0bd816b5438caf1bca0a7f583efd', 'request_id': 'req-02de1f48-ae2d-4053-8fc4-ea983707cbc2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:26.391530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60c0bd816b5438caf1bca0a7f583efd', 'request_id': 'req-02de1f48-ae2d-4053-8fc4-ea983707cbc2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:26.398012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60c0bd816b5438caf1bca0a7f583efd', 'request_id': 'req-02de1f48-ae2d-4053-8fc4-ea983707cbc2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:26.399162 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1093/2213] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:19:26.411772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46e701-ce32-4b36-a82f-5ee886e2e517 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:26.413442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7a46e701-ce32-4b36-a82f-5ee886e2e517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:26.430353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:26.446311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] The token cache is being invalidate because project c60c0bd816b5438caf1bca0a7f583efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:19:26.447760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:26.447760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:26.448977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1121/2214] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:19:26 2022] DELETE /identity/v3/projects/c60c0bd816b5438caf1bca0a7f583efd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:19:26.477166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46e701-ce32-4b36-a82f-5ee886e2e517 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:26.531102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041151b-df08-4c38-990a-69111df2f56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:26.531639 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041151b-df08-4c38-990a-69111df2f56c service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:26.531929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041151b-df08-4c38-990a-69111df2f56c service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:26.532185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041151b-df08-4c38-990a-69111df2f56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:26.534043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1041151b-df08-4c38-990a-69111df2f56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:26.608565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041151b-df08-4c38-990a-69111df2f56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:26.610389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041151b-df08-4c38-990a-69111df2f56c service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:26.622853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1094/2215] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:27.196950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:27.198459 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:27.215039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de1f48-ae2d-4053-8fc4-ea983707cbc2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:27.220624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:27.221405 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:27.221765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:27.221947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] PATH_INFO: `/v3/projects/717b152a720d4d5f9fc97c9099759987` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:27.223190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=717b152a720d4d5f9fc97c9099759987)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:27.225077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:27.363751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717b152a720d4d5f9fc97c9099759987', 'request_id': 'req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:27.378310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717b152a720d4d5f9fc97c9099759987', 'request_id': 'req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:27.385044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717b152a720d4d5f9fc97c9099759987', 'request_id': 'req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:27.469134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] The token cache is being invalidate because project 717b152a720d4d5f9fc97c9099759987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:19:27.469494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:27.470145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-79d8be72-692a-4d93-bcf2-e8ceaad8d28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:27.471647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1122/2216] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:19:27 2022] DELETE /identity/v3/projects/717b152a720d4d5f9fc97c9099759987 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:36.340155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041151b-df08-4c38-990a-69111df2f56c service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:36.342296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1041151b-df08-4c38-990a-69111df2f56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:36.354173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041151b-df08-4c38-990a-69111df2f56c service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:36.426591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:36.427386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:36.427607 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:36.427880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] PATH_INFO: `/v3/users/61c5fea9761d4cc69f33e5b3259a08f4` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:36.429024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c5fea9761d4cc69f33e5b3259a08f4)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:36.431017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:36.455050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:36.587204 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c5fea9761d4cc69f33e5b3259a08f4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:36.587853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c5fea9761d4cc69f33e5b3259a08f4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:36.679362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c5fea9761d4cc69f33e5b3259a08f4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:36.679925 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c5fea9761d4cc69f33e5b3259a08f4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:36.687276 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c5fea9761d4cc69f33e5b3259a08f4'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:36.704930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1095/2217] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:19:36 2022] DELETE /identity/v3/users/61c5fea9761d4cc69f33e5b3259a08f4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:36.709328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8204bcc-0e27-4354-bbd0-c7ffb969bebd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:36.709782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8204bcc-0e27-4354-bbd0-c7ffb969bebd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:36.709891 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8204bcc-0e27-4354-bbd0-c7ffb969bebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:36.729114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d8204bcc-0e27-4354-bbd0-c7ffb969bebd None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:36.730303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d8204bcc-0e27-4354-bbd0-c7ffb969bebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:36.747124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:36.789037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1123/2218] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:36.799037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:36.800445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:36.856797 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6c659-c7ff-41e2-b3db-285a4df0da37 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:36.860400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a6125-faa5-4659-aa5c-418d37a23cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:36.860995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6125-faa5-4659-aa5c-418d37a23cef service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:36.861291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6125-faa5-4659-aa5c-418d37a23cef service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:36.861557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6125-faa5-4659-aa5c-418d37a23cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:36.870395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a6125-faa5-4659-aa5c-418d37a23cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:36.871890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a6125-faa5-4659-aa5c-418d37a23cef service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:36.881396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1096/2219] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:37.252200 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8204bcc-0e27-4354-bbd0-c7ffb969bebd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:37.253638 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d8204bcc-0e27-4354-bbd0-c7ffb969bebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:37.267914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8204bcc-0e27-4354-bbd0-c7ffb969bebd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:37.272751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:37.273387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:37.273670 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:37.273941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] PATH_INFO: `/v3/projects/daf538e298ce4bb1ba4d5a4ce45fbb5e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:37.275116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf538e298ce4bb1ba4d5a4ce45fbb5e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:37.277074 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:37.394972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf538e298ce4bb1ba4d5a4ce45fbb5e', 'request_id': 'req-98abaa76-bb30-433d-9960-09e542777151'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:37.400464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf538e298ce4bb1ba4d5a4ce45fbb5e', 'request_id': 'req-98abaa76-bb30-433d-9960-09e542777151'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:37.406713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf538e298ce4bb1ba4d5a4ce45fbb5e', 'request_id': 'req-98abaa76-bb30-433d-9960-09e542777151'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:37.473698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] The token cache is being invalidate because project daf538e298ce4bb1ba4d5a4ce45fbb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:19:37.474000 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:37.474610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-98abaa76-bb30-433d-9960-09e542777151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:37.476135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1124/2220] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:19:37 2022] DELETE /identity/v3/projects/daf538e298ce4bb1ba4d5a4ce45fbb5e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:37.481019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5d1c8-afe1-4f6c-9f0f-1d5cc1830958 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:37.483503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5d1c8-afe1-4f6c-9f0f-1d5cc1830958 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:37.483503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5d1c8-afe1-4f6c-9f0f-1d5cc1830958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:37.501459 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-cdd5d1c8-afe1-4f6c-9f0f-1d5cc1830958 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:37.502585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-cdd5d1c8-afe1-4f6c-9f0f-1d5cc1830958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:37.566216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1097/2221] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:37.574439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15b3f-60a9-414e-a31b-89772fa4b763 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:37.574755 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15b3f-60a9-414e-a31b-89772fa4b763 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:37.575037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15b3f-60a9-414e-a31b-89772fa4b763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:37.577219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a6152-6a1e-4dbf-b124-8407d732b3f0 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:37.577500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a6152-6a1e-4dbf-b124-8407d732b3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:37.577767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a6152-6a1e-4dbf-b124-8407d732b3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:37.596303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6dd15b3f-60a9-414e-a31b-89772fa4b763 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:37.597098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-086a6152-6a1e-4dbf-b124-8407d732b3f0 None None] MFA Rules not processed for user `3252bd3cb18b4a2fa47b2d7b15b436b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:37.597523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6dd15b3f-60a9-414e-a31b-89772fa4b763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:37.598265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-086a6152-6a1e-4dbf-b124-8407d732b3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:37.605678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1125/2222] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:37.609842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15b3f-60a9-414e-a31b-89772fa4b763 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:37.619026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15b3f-60a9-414e-a31b-89772fa4b763 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:37.623768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b333-ecc8-4eac-8c41-f2429c3e25f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:37.624341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b333-ecc8-4eac-8c41-f2429c3e25f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:37.624618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b333-ecc8-4eac-8c41-f2429c3e25f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:37.624885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b333-ecc8-4eac-8c41-f2429c3e25f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:37.625512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4b333-ecc8-4eac-8c41-f2429c3e25f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:19:37.625809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4b333-ecc8-4eac-8c41-f2429c3e25f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:37.627430 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4b333-ecc8-4eac-8c41-f2429c3e25f2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:37.635537 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:37.643447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1126/2223] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:19:37.644516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b333-ecc8-4eac-8c41-f2429c3e25f2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:37.652533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1098/2224] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:19:37.656437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b333-ecc8-4eac-8c41-f2429c3e25f2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:37.661127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4806-7548-4202-9c23-d0ab5c9d8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:37.661814 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4806-7548-4202-9c23-d0ab5c9d8198 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:37.662090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4806-7548-4202-9c23-d0ab5c9d8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:37.662358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4806-7548-4202-9c23-d0ab5c9d8198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:37.663022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d4806-7548-4202-9c23-d0ab5c9d8198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:37.665177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d4806-7548-4202-9c23-d0ab5c9d8198 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:37.768563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1127/2225] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:19:37 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:19:37.772732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a6152-6a1e-4dbf-b124-8407d732b3f0 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:37.784424 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a6152-6a1e-4dbf-b124-8407d732b3f0 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:37.841396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251096d-90ad-42c1-b9d7-b87b17a79cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:37.842528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251096d-90ad-42c1-b9d7-b87b17a79cef admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:37.842907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251096d-90ad-42c1-b9d7-b87b17a79cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:37.843179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251096d-90ad-42c1-b9d7-b87b17a79cef admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:37.843842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251096d-90ad-42c1-b9d7-b87b17a79cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:37.855299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251096d-90ad-42c1-b9d7-b87b17a79cef admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:37.944115 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1099/2226] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:19:37 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:19:37.948214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4806-7548-4202-9c23-d0ab5c9d8198 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:37.959292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4806-7548-4202-9c23-d0ab5c9d8198 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:37.964066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1619b-74e9-4809-af10-e582d3ec5724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:37.964670 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1619b-74e9-4809-af10-e582d3ec5724 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:37.964982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1619b-74e9-4809-af10-e582d3ec5724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:37.965292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1619b-74e9-4809-af10-e582d3ec5724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:37.965912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1619b-74e9-4809-af10-e582d3ec5724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:37.967555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1619b-74e9-4809-af10-e582d3ec5724 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:37.980544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1128/2227] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:19:37.981780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251096d-90ad-42c1-b9d7-b87b17a79cef admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:37.992174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251096d-90ad-42c1-b9d7-b87b17a79cef admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:37.997080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b1f86-990a-41bb-bbb6-a4a97913a26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:37.998305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b1f86-990a-41bb-bbb6-a4a97913a26b admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:37.998586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b1f86-990a-41bb-bbb6-a4a97913a26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:37.998899 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b1f86-990a-41bb-bbb6-a4a97913a26b admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:37.999547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b1f86-990a-41bb-bbb6-a4a97913a26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:38.001144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b1f86-990a-41bb-bbb6-a4a97913a26b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:38.011268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1100/2228] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:19:38.015988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1619b-74e9-4809-af10-e582d3ec5724 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:38.026305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1619b-74e9-4809-af10-e582d3ec5724 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:38.031030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac6627-ff99-4437-8613-2b357aa94321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:38.031690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac6627-ff99-4437-8613-2b357aa94321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:38.031954 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac6627-ff99-4437-8613-2b357aa94321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:38.032224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac6627-ff99-4437-8613-2b357aa94321 admin admin] PATH_INFO: `/v3/projects/9144eccb89a6446399fa75192dfbe63a/users/851bc101b85941b484ff84a70e52acc1/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:38.046927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac6627-ff99-4437-8613-2b357aa94321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9144eccb89a6446399fa75192dfbe63a, user_id=851bc101b85941b484ff84a70e52acc1, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:38.049602 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac6627-ff99-4437-8613-2b357aa94321 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:38.120748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1129/2229] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:19:38 2022] PUT /identity/v3/projects/9144eccb89a6446399fa75192dfbe63a/users/851bc101b85941b484ff84a70e52acc1/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:38.132454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02689dd3-aceb-41a3-9f32-831b9b3c7cde None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:38.132755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02689dd3-aceb-41a3-9f32-831b9b3c7cde None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:38.133031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02689dd3-aceb-41a3-9f32-831b9b3c7cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:38.161938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-02689dd3-aceb-41a3-9f32-831b9b3c7cde None None] MFA Rules not processed for user `851bc101b85941b484ff84a70e52acc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:38.163854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-02689dd3-aceb-41a3-9f32-831b9b3c7cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:38.238830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1101/2230] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:38.248635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac6627-ff99-4437-8613-2b357aa94321 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:38.250561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d6ac6627-ff99-4437-8613-2b357aa94321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:38.298060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:38.327305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac6627-ff99-4437-8613-2b357aa94321 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:38.331346 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de5968-657b-47a2-905a-e540a6b95ef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:38.335328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de5968-657b-47a2-905a-e540a6b95ef3 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:38.335328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de5968-657b-47a2-905a-e540a6b95ef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:38.335328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de5968-657b-47a2-905a-e540a6b95ef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:38.343152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de5968-657b-47a2-905a-e540a6b95ef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:38.344628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de5968-657b-47a2-905a-e540a6b95ef3 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:38.355695 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1130/2231] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:48.232391 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:48.422796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=13 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:49.984125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02689dd3-aceb-41a3-9f32-831b9b3c7cde None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:50.045659 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02689dd3-aceb-41a3-9f32-831b9b3c7cde None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:50.050338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:50.051017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:50.051267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:50.051542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] PATH_INFO: `/v3/users/851bc101b85941b484ff84a70e52acc1` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:50.052717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] RBAC: Authorizing `identity:delete_user(user_id=851bc101b85941b484ff84a70e52acc1)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:50.054581 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:50.243705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851bc101b85941b484ff84a70e52acc1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:50.244360 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851bc101b85941b484ff84a70e52acc1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:50.320038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851bc101b85941b484ff84a70e52acc1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:50.320686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851bc101b85941b484ff84a70e52acc1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:50.328914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851bc101b85941b484ff84a70e52acc1'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:50.346295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1102/2232] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:19:49 2022] DELETE /identity/v3/users/851bc101b85941b484ff84a70e52acc1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:50.351028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a944-84d3-4bcd-9d78-5f91ee8c5c8d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:50.356796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a944-84d3-4bcd-9d78-5f91ee8c5c8d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:50.356796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a944-84d3-4bcd-9d78-5f91ee8c5c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:50.370205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-43b1a944-84d3-4bcd-9d78-5f91ee8c5c8d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:50.371378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-43b1a944-84d3-4bcd-9d78-5f91ee8c5c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:50.432943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1131/2233] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:50.444275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:50.445777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:50.503187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470a319-ab7e-49fc-bc16-72851116469c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:50.506647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51689291-a0e7-44c8-b8fe-229a79b93fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:50.507275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689291-a0e7-44c8-b8fe-229a79b93fdd service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:50.507549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689291-a0e7-44c8-b8fe-229a79b93fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:50.507816 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51689291-a0e7-44c8-b8fe-229a79b93fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:50.516991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51689291-a0e7-44c8-b8fe-229a79b93fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:50.519990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51689291-a0e7-44c8-b8fe-229a79b93fdd service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:50.528205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1103/2234] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:19:50.927831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a944-84d3-4bcd-9d78-5f91ee8c5c8d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:50.929335 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-43b1a944-84d3-4bcd-9d78-5f91ee8c5c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:50.942122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a944-84d3-4bcd-9d78-5f91ee8c5c8d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:50.947114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:50.947752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:50.948029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:50.948308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] PATH_INFO: `/v3/projects/9144eccb89a6446399fa75192dfbe63a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:50.949451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9144eccb89a6446399fa75192dfbe63a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:50.951413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:51.081208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9144eccb89a6446399fa75192dfbe63a', 'request_id': 'req-d2568ac8-bb21-4d36-8867-60169ef331d9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:51.086645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9144eccb89a6446399fa75192dfbe63a', 'request_id': 'req-d2568ac8-bb21-4d36-8867-60169ef331d9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:51.093442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9144eccb89a6446399fa75192dfbe63a', 'request_id': 'req-d2568ac8-bb21-4d36-8867-60169ef331d9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:51.177168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] The token cache is being invalidate because project 9144eccb89a6446399fa75192dfbe63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:19:51.177468 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:51.178117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:19:51.179656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1132/2235] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:19:50 2022] DELETE /identity/v3/projects/9144eccb89a6446399fa75192dfbe63a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:19:59.325286 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1120a86-6796-4e36-9be1-c56db52649ef None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:59.325682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1120a86-6796-4e36-9be1-c56db52649ef None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:59.325828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1120a86-6796-4e36-9be1-c56db52649ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:59.347128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-e1120a86-6796-4e36-9be1-c56db52649ef None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:19:59.348331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e1120a86-6796-4e36-9be1-c56db52649ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:59.364643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:19:59.407031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1104/2236] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:19:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:19:59.450155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:19:59.451606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:19:59.527836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2568ac8-bb21-4d36-8867-60169ef331d9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:19:59.532983 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f253029-abba-4fd2-8d96-f3f3ddd46cfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:19:59.533589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f253029-abba-4fd2-8d96-f3f3ddd46cfc service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:19:59.533867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f253029-abba-4fd2-8d96-f3f3ddd46cfc service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:19:59.534137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f253029-abba-4fd2-8d96-f3f3ddd46cfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:19:59.542836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f253029-abba-4fd2-8d96-f3f3ddd46cfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:19:59.544428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f253029-abba-4fd2-8d96-f3f3ddd46cfc service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:19:59.553391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1133/2237] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:19:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:20:09.457243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=15 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:20:09.549911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:20:15.967771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f83fd-c645-4266-8fc7-777d80c458ef None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:15.968292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f83fd-c645-4266-8fc7-777d80c458ef None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:15.968292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f83fd-c645-4266-8fc7-777d80c458ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:15.987004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-183f83fd-c645-4266-8fc7-777d80c458ef None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:20:15.988141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-183f83fd-c645-4266-8fc7-777d80c458ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:15.995076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1105/2238] 10.222.0.23 () {58 vars in 967 bytes} [Thu Sep 8 16:20:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:20:16.007544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f253029-abba-4fd2-8d96-f3f3ddd46cfc service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:16.018472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f253029-abba-4fd2-8d96-f3f3ddd46cfc service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:16.023505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42949785-f794-47f3-973e-cb59e5f02852 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:16.024093 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42949785-f794-47f3-973e-cb59e5f02852 service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:16.024371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42949785-f794-47f3-973e-cb59e5f02852 service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:16.024643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42949785-f794-47f3-973e-cb59e5f02852 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:16.033195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42949785-f794-47f3-973e-cb59e5f02852 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:16.034811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42949785-f794-47f3-973e-cb59e5f02852 service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:16.042966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1134/2239] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:20:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 16:20:19.034146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f83fd-c645-4266-8fc7-777d80c458ef None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:19.035637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-183f83fd-c645-4266-8fc7-777d80c458ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:19.113246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f83fd-c645-4266-8fc7-777d80c458ef None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:19.117806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a588321-e827-4ff8-82f8-833493f47cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:19.118410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a588321-e827-4ff8-82f8-833493f47cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:19.118706 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a588321-e827-4ff8-82f8-833493f47cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:19.118981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a588321-e827-4ff8-82f8-833493f47cfc admin admin] PATH_INFO: `/v3/users/3252bd3cb18b4a2fa47b2d7b15b436b6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:19.120129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a588321-e827-4ff8-82f8-833493f47cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3252bd3cb18b4a2fa47b2d7b15b436b6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:19.122096 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a588321-e827-4ff8-82f8-833493f47cfc admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:19.344558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-8a588321-e827-4ff8-82f8-833493f47cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3252bd3cb18b4a2fa47b2d7b15b436b6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:20:19.345218 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-8a588321-e827-4ff8-82f8-833493f47cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3252bd3cb18b4a2fa47b2d7b15b436b6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:20:19.427951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-8a588321-e827-4ff8-82f8-833493f47cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3252bd3cb18b4a2fa47b2d7b15b436b6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:20:19.428565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-8a588321-e827-4ff8-82f8-833493f47cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3252bd3cb18b4a2fa47b2d7b15b436b6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:20:19.436961 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-8a588321-e827-4ff8-82f8-833493f47cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3252bd3cb18b4a2fa47b2d7b15b436b6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:20:19.454480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1106/2240] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:20:19 2022] DELETE /identity/v3/users/3252bd3cb18b4a2fa47b2d7b15b436b6 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:20:19.714221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42949785-f794-47f3-973e-cb59e5f02852 service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:19.731479 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42949785-f794-47f3-973e-cb59e5f02852 service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:19.786974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:19.787608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:19.787916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:19.788458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] PATH_INFO: `/v3/projects/82d52e0b1ddf4735a0e7980d11a1dead` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:19.789571 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82d52e0b1ddf4735a0e7980d11a1dead)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:19.791549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:19.931737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d52e0b1ddf4735a0e7980d11a1dead', 'request_id': 'req-51c918e2-d981-44bd-9c17-131fe0654786'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:20:19.937382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d52e0b1ddf4735a0e7980d11a1dead', 'request_id': 'req-51c918e2-d981-44bd-9c17-131fe0654786'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:20:19.943503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d52e0b1ddf4735a0e7980d11a1dead', 'request_id': 'req-51c918e2-d981-44bd-9c17-131fe0654786'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:20:20.021235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] The token cache is being invalidate because project 82d52e0b1ddf4735a0e7980d11a1dead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:20:20.021454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:20:20.022069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51c918e2-d981-44bd-9c17-131fe0654786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:20:20.023611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1135/2241] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:20:19 2022] DELETE /identity/v3/projects/82d52e0b1ddf4735a0e7980d11a1dead => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:20:20.028938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093b1db-2e4c-4666-b86d-7df848004fdf None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:20.032202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093b1db-2e4c-4666-b86d-7df848004fdf None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:20.032202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093b1db-2e4c-4666-b86d-7df848004fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:20.050256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-9093b1db-2e4c-4666-b86d-7df848004fdf None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:20:20.051554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9093b1db-2e4c-4666-b86d-7df848004fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:20.114171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1107/2242] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:20:20.121948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfec63-9f23-4af6-8717-bda3eff05574 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:20.122246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfec63-9f23-4af6-8717-bda3eff05574 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:20.122518 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfec63-9f23-4af6-8717-bda3eff05574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:20.144085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e1dfec63-9f23-4af6-8717-bda3eff05574 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:20:20.145291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e1dfec63-9f23-4af6-8717-bda3eff05574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:20.153157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1136/2243] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:20:20.157380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093b1db-2e4c-4666-b86d-7df848004fdf None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:20.167337 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093b1db-2e4c-4666-b86d-7df848004fdf None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:20.172431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0f6c2-8392-4db9-9412-66891bea2f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:20.173022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f6c2-8392-4db9-9412-66891bea2f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:20.173294 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f6c2-8392-4db9-9412-66891bea2f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:20.173564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f6c2-8392-4db9-9412-66891bea2f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:20.174232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0f6c2-8392-4db9-9412-66891bea2f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:20:20.174533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0f6c2-8392-4db9-9412-66891bea2f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:20.176167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0f6c2-8392-4db9-9412-66891bea2f89 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:20.184544 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:20:20.188273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1108/2244] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:20:20.192475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfec63-9f23-4af6-8717-bda3eff05574 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:20.201958 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfec63-9f23-4af6-8717-bda3eff05574 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:20.206805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90578c6-f00f-4357-9fa9-9dee6b02f0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:20.207393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90578c6-f00f-4357-9fa9-9dee6b02f0fe admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:20.207673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90578c6-f00f-4357-9fa9-9dee6b02f0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:20.207949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90578c6-f00f-4357-9fa9-9dee6b02f0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:20.208567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90578c6-f00f-4357-9fa9-9dee6b02f0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:20.210461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90578c6-f00f-4357-9fa9-9dee6b02f0fe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:20.314977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1137/2245] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:20:20 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:20:20.319084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0f6c2-8392-4db9-9412-66891bea2f89 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:20.328980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0f6c2-8392-4db9-9412-66891bea2f89 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:20.392099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91142155-73cb-48c7-8b5e-0b58cc06693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:20.392713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91142155-73cb-48c7-8b5e-0b58cc06693c admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:20.392992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91142155-73cb-48c7-8b5e-0b58cc06693c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:20.393261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91142155-73cb-48c7-8b5e-0b58cc06693c admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:20.393984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91142155-73cb-48c7-8b5e-0b58cc06693c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:20.396209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91142155-73cb-48c7-8b5e-0b58cc06693c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:20.466156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1109/2246] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:20:20 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:20:20.468579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90578c6-f00f-4357-9fa9-9dee6b02f0fe admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:20.479701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90578c6-f00f-4357-9fa9-9dee6b02f0fe admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:20.484694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beaa10-032a-4b7e-b8d8-d235dea6c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:20.485447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beaa10-032a-4b7e-b8d8-d235dea6c0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:20.485837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beaa10-032a-4b7e-b8d8-d235dea6c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:20.486116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beaa10-032a-4b7e-b8d8-d235dea6c0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:20.486822 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beaa10-032a-4b7e-b8d8-d235dea6c0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:20.489038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beaa10-032a-4b7e-b8d8-d235dea6c0d9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:20.511343 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1138/2247] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:20:20.515469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91142155-73cb-48c7-8b5e-0b58cc06693c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:20.527130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91142155-73cb-48c7-8b5e-0b58cc06693c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:20.538595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf1a3c-c7d9-49ff-b750-45b069523125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:20.538595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf1a3c-c7d9-49ff-b750-45b069523125 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:20.538595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf1a3c-c7d9-49ff-b750-45b069523125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:20.538595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf1a3c-c7d9-49ff-b750-45b069523125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:20.538948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf1a3c-c7d9-49ff-b750-45b069523125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:20.538948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf1a3c-c7d9-49ff-b750-45b069523125 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:20.550581 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1110/2248] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:20:20.554867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beaa10-032a-4b7e-b8d8-d235dea6c0d9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:20.570759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beaa10-032a-4b7e-b8d8-d235dea6c0d9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:20.580979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a6853-63ed-4990-bc48-6aba66bc7698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:20.581958 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a6853-63ed-4990-bc48-6aba66bc7698 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:20.582287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a6853-63ed-4990-bc48-6aba66bc7698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:20.582658 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a6853-63ed-4990-bc48-6aba66bc7698 admin admin] PATH_INFO: `/v3/projects/7e35a35e4ac945669579d16de248d5a4/users/2bea9545991f4bc08af66113ac8c72c8/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:20.602937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a6853-63ed-4990-bc48-6aba66bc7698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e35a35e4ac945669579d16de248d5a4, user_id=2bea9545991f4bc08af66113ac8c72c8, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:20.602937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a6853-63ed-4990-bc48-6aba66bc7698 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:20.685464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1139/2249] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:20:20 2022] PUT /identity/v3/projects/7e35a35e4ac945669579d16de248d5a4/users/2bea9545991f4bc08af66113ac8c72c8/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:20:20.691036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de0843-9982-46cf-b77a-649d918b8bac None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:20.691523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de0843-9982-46cf-b77a-649d918b8bac None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:20.691802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de0843-9982-46cf-b77a-649d918b8bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:20.722160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-d3de0843-9982-46cf-b77a-649d918b8bac None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:20:20.724813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d3de0843-9982-46cf-b77a-649d918b8bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:20.790152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1111/2250] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:20:20.809953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a6853-63ed-4990-bc48-6aba66bc7698 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:20.809953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e27a6853-63ed-4990-bc48-6aba66bc7698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:20.820936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:20:20.866313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a6853-63ed-4990-bc48-6aba66bc7698 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:20.870195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7e61c-a95c-498e-a708-8a8e54b11e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:20.870839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e61c-a95c-498e-a708-8a8e54b11e81 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:20.871120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e61c-a95c-498e-a708-8a8e54b11e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:20.871400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7e61c-a95c-498e-a708-8a8e54b11e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:20.881468 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7e61c-a95c-498e-a708-8a8e54b11e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:20.883456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7e61c-a95c-498e-a708-8a8e54b11e81 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:20.895325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1140/2251] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:20:26.596426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527d9d4-43e9-4794-8856-f3160be869d1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:26.596843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527d9d4-43e9-4794-8856-f3160be869d1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:26.597173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527d9d4-43e9-4794-8856-f3160be869d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:26.672686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-4527d9d4-43e9-4794-8856-f3160be869d1 None None] MFA Rules not processed for user `2bea9545991f4bc08af66113ac8c72c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:20:26.674098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4527d9d4-43e9-4794-8856-f3160be869d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:26.826140 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1112/2252] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:20:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:20:26.827810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7e61c-a95c-498e-a708-8a8e54b11e81 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:26.840493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7e61c-a95c-498e-a708-8a8e54b11e81 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:26.860215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dac49-9721-4460-8dd6-048d540309b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:26.861140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dac49-9721-4460-8dd6-048d540309b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:26.861572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dac49-9721-4460-8dd6-048d540309b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:26.862035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dac49-9721-4460-8dd6-048d540309b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:26.862874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dac49-9721-4460-8dd6-048d540309b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:26.865161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dac49-9721-4460-8dd6-048d540309b5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:26.988997 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1141/2253] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:20:26 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:20:26.989933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527d9d4-43e9-4794-8856-f3160be869d1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:27.006551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527d9d4-43e9-4794-8856-f3160be869d1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:27.012337 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:20:27.090453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d293636-0ea0-4ce3-8e9b-f999be18aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:27.091110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d293636-0ea0-4ce3-8e9b-f999be18aed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:27.091386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d293636-0ea0-4ce3-8e9b-f999be18aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:27.091657 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d293636-0ea0-4ce3-8e9b-f999be18aed5 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:27.092970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d293636-0ea0-4ce3-8e9b-f999be18aed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:27.095035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d293636-0ea0-4ce3-8e9b-f999be18aed5 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:27.242844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1113/2254] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:20:26 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:20:27.249256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dac49-9721-4460-8dd6-048d540309b5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:27.261896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dac49-9721-4460-8dd6-048d540309b5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:27.267735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0ce9-e379-47b3-b53b-9baef5357428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:27.268536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0ce9-e379-47b3-b53b-9baef5357428 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:27.268820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0ce9-e379-47b3-b53b-9baef5357428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:27.269093 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0ce9-e379-47b3-b53b-9baef5357428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:27.269742 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f0ce9-e379-47b3-b53b-9baef5357428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:27.271402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f0ce9-e379-47b3-b53b-9baef5357428 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:27.296863 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1142/2255] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:20:27.301192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d293636-0ea0-4ce3-8e9b-f999be18aed5 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:27.312853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d293636-0ea0-4ce3-8e9b-f999be18aed5 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:27.319341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaf523-1ba4-4da7-b70e-b2edd78729f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:27.320244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf523-1ba4-4da7-b70e-b2edd78729f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:27.320627 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf523-1ba4-4da7-b70e-b2edd78729f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:27.321134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaf523-1ba4-4da7-b70e-b2edd78729f5 admin admin] PATH_INFO: `/v3/projects/a7460c505dfc409c8b5a6249abb502e9/users/c22c69a2bebe449682f7e1a1be1078c1/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:27.353135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaf523-1ba4-4da7-b70e-b2edd78729f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7460c505dfc409c8b5a6249abb502e9, user_id=c22c69a2bebe449682f7e1a1be1078c1, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:27.355993 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaf523-1ba4-4da7-b70e-b2edd78729f5 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:27.472282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0ce9-e379-47b3-b53b-9baef5357428 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:27.473113 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1114/2256] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:20:27 2022] PUT /identity/v3/projects/a7460c505dfc409c8b5a6249abb502e9/users/c22c69a2bebe449682f7e1a1be1078c1/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:20:27.484530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0ce9-e379-47b3-b53b-9baef5357428 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:27.556252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9c41-30aa-436d-bbe1-9f96001ebd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:27.557126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9c41-30aa-436d-bbe1-9f96001ebd92 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:27.557414 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9c41-30aa-436d-bbe1-9f96001ebd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:27.559392 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9c41-30aa-436d-bbe1-9f96001ebd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:27.559392 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd9c41-30aa-436d-bbe1-9f96001ebd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:27.560651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd9c41-30aa-436d-bbe1-9f96001ebd92 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:27.574725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1143/2257] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:20:27.579612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaf523-1ba4-4da7-b70e-b2edd78729f5 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:27.592186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaf523-1ba4-4da7-b70e-b2edd78729f5 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:27.597441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63695829-b01f-4843-9de1-1530adcd9435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:27.600652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63695829-b01f-4843-9de1-1530adcd9435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:27.600652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63695829-b01f-4843-9de1-1530adcd9435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:27.600652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63695829-b01f-4843-9de1-1530adcd9435 admin admin] PATH_INFO: `/v3/projects/a7460c505dfc409c8b5a6249abb502e9/users/c22c69a2bebe449682f7e1a1be1078c1/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:27.601838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63695829-b01f-4843-9de1-1530adcd9435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7460c505dfc409c8b5a6249abb502e9, user_id=c22c69a2bebe449682f7e1a1be1078c1, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:27.604833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63695829-b01f-4843-9de1-1530adcd9435 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:27.619755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1115/2258] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:20:27 2022] PUT /identity/v3/projects/a7460c505dfc409c8b5a6249abb502e9/users/c22c69a2bebe449682f7e1a1be1078c1/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:20:30.159012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fd5c2-9f31-4744-bd2f-1f4ec4effd31 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:30.159964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fd5c2-9f31-4744-bd2f-1f4ec4effd31 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:30.160975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fd5c2-9f31-4744-bd2f-1f4ec4effd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:30.184361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cc6fd5c2-9f31-4744-bd2f-1f4ec4effd31 None None] MFA Rules not processed for user `d235e94611884b28b85b637ac54204f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:20:30.185704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cc6fd5c2-9f31-4744-bd2f-1f4ec4effd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:30.260593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1144/2259] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:20:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:20:35.172482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddc68c-f8a9-41c9-9674-56bec6874783 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:35.172962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddc68c-f8a9-41c9-9674-56bec6874783 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:35.173196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddc68c-f8a9-41c9-9674-56bec6874783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:35.208146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-dbddc68c-f8a9-41c9-9674-56bec6874783 None None] MFA Rules not processed for user `c22c69a2bebe449682f7e1a1be1078c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:20:35.209386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dbddc68c-f8a9-41c9-9674-56bec6874783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:35.316108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1116/2260] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:20:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:20:35.330884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fd5c2-9f31-4744-bd2f-1f4ec4effd31 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:35.332282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cc6fd5c2-9f31-4744-bd2f-1f4ec4effd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:35.363690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:20:35.419350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fd5c2-9f31-4744-bd2f-1f4ec4effd31 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:35.429896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9f841-1ef1-4684-9b61-f170e6bbc932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:35.435243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9f841-1ef1-4684-9b61-f170e6bbc932 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:35.435243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9f841-1ef1-4684-9b61-f170e6bbc932 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:35.435243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9f841-1ef1-4684-9b61-f170e6bbc932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:35.531432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9f841-1ef1-4684-9b61-f170e6bbc932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:35.538295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9f841-1ef1-4684-9b61-f170e6bbc932 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:35.552876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1145/2261] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:20:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:20:37.125863 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4d46-eacf-4da2-a3ea-1b38cb11eabb None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:37.126427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4d46-eacf-4da2-a3ea-1b38cb11eabb None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:37.126427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4d46-eacf-4da2-a3ea-1b38cb11eabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:37.147520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-96da4d46-eacf-4da2-a3ea-1b38cb11eabb None None] MFA Rules not processed for user `f3ca84526cc8440ab332292c2fb4e73e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:20:37.148768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-96da4d46-eacf-4da2-a3ea-1b38cb11eabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:37.206083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:20:37.224440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1117/2262] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:20:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:20:39.281951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a824f82-b0e0-4165-8d2c-f45310b920cc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:39.281951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a824f82-b0e0-4165-8d2c-f45310b920cc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:39.281951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a824f82-b0e0-4165-8d2c-f45310b920cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:39.307049 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6a824f82-b0e0-4165-8d2c-f45310b920cc None None] MFA Rules not processed for user `2bea9545991f4bc08af66113ac8c72c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:20:39.308280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6a824f82-b0e0-4165-8d2c-f45310b920cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:39.317639 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1146/2263] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:20:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:20:41.394255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da4d46-eacf-4da2-a3ea-1b38cb11eabb None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:41.395804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-96da4d46-eacf-4da2-a3ea-1b38cb11eabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:41.474430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da4d46-eacf-4da2-a3ea-1b38cb11eabb None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:41.479709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56254c5c-d41a-41e9-af12-e48de99fe041 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:41.480322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56254c5c-d41a-41e9-af12-e48de99fe041 service placement] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:41.480595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56254c5c-d41a-41e9-af12-e48de99fe041 service placement] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:41.480866 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56254c5c-d41a-41e9-af12-e48de99fe041 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:41.483310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-56254c5c-d41a-41e9-af12-e48de99fe041 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:41.495567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56254c5c-d41a-41e9-af12-e48de99fe041 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:41.497200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56254c5c-d41a-41e9-af12-e48de99fe041 service placement] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:41.509141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1118/2264] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:20:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:20:49.303536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=48 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:20:51.504273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=36 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:20:54.413197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629f554-f5c9-453a-b1db-1c070302c8e5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:54.414060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629f554-f5c9-453a-b1db-1c070302c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:54.414491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629f554-f5c9-453a-b1db-1c070302c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:54.440590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9629f554-f5c9-453a-b1db-1c070302c8e5 None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:20:54.441815 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9629f554-f5c9-453a-b1db-1c070302c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:54.513180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1147/2265] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:20:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:20:54.526252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56254c5c-d41a-41e9-af12-e48de99fe041 service placement] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:20:54.527727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-56254c5c-d41a-41e9-af12-e48de99fe041 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:20:54.603747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56254c5c-d41a-41e9-af12-e48de99fe041 service placement] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:20:54.608817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88dc9b-1633-474a-b03a-15550bf0a814 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:20:54.609427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88dc9b-1633-474a-b03a-15550bf0a814 service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:20:54.609704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88dc9b-1633-474a-b03a-15550bf0a814 service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:20:54.609976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88dc9b-1633-474a-b03a-15550bf0a814 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:20:54.618352 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88dc9b-1633-474a-b03a-15550bf0a814 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:20:54.619986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88dc9b-1633-474a-b03a-15550bf0a814 service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:20:54.629282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1119/2266] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:21:04.504982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=25 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:21:04.625662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=32 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:21:16.474541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01870623-ab1b-4dc8-b322-21e5e7e4e5d8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:16.475083 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01870623-ab1b-4dc8-b322-21e5e7e4e5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:16.475228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01870623-ab1b-4dc8-b322-21e5e7e4e5d8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:16.476991 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1148/2267] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:21:16.483850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30bf72-7db0-47d6-b77e-a56d2183c72e None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:16.484331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30bf72-7db0-47d6-b77e-a56d2183c72e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:16.484429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30bf72-7db0-47d6-b77e-a56d2183c72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:16.505171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-6a30bf72-7db0-47d6-b77e-a56d2183c72e None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:21:16.506399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6a30bf72-7db0-47d6-b77e-a56d2183c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:21:16.516475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1120/2268] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:21:16.529486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01870623-ab1b-4dc8-b322-21e5e7e4e5d8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:21:16.532988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-01870623-ab1b-4dc8-b322-21e5e7e4e5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:21:16.592572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01870623-ab1b-4dc8-b322-21e5e7e4e5d8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:21:16.596104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27810abd-1a13-47a0-9fa8-003d642a7287 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0892bfab3ce435b90b93b0786899f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:21:16.596695 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810abd-1a13-47a0-9fa8-003d642a7287 service glance] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:16.596968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810abd-1a13-47a0-9fa8-003d642a7287 service glance] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:16.597237 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810abd-1a13-47a0-9fa8-003d642a7287 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:16.607283 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27810abd-1a13-47a0-9fa8-003d642a7287 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:21:16.608633 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27810abd-1a13-47a0-9fa8-003d642a7287 service glance] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:21:16.619180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1149/2269] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:21:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:21:16.817361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410a395-4554-40b6-a5b9-cde6c3a27add None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:16.817661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410a395-4554-40b6-a5b9-cde6c3a27add None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:16.817934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410a395-4554-40b6-a5b9-cde6c3a27add None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:16.819917 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1121/2270] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:21:16.824868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df1e3f-efd9-422f-b683-2f4530dc339c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:16.825305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df1e3f-efd9-422f-b683-2f4530dc339c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:16.825652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df1e3f-efd9-422f-b683-2f4530dc339c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:16.846077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-79df1e3f-efd9-422f-b683-2f4530dc339c None None] MFA Rules not processed for user `e08c9de660c04ed98f6100be2d687ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:21:16.847294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-79df1e3f-efd9-422f-b683-2f4530dc339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:21:16.905383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1150/2271] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:21:16.917851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410a395-4554-40b6-a5b9-cde6c3a27add None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:21:16.919738 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0410a395-4554-40b6-a5b9-cde6c3a27add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:21:16.932839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410a395-4554-40b6-a5b9-cde6c3a27add None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:21:16.936860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ee2f3-c62b-4d97-9c84-c4a630b58eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:21:16.937450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee2f3-c62b-4d97-9c84-c4a630b58eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:16.937727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee2f3-c62b-4d97-9c84-c4a630b58eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:16.941678 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee2f3-c62b-4d97-9c84-c4a630b58eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:16.945072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ee2f3-c62b-4d97-9c84-c4a630b58eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:21:16.946538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ee2f3-c62b-4d97-9c84-c4a630b58eb1 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:21:16.954987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1122/2272] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:21:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:21:17.048922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d858df-b3b4-4767-8b04-36412a408ae3 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:17.049300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d858df-b3b4-4767-8b04-36412a408ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:17.049575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d858df-b3b4-4767-8b04-36412a408ae3 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:17.050984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1151/2273] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:21:17.056666 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd06270-5f68-4f08-8334-797609755081 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:17.056953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd06270-5f68-4f08-8334-797609755081 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:17.057229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd06270-5f68-4f08-8334-797609755081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:17.077592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0bd06270-5f68-4f08-8334-797609755081 None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:21:17.078867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0bd06270-5f68-4f08-8334-797609755081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:21:17.088072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1123/2274] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:21:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:21:17.098401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d858df-b3b4-4767-8b04-36412a408ae3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:21:17.109320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d858df-b3b4-4767-8b04-36412a408ae3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:21:17.112912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea658bc-8e3b-4dd8-a988-ace2e57579e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:21:17.113505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea658bc-8e3b-4dd8-a988-ace2e57579e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:17.113778 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea658bc-8e3b-4dd8-a988-ace2e57579e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:17.114048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea658bc-8e3b-4dd8-a988-ace2e57579e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:17.124629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea658bc-8e3b-4dd8-a988-ace2e57579e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:21:17.126042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea658bc-8e3b-4dd8-a988-ace2e57579e0 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:21:17.137304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1152/2275] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:21:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:21:18.271146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd06270-5f68-4f08-8334-797609755081 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:21:18.281196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd06270-5f68-4f08-8334-797609755081 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:21:18.284943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753a88a-29a3-4693-8691-e96e50cb4aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:21:18.285547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753a88a-29a3-4693-8691-e96e50cb4aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:18.285847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753a88a-29a3-4693-8691-e96e50cb4aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:18.286107 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753a88a-29a3-4693-8691-e96e50cb4aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:18.298896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753a88a-29a3-4693-8691-e96e50cb4aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:21:18.299042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753a88a-29a3-4693-8691-e96e50cb4aa8 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:21:18.308711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1124/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:21:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:21:20.800932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b034e-1740-4189-b4ad-f3657780900c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:20.801423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b034e-1740-4189-b4ad-f3657780900c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:20.801634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b034e-1740-4189-b4ad-f3657780900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:20.823545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-322b034e-1740-4189-b4ad-f3657780900c None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:21:20.825121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-322b034e-1740-4189-b4ad-f3657780900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:21:20.833238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1153/2277] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:21:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:21:20.847263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753a88a-29a3-4693-8691-e96e50cb4aa8 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:21:20.860103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753a88a-29a3-4693-8691-e96e50cb4aa8 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:21:20.865583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065d46f-2899-489c-88ef-71388ba6b625 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:21:20.866359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065d46f-2899-489c-88ef-71388ba6b625 service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:20.866763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065d46f-2899-489c-88ef-71388ba6b625 service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:20.867270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065d46f-2899-489c-88ef-71388ba6b625 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:20.876041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065d46f-2899-489c-88ef-71388ba6b625 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:21:20.877737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065d46f-2899-489c-88ef-71388ba6b625 service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:21:20.887517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1125/2278] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:21:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:21:30.817047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=58 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:21:30.883938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=24 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:21:45.600780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ed955-d67f-4330-b559-92efdd6499cd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:45.601301 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ed955-d67f-4330-b559-92efdd6499cd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:45.601437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ed955-d67f-4330-b559-92efdd6499cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:45.620873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f42ed955-d67f-4330-b559-92efdd6499cd None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:21:45.622071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f42ed955-d67f-4330-b559-92efdd6499cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:21:45.629144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1154/2279] 10.222.0.23 () {58 vars in 967 bytes} [Thu Sep 8 16:21:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:21:45.642043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065d46f-2899-489c-88ef-71388ba6b625 service swift] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:21:45.654001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065d46f-2899-489c-88ef-71388ba6b625 service swift] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:21:45.660620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ee2a-2a2e-4b3f-b650-fe280cb81eb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:21:45.661224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ee2a-2a2e-4b3f-b650-fe280cb81eb0 service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:21:45.661501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ee2a-2a2e-4b3f-b650-fe280cb81eb0 service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:21:45.661771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ee2a-2a2e-4b3f-b650-fe280cb81eb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:21:45.673162 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2ee2a-2a2e-4b3f-b650-fe280cb81eb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:21:45.674863 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2ee2a-2a2e-4b3f-b650-fe280cb81eb0 service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:21:45.683195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1126/2280] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:21:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:21:55.615528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:21:55.679637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=6 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:22:41.129139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ed955-d67f-4330-b559-92efdd6499cd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:22:41.130536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f42ed955-d67f-4330-b559-92efdd6499cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:22:41.185709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ed955-d67f-4330-b559-92efdd6499cd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:22:41.189241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dc2e6-f623-4c5f-aaed-245408b06220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:22:41.190437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dc2e6-f623-4c5f-aaed-245408b06220 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:22:41.190747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dc2e6-f623-4c5f-aaed-245408b06220 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:22:41.191021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dc2e6-f623-4c5f-aaed-245408b06220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:22:41.192744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-326dc2e6-f623-4c5f-aaed-245408b06220 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:22:41.206426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dc2e6-f623-4c5f-aaed-245408b06220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:22:41.207876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dc2e6-f623-4c5f-aaed-245408b06220 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:22:41.218566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1155/2281] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:22:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:22:44.099497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ee2a-2a2e-4b3f-b650-fe280cb81eb0 service swift] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:22:44.109800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ee2a-2a2e-4b3f-b650-fe280cb81eb0 service swift] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:22:44.113646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0fd63-1ac1-4743-bf26-3413681cdfdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:22:44.114479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0fd63-1ac1-4743-bf26-3413681cdfdd service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:22:44.114791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0fd63-1ac1-4743-bf26-3413681cdfdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:22:44.115067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0fd63-1ac1-4743-bf26-3413681cdfdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:22:44.118434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1ae0fd63-1ac1-4743-bf26-3413681cdfdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:22:44.132501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0fd63-1ac1-4743-bf26-3413681cdfdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:22:44.133950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0fd63-1ac1-4743-bf26-3413681cdfdd service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:22:44.146039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1127/2282] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:22:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:22:51.214088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=26 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:22:51.709538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41451d33-c0b7-4cc0-bc8e-49dfc701897b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:22:51.709824 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41451d33-c0b7-4cc0-bc8e-49dfc701897b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:22:51.710097 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41451d33-c0b7-4cc0-bc8e-49dfc701897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:22:51.730389 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-41451d33-c0b7-4cc0-bc8e-49dfc701897b None None] MFA Rules not processed for user `d235e94611884b28b85b637ac54204f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:22:51.731632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-41451d33-c0b7-4cc0-bc8e-49dfc701897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:22:51.738731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1156/2283] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:22:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:22:54.141460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=6 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:22:54.931960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0fd63-1ac1-4743-bf26-3413681cdfdd service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:22:54.941576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0fd63-1ac1-4743-bf26-3413681cdfdd service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:22:54.945184 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013a120-3867-4fcf-8e3b-6448a11295d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0892bfab3ce435b90b93b0786899f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:22:54.945778 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013a120-3867-4fcf-8e3b-6448a11295d1 service glance] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:22:54.946051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013a120-3867-4fcf-8e3b-6448a11295d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:22:54.946455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013a120-3867-4fcf-8e3b-6448a11295d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:22:54.948069 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5013a120-3867-4fcf-8e3b-6448a11295d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:22:54.959288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013a120-3867-4fcf-8e3b-6448a11295d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:22:54.960735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013a120-3867-4fcf-8e3b-6448a11295d1 service glance] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:22:54.969928 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1128/2284] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:22:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:22:56.137523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41451d33-c0b7-4cc0-bc8e-49dfc701897b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:22:56.139069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-41451d33-c0b7-4cc0-bc8e-49dfc701897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:22:56.158370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41451d33-c0b7-4cc0-bc8e-49dfc701897b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:22:56.165320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0de1ba-66d1-44a3-9b51-f470ea1c55d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:22:56.166411 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0de1ba-66d1-44a3-9b51-f470ea1c55d4 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:22:56.166690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0de1ba-66d1-44a3-9b51-f470ea1c55d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:22:56.166957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0de1ba-66d1-44a3-9b51-f470ea1c55d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:22:56.168758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-db0de1ba-66d1-44a3-9b51-f470ea1c55d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:22:56.239126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0de1ba-66d1-44a3-9b51-f470ea1c55d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:22:56.240737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0de1ba-66d1-44a3-9b51-f470ea1c55d4 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:22:56.250089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1157/2285] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:22:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:23:04.965533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=6 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:23:05.426156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47816233-51db-40e2-9a3d-f8e4cf40fcb2 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:23:05.426442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47816233-51db-40e2-9a3d-f8e4cf40fcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:23:05.426813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47816233-51db-40e2-9a3d-f8e4cf40fcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:23:05.446467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-47816233-51db-40e2-9a3d-f8e4cf40fcb2 None None] MFA Rules not processed for user `f3ca84526cc8440ab332292c2fb4e73e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:23:05.451274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-47816233-51db-40e2-9a3d-f8e4cf40fcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:23:05.454652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1129/2286] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:23:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:23:05.963517 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0de1ba-66d1-44a3-9b51-f470ea1c55d4 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:23:05.983699 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0de1ba-66d1-44a3-9b51-f470ea1c55d4 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:23:05.987551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57a63-40dc-494f-9310-456a65800140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:23:05.988150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57a63-40dc-494f-9310-456a65800140 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:23:05.989105 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57a63-40dc-494f-9310-456a65800140 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:23:05.989418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57a63-40dc-494f-9310-456a65800140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:23:05.991272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f3e57a63-40dc-494f-9310-456a65800140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:23:06.001245 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e57a63-40dc-494f-9310-456a65800140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:23:06.002696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e57a63-40dc-494f-9310-456a65800140 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:23:06.011487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1158/2287] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:23:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:23:09.503127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa4db-c749-48cd-bccd-31f0d07d7d0b None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:23:09.503619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa4db-c749-48cd-bccd-31f0d07d7d0b None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:23:09.503727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa4db-c749-48cd-bccd-31f0d07d7d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:23:09.523832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-51daa4db-c749-48cd-bccd-31f0d07d7d0b None None] MFA Rules not processed for user `ce39c87aac4e4df79efc1f80a07b3273`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:23:09.531705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-51daa4db-c749-48cd-bccd-31f0d07d7d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:23:09.532023 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1130/2288] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:23:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:23:09.840948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57a63-40dc-494f-9310-456a65800140 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:23:09.849912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57a63-40dc-494f-9310-456a65800140 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:23:09.853671 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f419e-e769-4093-8f82-b2890602bdc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:23:09.854271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f419e-e769-4093-8f82-b2890602bdc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:23:09.854548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f419e-e769-4093-8f82-b2890602bdc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:23:09.854858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f419e-e769-4093-8f82-b2890602bdc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:23:09.856567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ff1f419e-e769-4093-8f82-b2890602bdc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:23:09.866536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f419e-e769-4093-8f82-b2890602bdc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:23:09.867982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f419e-e769-4093-8f82-b2890602bdc9 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:23:09.875860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1159/2289] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:23:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:23:10.259412 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daa4db-c749-48cd-bccd-31f0d07d7d0b None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:23:10.260916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-51daa4db-c749-48cd-bccd-31f0d07d7d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:23:10.276924 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daa4db-c749-48cd-bccd-31f0d07d7d0b None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:23:10.282137 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a039ef-e331-4ea3-bd74-de7eafb2b14f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:23:10.282577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a039ef-e331-4ea3-bd74-de7eafb2b14f service placement] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:23:10.282907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a039ef-e331-4ea3-bd74-de7eafb2b14f service placement] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:23:10.283335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a039ef-e331-4ea3-bd74-de7eafb2b14f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:23:10.284894 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-21a039ef-e331-4ea3-bd74-de7eafb2b14f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:23:10.297338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a039ef-e331-4ea3-bd74-de7eafb2b14f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:23:10.299293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a039ef-e331-4ea3-bd74-de7eafb2b14f service placement] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:23:10.310283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1131/2290] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:23:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:23:13.883036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f419e-e769-4093-8f82-b2890602bdc9 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:23:13.906139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f419e-e769-4093-8f82-b2890602bdc9 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:23:13.914387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095dcea-f433-49d4-9d8f-6b8a27f21f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:23:13.915281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095dcea-f433-49d4-9d8f-6b8a27f21f58 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:23:13.916100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095dcea-f433-49d4-9d8f-6b8a27f21f58 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:23:13.916800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095dcea-f433-49d4-9d8f-6b8a27f21f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:23:13.919838 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7095dcea-f433-49d4-9d8f-6b8a27f21f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:23:13.936512 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095dcea-f433-49d4-9d8f-6b8a27f21f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:23:13.938291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095dcea-f433-49d4-9d8f-6b8a27f21f58 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:23:13.950317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1160/2291] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:23:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:23:15.031535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a039ef-e331-4ea3-bd74-de7eafb2b14f service placement] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:23:15.046766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a039ef-e331-4ea3-bd74-de7eafb2b14f service placement] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:23:15.053571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b4e1a-8dc2-43b3-b147-d266b7b5ce15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:23:15.054329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4e1a-8dc2-43b3-b147-d266b7b5ce15 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:23:15.054744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4e1a-8dc2-43b3-b147-d266b7b5ce15 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:23:15.055262 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b4e1a-8dc2-43b3-b147-d266b7b5ce15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:23:15.057157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ad3b4e1a-8dc2-43b3-b147-d266b7b5ce15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:23:15.070377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b4e1a-8dc2-43b3-b147-d266b7b5ce15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:23:15.072208 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b4e1a-8dc2-43b3-b147-d266b7b5ce15 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:23:15.083461 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1132/2292] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:23:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:23:23.945098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=49 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:23:25.078417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=18 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:23:48.152523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095dcea-f433-49d4-9d8f-6b8a27f21f58 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:23:48.161772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095dcea-f433-49d4-9d8f-6b8a27f21f58 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:23:48.165439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fbfca-78f9-43eb-b18e-35da7e653775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:23:48.166025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fbfca-78f9-43eb-b18e-35da7e653775 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:23:48.166300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fbfca-78f9-43eb-b18e-35da7e653775 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:23:48.166571 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fbfca-78f9-43eb-b18e-35da7e653775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:23:48.168926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fa6fbfca-78f9-43eb-b18e-35da7e653775 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:23:48.228869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fbfca-78f9-43eb-b18e-35da7e653775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:23:48.230308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fbfca-78f9-43eb-b18e-35da7e653775 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:23:48.239395 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1161/2293] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:23:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:23:55.411728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff60bb-963e-4094-8f83-7259bf6ba242 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:23:55.412263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff60bb-963e-4094-8f83-7259bf6ba242 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:23:55.412372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff60bb-963e-4094-8f83-7259bf6ba242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:23:55.432457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-7bff60bb-963e-4094-8f83-7259bf6ba242 None None] MFA Rules not processed for user `73f357cb7b2d4214bde8d5d0d212c91f`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:23:55.433647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7bff60bb-963e-4094-8f83-7259bf6ba242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:23:55.440604 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1133/2294] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:23:58.235221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=28 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:05.427617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:07.324423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fbfca-78f9-43eb-b18e-35da7e653775 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:07.337550 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fbfca-78f9-43eb-b18e-35da7e653775 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:07.343006 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239a82e-6f32-4a10-b5e7-6e944d099989 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:07.343630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239a82e-6f32-4a10-b5e7-6e944d099989 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:07.343909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239a82e-6f32-4a10-b5e7-6e944d099989 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:07.344181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239a82e-6f32-4a10-b5e7-6e944d099989 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:07.345985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6239a82e-6f32-4a10-b5e7-6e944d099989 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:07.358501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239a82e-6f32-4a10-b5e7-6e944d099989 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:07.360132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239a82e-6f32-4a10-b5e7-6e944d099989 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:07.371113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1162/2295] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:24:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:24:17.366824 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:18.145929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff60bb-963e-4094-8f83-7259bf6ba242 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:18.155476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff60bb-963e-4094-8f83-7259bf6ba242 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:18.159146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7597ae-529f-4bc4-ba4e-5855ee263c24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:18.159742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7597ae-529f-4bc4-ba4e-5855ee263c24 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:18.160029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7597ae-529f-4bc4-ba4e-5855ee263c24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:18.160281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7597ae-529f-4bc4-ba4e-5855ee263c24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:18.162011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2c7597ae-529f-4bc4-ba4e-5855ee263c24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:18.173058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7597ae-529f-4bc4-ba4e-5855ee263c24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:18.174483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7597ae-529f-4bc4-ba4e-5855ee263c24 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:18.183201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1134/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:24:18 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:24:28.179193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=6 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:44.872279 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239a82e-6f32-4a10-b5e7-6e944d099989 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:44.882246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239a82e-6f32-4a10-b5e7-6e944d099989 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:44.893208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027722a-b47b-4b4a-9ebc-826566dd3e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:44.893208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027722a-b47b-4b4a-9ebc-826566dd3e30 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:44.893208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027722a-b47b-4b4a-9ebc-826566dd3e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:44.893208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027722a-b47b-4b4a-9ebc-826566dd3e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:44.893670 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5027722a-b47b-4b4a-9ebc-826566dd3e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:44.956104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027722a-b47b-4b4a-9ebc-826566dd3e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:44.958096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027722a-b47b-4b4a-9ebc-826566dd3e30 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:44.968155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1163/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:24:48.527842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7597ae-529f-4bc4-ba4e-5855ee263c24 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:48.539871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7597ae-529f-4bc4-ba4e-5855ee263c24 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:48.545111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d858-039c-48fb-9a27-a11f2d6e0805 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:48.545739 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d858-039c-48fb-9a27-a11f2d6e0805 service placement] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:48.546014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d858-039c-48fb-9a27-a11f2d6e0805 service placement] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:48.546283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2d858-039c-48fb-9a27-a11f2d6e0805 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:48.548016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3df2d858-039c-48fb-9a27-a11f2d6e0805 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:48.559784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2d858-039c-48fb-9a27-a11f2d6e0805 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:48.561398 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2d858-039c-48fb-9a27-a11f2d6e0805 service placement] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:48.571547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1135/2298] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:24:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:24:48.728175 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027722a-b47b-4b4a-9ebc-826566dd3e30 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:48.729874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5027722a-b47b-4b4a-9ebc-826566dd3e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:48.744153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027722a-b47b-4b4a-9ebc-826566dd3e30 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:48.749372 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff76e5-5977-47e1-9698-680d0cedd01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:48.750140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff76e5-5977-47e1-9698-680d0cedd01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:48.750701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff76e5-5977-47e1-9698-680d0cedd01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:48.751060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff76e5-5977-47e1-9698-680d0cedd01c admin admin] PATH_INFO: `/v3/users/f3ca84526cc8440ab332292c2fb4e73e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:48.752121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff76e5-5977-47e1-9698-680d0cedd01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ca84526cc8440ab332292c2fb4e73e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:48.754558 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff76e5-5977-47e1-9698-680d0cedd01c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:49.014963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5cff76e5-5977-47e1-9698-680d0cedd01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ca84526cc8440ab332292c2fb4e73e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:49.016034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5cff76e5-5977-47e1-9698-680d0cedd01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ca84526cc8440ab332292c2fb4e73e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:49.099345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5cff76e5-5977-47e1-9698-680d0cedd01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ca84526cc8440ab332292c2fb4e73e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:49.100172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5cff76e5-5977-47e1-9698-680d0cedd01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ca84526cc8440ab332292c2fb4e73e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:49.108034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5cff76e5-5977-47e1-9698-680d0cedd01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ca84526cc8440ab332292c2fb4e73e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:49.127971 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1164/2299] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:24:48 2022] DELETE /identity/v3/users/f3ca84526cc8440ab332292c2fb4e73e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:24:49.401236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d858-039c-48fb-9a27-a11f2d6e0805 service placement] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:49.425231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2d858-039c-48fb-9a27-a11f2d6e0805 service placement] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:49.502341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:49.503358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:49.504079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:49.504648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] PATH_INFO: `/v3/projects/27fc80566150466580ab9881260bf299` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:49.505971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27fc80566150466580ab9881260bf299)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:49.508153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:49.633708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27fc80566150466580ab9881260bf299', 'request_id': 'req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:49.641093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27fc80566150466580ab9881260bf299', 'request_id': 'req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:49.647883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27fc80566150466580ab9881260bf299', 'request_id': 'req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:49.746001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] The token cache is being invalidate because project 27fc80566150466580ab9881260bf299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:24:49.746230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:49.746911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88fd9968-57d3-46c4-abc2-6ae8ca9695f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:49.748436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1136/2300] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:24:49 2022] DELETE /identity/v3/projects/27fc80566150466580ab9881260bf299 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:24:49.753595 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c769fe4-4180-404d-ac50-a433b7f0d094 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:49.754122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c769fe4-4180-404d-ac50-a433b7f0d094 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:49.754384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c769fe4-4180-404d-ac50-a433b7f0d094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:49.776802 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0c769fe4-4180-404d-ac50-a433b7f0d094 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:24:49.778063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0c769fe4-4180-404d-ac50-a433b7f0d094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:49.844048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1165/2301] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:24:49.852461 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b9e6-6a37-4c96-8ebd-a8aa87718922 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:49.852746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b9e6-6a37-4c96-8ebd-a8aa87718922 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:49.853019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b9e6-6a37-4c96-8ebd-a8aa87718922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:49.873903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-dce9b9e6-6a37-4c96-8ebd-a8aa87718922 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:24:49.875764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dce9b9e6-6a37-4c96-8ebd-a8aa87718922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:49.885918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1137/2302] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:24:49.893794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c769fe4-4180-404d-ac50-a433b7f0d094 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:49.906069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c769fe4-4180-404d-ac50-a433b7f0d094 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:49.912116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56022236-710e-44c7-a656-520efeae6f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:49.912984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56022236-710e-44c7-a656-520efeae6f6a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:49.913318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56022236-710e-44c7-a656-520efeae6f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:49.915113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56022236-710e-44c7-a656-520efeae6f6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:49.915113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56022236-710e-44c7-a656-520efeae6f6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:24:49.915113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56022236-710e-44c7-a656-520efeae6f6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:49.916840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56022236-710e-44c7-a656-520efeae6f6a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:49.919670 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:49.932330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1166/2303] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:24:49.936520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9b9e6-6a37-4c96-8ebd-a8aa87718922 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:49.957522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9b9e6-6a37-4c96-8ebd-a8aa87718922 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:49.963345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ff0ee-1eea-4425-b7ae-9db03fcd0aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:49.964529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ff0ee-1eea-4425-b7ae-9db03fcd0aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:49.964810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ff0ee-1eea-4425-b7ae-9db03fcd0aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:49.965082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ff0ee-1eea-4425-b7ae-9db03fcd0aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:49.965912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ff0ee-1eea-4425-b7ae-9db03fcd0aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:49.968129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ff0ee-1eea-4425-b7ae-9db03fcd0aa2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:50.085352 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1138/2304] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:24:49 2022] POST /identity/v3/projects => generated 401 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:24:50.089681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56022236-710e-44c7-a656-520efeae6f6a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:50.100205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56022236-710e-44c7-a656-520efeae6f6a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:50.156560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46251f37-f523-479a-bdff-969527d81845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:50.157268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46251f37-f523-479a-bdff-969527d81845 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:50.157546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46251f37-f523-479a-bdff-969527d81845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:50.157812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46251f37-f523-479a-bdff-969527d81845 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:50.158432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46251f37-f523-479a-bdff-969527d81845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:50.160957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46251f37-f523-479a-bdff-969527d81845 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:50.237612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1167/2305] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:24:50 2022] POST /identity/v3/users => generated 301 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:24:50.241641 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ff0ee-1eea-4425-b7ae-9db03fcd0aa2 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:50.252952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ff0ee-1eea-4425-b7ae-9db03fcd0aa2 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:50.258817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c26fb5-ffa5-4620-87db-61c64869422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:50.259466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c26fb5-ffa5-4620-87db-61c64869422a admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:50.259738 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c26fb5-ffa5-4620-87db-61c64869422a admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:50.260001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c26fb5-ffa5-4620-87db-61c64869422a admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:50.260636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c26fb5-ffa5-4620-87db-61c64869422a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:50.262263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c26fb5-ffa5-4620-87db-61c64869422a admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:50.273759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1139/2306] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:24:50.278728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46251f37-f523-479a-bdff-969527d81845 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:50.293550 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46251f37-f523-479a-bdff-969527d81845 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:50.303208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643926c-414d-4a63-a422-b9c98490d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:50.303856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643926c-414d-4a63-a422-b9c98490d5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:50.304129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643926c-414d-4a63-a422-b9c98490d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:50.304456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643926c-414d-4a63-a422-b9c98490d5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:50.305102 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643926c-414d-4a63-a422-b9c98490d5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:50.306899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643926c-414d-4a63-a422-b9c98490d5f2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:50.319028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1168/2307] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:24:50.323562 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c26fb5-ffa5-4620-87db-61c64869422a admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:50.338623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c26fb5-ffa5-4620-87db-61c64869422a admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:50.343936 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564b52b-8972-477d-a610-3bb22c324c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:50.344858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564b52b-8972-477d-a610-3bb22c324c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:50.351455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564b52b-8972-477d-a610-3bb22c324c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:50.351455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564b52b-8972-477d-a610-3bb22c324c7b admin admin] PATH_INFO: `/v3/projects/280e4376c90f439f881666ba56974630/users/737a00e8fc2b4b99bec1b0146d2fa883/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:50.361453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564b52b-8972-477d-a610-3bb22c324c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=280e4376c90f439f881666ba56974630, user_id=737a00e8fc2b4b99bec1b0146d2fa883, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:50.364273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564b52b-8972-477d-a610-3bb22c324c7b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:50.444938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1140/2308] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:24:50 2022] PUT /identity/v3/projects/280e4376c90f439f881666ba56974630/users/737a00e8fc2b4b99bec1b0146d2fa883/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:24:50.458083 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb225-730e-456b-bc5f-5ab35753cc14 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:50.458083 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb225-730e-456b-bc5f-5ab35753cc14 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:50.458492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb225-730e-456b-bc5f-5ab35753cc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:50.490446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1a3bb225-730e-456b-bc5f-5ab35753cc14 None None] MFA Rules not processed for user `737a00e8fc2b4b99bec1b0146d2fa883`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:24:50.491997 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1a3bb225-730e-456b-bc5f-5ab35753cc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:50.564861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1169/2309] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:24:50 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:24:50.569938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564b52b-8972-477d-a610-3bb22c324c7b admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:50.584587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:50.634016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564b52b-8972-477d-a610-3bb22c324c7b admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:50.639403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd31aa-5202-4b9b-98f0-9f6717f92983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:50.640018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd31aa-5202-4b9b-98f0-9f6717f92983 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:50.640300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd31aa-5202-4b9b-98f0-9f6717f92983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:50.640579 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd31aa-5202-4b9b-98f0-9f6717f92983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:50.641252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd31aa-5202-4b9b-98f0-9f6717f92983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:50.643225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd31aa-5202-4b9b-98f0-9f6717f92983 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:50.731037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1141/2310] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:24:50 2022] POST /identity/v3/projects => generated 399 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:24:50.735174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bb225-730e-456b-bc5f-5ab35753cc14 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:50.746555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bb225-730e-456b-bc5f-5ab35753cc14 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:50.805081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e78b2b-aac9-4fe8-ad59-5521a8fac510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:50.806071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78b2b-aac9-4fe8-ad59-5521a8fac510 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:50.806071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78b2b-aac9-4fe8-ad59-5521a8fac510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:50.806259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e78b2b-aac9-4fe8-ad59-5521a8fac510 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:50.806770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e78b2b-aac9-4fe8-ad59-5521a8fac510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:50.808688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e78b2b-aac9-4fe8-ad59-5521a8fac510 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:50.818569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:50.964147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1170/2311] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:24:50 2022] POST /identity/v3/users => generated 306 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:24:50.968003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd31aa-5202-4b9b-98f0-9f6717f92983 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:50.979958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd31aa-5202-4b9b-98f0-9f6717f92983 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:50.984703 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbad1a-a938-4ab2-af62-ddc413f6a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:50.985314 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbad1a-a938-4ab2-af62-ddc413f6a08b admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:50.985593 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbad1a-a938-4ab2-af62-ddc413f6a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:50.985864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbad1a-a938-4ab2-af62-ddc413f6a08b admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:50.986505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbad1a-a938-4ab2-af62-ddc413f6a08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:50.988792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbad1a-a938-4ab2-af62-ddc413f6a08b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:51.000351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1142/2312] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:24:51.009039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e78b2b-aac9-4fe8-ad59-5521a8fac510 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:51.019469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e78b2b-aac9-4fe8-ad59-5521a8fac510 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:51.024508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1614f-078e-4cdc-84c9-c7fb39d234fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:51.025200 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1614f-078e-4cdc-84c9-c7fb39d234fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:51.030569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1614f-078e-4cdc-84c9-c7fb39d234fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:51.030569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1614f-078e-4cdc-84c9-c7fb39d234fe admin admin] PATH_INFO: `/v3/projects/6383af35d90a45cbac974e8ff9f884cd/users/f510b66b59084183a88e62c6d80d0fad/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:51.041664 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1614f-078e-4cdc-84c9-c7fb39d234fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6383af35d90a45cbac974e8ff9f884cd, user_id=f510b66b59084183a88e62c6d80d0fad, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:51.044698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1614f-078e-4cdc-84c9-c7fb39d234fe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:51.118870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1171/2313] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:24:51 2022] PUT /identity/v3/projects/6383af35d90a45cbac974e8ff9f884cd/users/f510b66b59084183a88e62c6d80d0fad/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:24:51.124354 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbad1a-a938-4ab2-af62-ddc413f6a08b admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:51.134617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbad1a-a938-4ab2-af62-ddc413f6a08b admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:51.198710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba202370-b438-4883-b5d6-315e1a915dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:51.199319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba202370-b438-4883-b5d6-315e1a915dab admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:51.199604 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba202370-b438-4883-b5d6-315e1a915dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:51.199872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba202370-b438-4883-b5d6-315e1a915dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:51.200542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba202370-b438-4883-b5d6-315e1a915dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:51.202254 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba202370-b438-4883-b5d6-315e1a915dab admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:51.218041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1143/2314] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:24:51.222973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1614f-078e-4cdc-84c9-c7fb39d234fe admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:51.234555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1614f-078e-4cdc-84c9-c7fb39d234fe admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:51.240371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2c224-1fd6-4f3f-a1cd-d48042ca4300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:51.241099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2c224-1fd6-4f3f-a1cd-d48042ca4300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:51.241320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2c224-1fd6-4f3f-a1cd-d48042ca4300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:51.241590 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2c224-1fd6-4f3f-a1cd-d48042ca4300 admin admin] PATH_INFO: `/v3/projects/6383af35d90a45cbac974e8ff9f884cd/users/f510b66b59084183a88e62c6d80d0fad/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:51.243596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2c224-1fd6-4f3f-a1cd-d48042ca4300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6383af35d90a45cbac974e8ff9f884cd, user_id=f510b66b59084183a88e62c6d80d0fad, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:51.246274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2c224-1fd6-4f3f-a1cd-d48042ca4300 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:51.257155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1172/2315] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:24:51 2022] PUT /identity/v3/projects/6383af35d90a45cbac974e8ff9f884cd/users/f510b66b59084183a88e62c6d80d0fad/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:24:51.267857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b9e48-54f7-4c0e-966c-c021d8951955 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:51.268147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b9e48-54f7-4c0e-966c-c021d8951955 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:51.268449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b9e48-54f7-4c0e-966c-c021d8951955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:51.298882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-675b9e48-54f7-4c0e-966c-c021d8951955 None None] MFA Rules not processed for user `f510b66b59084183a88e62c6d80d0fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:24:51.300112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-675b9e48-54f7-4c0e-966c-c021d8951955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:51.382395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1144/2316] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:24:51 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:24:51.393472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2c224-1fd6-4f3f-a1cd-d48042ca4300 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:51.395812 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a9c2c224-1fd6-4f3f-a1cd-d48042ca4300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:51.476037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2c224-1fd6-4f3f-a1cd-d48042ca4300 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:51.479760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237da05-4d0a-4134-bab7-9b2a19c2fdb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:51.480366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237da05-4d0a-4134-bab7-9b2a19c2fdb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:51.480698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237da05-4d0a-4134-bab7-9b2a19c2fdb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:51.480966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237da05-4d0a-4134-bab7-9b2a19c2fdb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:51.491753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237da05-4d0a-4134-bab7-9b2a19c2fdb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:51.493347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237da05-4d0a-4134-bab7-9b2a19c2fdb2 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:51.504306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1173/2317] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:24:51 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:24:51.692620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b9e48-54f7-4c0e-966c-c021d8951955 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:51.702622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b9e48-54f7-4c0e-966c-c021d8951955 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:51.706447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36df4b-9bd0-4787-810a-40d7fd80b1e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:51.707652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36df4b-9bd0-4787-810a-40d7fd80b1e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:51.707928 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36df4b-9bd0-4787-810a-40d7fd80b1e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:51.708202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36df4b-9bd0-4787-810a-40d7fd80b1e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:51.713671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:51.764518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36df4b-9bd0-4787-810a-40d7fd80b1e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:51.765903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36df4b-9bd0-4787-810a-40d7fd80b1e6 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:51.777952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1145/2318] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:24:51 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:24:54.125551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146a02f-4c16-42f7-9e36-221c99a2c3dc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:54.126064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146a02f-4c16-42f7-9e36-221c99a2c3dc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:54.126182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146a02f-4c16-42f7-9e36-221c99a2c3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:54.150293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1146a02f-4c16-42f7-9e36-221c99a2c3dc None None] MFA Rules not processed for user `d235e94611884b28b85b637ac54204f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:24:54.150293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1146a02f-4c16-42f7-9e36-221c99a2c3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:54.206323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1174/2319] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:24:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:24:54.762081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36df4b-9bd0-4787-810a-40d7fd80b1e6 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:54.763705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7d36df4b-9bd0-4787-810a-40d7fd80b1e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:54.824309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36df4b-9bd0-4787-810a-40d7fd80b1e6 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:54.828089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0ee7e-8906-4eac-871e-c900f8cbe55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:54.828692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0ee7e-8906-4eac-871e-c900f8cbe55e service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:54.828972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0ee7e-8906-4eac-871e-c900f8cbe55e service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:54.829245 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0ee7e-8906-4eac-871e-c900f8cbe55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:54.830991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6cd0ee7e-8906-4eac-871e-c900f8cbe55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:54.842855 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0ee7e-8906-4eac-871e-c900f8cbe55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:54.844325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0ee7e-8906-4eac-871e-c900f8cbe55e service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:54.852846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1146/2320] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:24:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:24:56.764067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146a02f-4c16-42f7-9e36-221c99a2c3dc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:56.836371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146a02f-4c16-42f7-9e36-221c99a2c3dc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:56.841031 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:56.841669 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:56.841942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:56.842262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] PATH_INFO: `/v3/users/737a00e8fc2b4b99bec1b0146d2fa883` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:56.843440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=737a00e8fc2b4b99bec1b0146d2fa883)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:56.845460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:56.848072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:56.977313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737a00e8fc2b4b99bec1b0146d2fa883'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:56.977884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737a00e8fc2b4b99bec1b0146d2fa883'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:57.031563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737a00e8fc2b4b99bec1b0146d2fa883'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:57.032176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737a00e8fc2b4b99bec1b0146d2fa883'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:57.039469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737a00e8fc2b4b99bec1b0146d2fa883'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:57.056927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1175/2321] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:24:56 2022] DELETE /identity/v3/users/737a00e8fc2b4b99bec1b0146d2fa883 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:24:57.061609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440422-45bd-4cc6-9b82-fea831959792 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:57.062125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440422-45bd-4cc6-9b82-fea831959792 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:57.062223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440422-45bd-4cc6-9b82-fea831959792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:57.081278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-dc440422-45bd-4cc6-9b82-fea831959792 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:24:57.083216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dc440422-45bd-4cc6-9b82-fea831959792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:57.140828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1147/2322] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:24:57.151088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:57.152607 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:57.211268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c8587-6b6f-4fab-a9db-9efaa1b5dc2e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:57.215076 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a759688-399b-4637-8420-fb260449a8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:57.215711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a759688-399b-4637-8420-fb260449a8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:57.215985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a759688-399b-4637-8420-fb260449a8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:57.216250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a759688-399b-4637-8420-fb260449a8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:57.225380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a759688-399b-4637-8420-fb260449a8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:57.226856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a759688-399b-4637-8420-fb260449a8a0 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:57.236706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1176/2323] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:24:57.656440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc440422-45bd-4cc6-9b82-fea831959792 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:57.657966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dc440422-45bd-4cc6-9b82-fea831959792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:57.673653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc440422-45bd-4cc6-9b82-fea831959792 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:57.679059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:57.679712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:57.680535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:57.680535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] PATH_INFO: `/v3/projects/280e4376c90f439f881666ba56974630` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:57.681623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=280e4376c90f439f881666ba56974630)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:57.683647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:57.784740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:57.787670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280e4376c90f439f881666ba56974630', 'request_id': 'req-39af19db-aaac-4781-b2d2-4dba32a63b34'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:57.793147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280e4376c90f439f881666ba56974630', 'request_id': 'req-39af19db-aaac-4781-b2d2-4dba32a63b34'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:57.799693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280e4376c90f439f881666ba56974630', 'request_id': 'req-39af19db-aaac-4781-b2d2-4dba32a63b34'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:57.871102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] The token cache is being invalidate because project 280e4376c90f439f881666ba56974630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:24:57.871682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:57.872433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:57.874172 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1148/2324] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:24:57 2022] DELETE /identity/v3/projects/280e4376c90f439f881666ba56974630 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:24:57.877961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a759688-399b-4637-8420-fb260449a8a0 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:57.889034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a759688-399b-4637-8420-fb260449a8a0 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:57.961766 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17cef7-ee7b-4f5a-babc-cef4811533e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:57.962510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17cef7-ee7b-4f5a-babc-cef4811533e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:57.962838 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17cef7-ee7b-4f5a-babc-cef4811533e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:57.963116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17cef7-ee7b-4f5a-babc-cef4811533e7 admin admin] PATH_INFO: `/v3/users/f510b66b59084183a88e62c6d80d0fad` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:57.968234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17cef7-ee7b-4f5a-babc-cef4811533e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f510b66b59084183a88e62c6d80d0fad)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:57.968234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17cef7-ee7b-4f5a-babc-cef4811533e7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:58.045218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:58.138504 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4c17cef7-ee7b-4f5a-babc-cef4811533e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f510b66b59084183a88e62c6d80d0fad'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:58.139201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4c17cef7-ee7b-4f5a-babc-cef4811533e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f510b66b59084183a88e62c6d80d0fad'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:58.198421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4c17cef7-ee7b-4f5a-babc-cef4811533e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f510b66b59084183a88e62c6d80d0fad'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:58.199673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4c17cef7-ee7b-4f5a-babc-cef4811533e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f510b66b59084183a88e62c6d80d0fad'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:58.208352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4c17cef7-ee7b-4f5a-babc-cef4811533e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f510b66b59084183a88e62c6d80d0fad'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:58.238837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1177/2325] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:24:57 2022] DELETE /identity/v3/users/f510b66b59084183a88e62c6d80d0fad => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:24:58.859457 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:58.861099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:58.875077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af19db-aaac-4781-b2d2-4dba32a63b34 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:58.935099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:58.935746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:58.936010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:58.936282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] PATH_INFO: `/v3/projects/6383af35d90a45cbac974e8ff9f884cd` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:58.937397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6383af35d90a45cbac974e8ff9f884cd)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:58.939361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:59.072498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6383af35d90a45cbac974e8ff9f884cd', 'request_id': 'req-225bd32d-e092-45b8-b2f3-ed4f04e8498e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:59.078311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6383af35d90a45cbac974e8ff9f884cd', 'request_id': 'req-225bd32d-e092-45b8-b2f3-ed4f04e8498e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:59.085249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6383af35d90a45cbac974e8ff9f884cd', 'request_id': 'req-225bd32d-e092-45b8-b2f3-ed4f04e8498e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:59.152698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] The token cache is being invalidate because project 6383af35d90a45cbac974e8ff9f884cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:24:59.153209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:59.153775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-225bd32d-e092-45b8-b2f3-ed4f04e8498e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:24:59.155598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1149/2326] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:24:58 2022] DELETE /identity/v3/projects/6383af35d90a45cbac974e8ff9f884cd => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:24:59.160995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9e80a-849e-4195-864f-9003d6d71007 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:59.161549 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9e80a-849e-4195-864f-9003d6d71007 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:59.161631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9e80a-849e-4195-864f-9003d6d71007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:59.183968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fad9e80a-849e-4195-864f-9003d6d71007 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:24:59.185457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fad9e80a-849e-4195-864f-9003d6d71007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:59.250180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1178/2327] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:24:59.258642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f40c4-4d3b-42b2-8861-32c5665af4cd None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:59.258962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f40c4-4d3b-42b2-8861-32c5665af4cd None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:59.259247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f40c4-4d3b-42b2-8861-32c5665af4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:59.281794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-2a5f40c4-4d3b-42b2-8861-32c5665af4cd None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:24:59.283435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2a5f40c4-4d3b-42b2-8861-32c5665af4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:59.293493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1150/2328] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:24:59.297743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9e80a-849e-4195-864f-9003d6d71007 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:59.308783 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9e80a-849e-4195-864f-9003d6d71007 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:59.313946 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d24106-4ffc-407a-8e40-353e46738ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:59.315035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24106-4ffc-407a-8e40-353e46738ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:59.315219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24106-4ffc-407a-8e40-353e46738ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:59.315589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24106-4ffc-407a-8e40-353e46738ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:59.317015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d24106-4ffc-407a-8e40-353e46738ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:24:59.317405 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d24106-4ffc-407a-8e40-353e46738ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:59.319101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d24106-4ffc-407a-8e40-353e46738ac9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:59.331195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1179/2329] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:24:59.339805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f40c4-4d3b-42b2-8861-32c5665af4cd None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:59.349189 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f40c4-4d3b-42b2-8861-32c5665af4cd None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:59.353853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6452f-4cae-4848-aab3-b8ee5f8e5732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:59.354447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6452f-4cae-4848-aab3-b8ee5f8e5732 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:59.354759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6452f-4cae-4848-aab3-b8ee5f8e5732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:59.355033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6452f-4cae-4848-aab3-b8ee5f8e5732 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:59.355665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6452f-4cae-4848-aab3-b8ee5f8e5732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:59.357574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6452f-4cae-4848-aab3-b8ee5f8e5732 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:59.448665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1151/2330] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:24:59 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:24:59.449925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d24106-4ffc-407a-8e40-353e46738ac9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:59.461294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d24106-4ffc-407a-8e40-353e46738ac9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:59.520149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd899976-b4e3-4b16-adcb-ffc650d817dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:59.520756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd899976-b4e3-4b16-adcb-ffc650d817dd admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:59.521035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd899976-b4e3-4b16-adcb-ffc650d817dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:59.521307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd899976-b4e3-4b16-adcb-ffc650d817dd admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:59.521935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd899976-b4e3-4b16-adcb-ffc650d817dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:59.523914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd899976-b4e3-4b16-adcb-ffc650d817dd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:59.620843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1180/2331] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:24:59 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:24:59.624903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6452f-4cae-4848-aab3-b8ee5f8e5732 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:59.635568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6452f-4cae-4848-aab3-b8ee5f8e5732 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:59.640431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca8ae1-e777-406d-b2c5-df4a2df809f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:59.641222 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8ae1-e777-406d-b2c5-df4a2df809f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:59.641500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8ae1-e777-406d-b2c5-df4a2df809f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:59.641773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca8ae1-e777-406d-b2c5-df4a2df809f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:59.642425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca8ae1-e777-406d-b2c5-df4a2df809f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:59.644755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca8ae1-e777-406d-b2c5-df4a2df809f4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:59.655217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1152/2332] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:24:59.658948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd899976-b4e3-4b16-adcb-ffc650d817dd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:59.669921 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd899976-b4e3-4b16-adcb-ffc650d817dd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:59.674772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203f944-06cd-47b6-a3cc-30497289089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:59.675456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f944-06cd-47b6-a3cc-30497289089b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:59.675826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f944-06cd-47b6-a3cc-30497289089b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:59.676101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f944-06cd-47b6-a3cc-30497289089b admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:59.676765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203f944-06cd-47b6-a3cc-30497289089b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:59.678340 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203f944-06cd-47b6-a3cc-30497289089b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:59.689188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1181/2333] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:24:59.693359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca8ae1-e777-406d-b2c5-df4a2df809f4 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:59.704251 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca8ae1-e777-406d-b2c5-df4a2df809f4 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:59.709628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c996c-65f5-41fe-b06f-17d0c59175ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:59.710282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c996c-65f5-41fe-b06f-17d0c59175ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:59.710560 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c996c-65f5-41fe-b06f-17d0c59175ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:59.710900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c996c-65f5-41fe-b06f-17d0c59175ae admin admin] PATH_INFO: `/v3/projects/f5697f3f6259404b949c8d67333d1938/users/47385dc912d34db290fcf24ec196c97b/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:59.726477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c996c-65f5-41fe-b06f-17d0c59175ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5697f3f6259404b949c8d67333d1938, user_id=47385dc912d34db290fcf24ec196c97b, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:59.729233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c996c-65f5-41fe-b06f-17d0c59175ae admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:59.793429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:59.798496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1153/2334] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:24:59 2022] PUT /identity/v3/projects/f5697f3f6259404b949c8d67333d1938/users/47385dc912d34db290fcf24ec196c97b/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:24:59.803536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9832a-1239-404b-a862-8f076c1cb9d7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:59.808267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9832a-1239-404b-a862-8f076c1cb9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:59.808267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9832a-1239-404b-a862-8f076c1cb9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:59.823104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ccc9832a-1239-404b-a862-8f076c1cb9d7 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:24:59.824376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ccc9832a-1239-404b-a862-8f076c1cb9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:59.828772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:24:59.890144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1182/2335] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:24:59.900416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c996c-65f5-41fe-b06f-17d0c59175ae admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:24:59.902281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f35c996c-65f5-41fe-b06f-17d0c59175ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:24:59.967005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c996c-65f5-41fe-b06f-17d0c59175ae admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:24:59.971287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d84cb-ac7c-442d-afce-34dc44cd9950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:24:59.971889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d84cb-ac7c-442d-afce-34dc44cd9950 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:24:59.972898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d84cb-ac7c-442d-afce-34dc44cd9950 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:24:59.973177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d84cb-ac7c-442d-afce-34dc44cd9950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:24:59.984353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d84cb-ac7c-442d-afce-34dc44cd9950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:24:59.987333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d84cb-ac7c-442d-afce-34dc44cd9950 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:24:59.999759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1154/2336] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:25:01.268079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd456e44-fc6f-483e-a0fa-0c0550efffd6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:01.268591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd456e44-fc6f-483e-a0fa-0c0550efffd6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:01.268704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd456e44-fc6f-483e-a0fa-0c0550efffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:01.298333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cd456e44-fc6f-483e-a0fa-0c0550efffd6 None None] MFA Rules not processed for user `47385dc912d34db290fcf24ec196c97b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:01.299646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cd456e44-fc6f-483e-a0fa-0c0550efffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:01.367518 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1183/2337] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:01.372064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d84cb-ac7c-442d-afce-34dc44cd9950 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:01.381685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d84cb-ac7c-442d-afce-34dc44cd9950 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:01.386535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ba05d-7c38-4cfb-818f-d61f6e3a733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:01.387198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba05d-7c38-4cfb-818f-d61f6e3a733d admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:01.387481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba05d-7c38-4cfb-818f-d61f6e3a733d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:01.387758 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba05d-7c38-4cfb-818f-d61f6e3a733d admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:01.388398 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ba05d-7c38-4cfb-818f-d61f6e3a733d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:01.390384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ba05d-7c38-4cfb-818f-d61f6e3a733d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:01.468158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1155/2338] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:25:01 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:25:01.472852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd456e44-fc6f-483e-a0fa-0c0550efffd6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:01.483741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd456e44-fc6f-483e-a0fa-0c0550efffd6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:01.540208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e4bc0-0ab8-4c6c-ac75-35ac5228422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:01.540820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e4bc0-0ab8-4c6c-ac75-35ac5228422c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:01.541104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e4bc0-0ab8-4c6c-ac75-35ac5228422c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:01.541374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e4bc0-0ab8-4c6c-ac75-35ac5228422c admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:01.542026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e4bc0-0ab8-4c6c-ac75-35ac5228422c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:01.544252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e4bc0-0ab8-4c6c-ac75-35ac5228422c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:01.626555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1184/2339] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:25:01 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:25:01.631152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ba05d-7c38-4cfb-818f-d61f6e3a733d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:01.642129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ba05d-7c38-4cfb-818f-d61f6e3a733d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:01.647416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf37a12-a5aa-4591-a043-9eed4cfe73c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:01.648022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf37a12-a5aa-4591-a043-9eed4cfe73c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:01.648306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf37a12-a5aa-4591-a043-9eed4cfe73c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:01.648583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf37a12-a5aa-4591-a043-9eed4cfe73c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:01.649231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf37a12-a5aa-4591-a043-9eed4cfe73c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:01.650901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf37a12-a5aa-4591-a043-9eed4cfe73c2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:01.661705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1156/2340] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:25:01.665918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e4bc0-0ab8-4c6c-ac75-35ac5228422c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:01.683770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e4bc0-0ab8-4c6c-ac75-35ac5228422c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:01.688494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed04fac-a913-4d90-a34f-8297e7e0dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:01.689144 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed04fac-a913-4d90-a34f-8297e7e0dd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:01.689417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed04fac-a913-4d90-a34f-8297e7e0dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:01.689683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed04fac-a913-4d90-a34f-8297e7e0dd46 admin admin] PATH_INFO: `/v3/projects/0ee033d7542e4f969dc97f2f44e9fb52/users/def75ad079364bda809192afb82af4ab/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:01.705090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed04fac-a913-4d90-a34f-8297e7e0dd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee033d7542e4f969dc97f2f44e9fb52, user_id=def75ad079364bda809192afb82af4ab, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:01.708437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed04fac-a913-4d90-a34f-8297e7e0dd46 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:01.808927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1185/2341] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:25:01 2022] PUT /identity/v3/projects/0ee033d7542e4f969dc97f2f44e9fb52/users/def75ad079364bda809192afb82af4ab/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:01.812979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf37a12-a5aa-4591-a043-9eed4cfe73c2 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:01.823590 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf37a12-a5aa-4591-a043-9eed4cfe73c2 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:01.878156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc133fb3-d720-4103-905c-42f749231d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:01.879483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133fb3-d720-4103-905c-42f749231d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:01.886644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133fb3-d720-4103-905c-42f749231d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:01.886644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133fb3-d720-4103-905c-42f749231d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:01.886644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc133fb3-d720-4103-905c-42f749231d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:01.886644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc133fb3-d720-4103-905c-42f749231d4f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:01.891728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1157/2342] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:25:01.896173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed04fac-a913-4d90-a34f-8297e7e0dd46 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:01.902803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:01.906537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed04fac-a913-4d90-a34f-8297e7e0dd46 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:01.911327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551ee13-c16b-4200-9b87-2f4a39174c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:01.911999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ee13-c16b-4200-9b87-2f4a39174c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:01.912336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ee13-c16b-4200-9b87-2f4a39174c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:01.912608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ee13-c16b-4200-9b87-2f4a39174c53 admin admin] PATH_INFO: `/v3/projects/0ee033d7542e4f969dc97f2f44e9fb52/users/def75ad079364bda809192afb82af4ab/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:01.914536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551ee13-c16b-4200-9b87-2f4a39174c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee033d7542e4f969dc97f2f44e9fb52, user_id=def75ad079364bda809192afb82af4ab, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:01.917241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551ee13-c16b-4200-9b87-2f4a39174c53 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:01.928029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1186/2343] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:25:01 2022] PUT /identity/v3/projects/0ee033d7542e4f969dc97f2f44e9fb52/users/def75ad079364bda809192afb82af4ab/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:03.095583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc2d79-3b60-4a74-9e16-cd2e6db28bab None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:03.096122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc2d79-3b60-4a74-9e16-cd2e6db28bab None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:03.096269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc2d79-3b60-4a74-9e16-cd2e6db28bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:03.125051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b6bc2d79-3b60-4a74-9e16-cd2e6db28bab None None] MFA Rules not processed for user `def75ad079364bda809192afb82af4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:03.126279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b6bc2d79-3b60-4a74-9e16-cd2e6db28bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:03.179810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:03.198160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1158/2344] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:03.210399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14845f43-0bbe-406c-9f5e-4e46a666a61a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:03.210880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14845f43-0bbe-406c-9f5e-4e46a666a61a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:03.210994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14845f43-0bbe-406c-9f5e-4e46a666a61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:03.230099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-14845f43-0bbe-406c-9f5e-4e46a666a61a None None] MFA Rules not processed for user `47385dc912d34db290fcf24ec196c97b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:03.231872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-14845f43-0bbe-406c-9f5e-4e46a666a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:03.284954 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1187/2345] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:03.296225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc2d79-3b60-4a74-9e16-cd2e6db28bab None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:03.297732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b6bc2d79-3b60-4a74-9e16-cd2e6db28bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:03.369410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc2d79-3b60-4a74-9e16-cd2e6db28bab None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:03.374965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4dfd-7b8a-4b14-bdc1-e4ca64843222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:03.375569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4dfd-7b8a-4b14-bdc1-e4ca64843222 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:03.375844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4dfd-7b8a-4b14-bdc1-e4ca64843222 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:03.376111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4dfd-7b8a-4b14-bdc1-e4ca64843222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:03.384772 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e4dfd-7b8a-4b14-bdc1-e4ca64843222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:03.386406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e4dfd-7b8a-4b14-bdc1-e4ca64843222 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:03.395275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1159/2346] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:25:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:25:13.278350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=28,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:13.391199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=38 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:18.194645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14af899-c29c-403f-a1ba-391ed9be4354 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:18.200724 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14af899-c29c-403f-a1ba-391ed9be4354 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:18.200724 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14af899-c29c-403f-a1ba-391ed9be4354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:18.215265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f14af899-c29c-403f-a1ba-391ed9be4354 None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:18.216521 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f14af899-c29c-403f-a1ba-391ed9be4354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:18.272374 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1188/2347] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:18.436229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4dfd-7b8a-4b14-bdc1-e4ca64843222 service nova] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:18.437755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1e9e4dfd-7b8a-4b14-bdc1-e4ca64843222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:18.510553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4dfd-7b8a-4b14-bdc1-e4ca64843222 service nova] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:18.515995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f7cf9-e0f2-4a6e-88a5-b4618370ef15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:18.516605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7cf9-e0f2-4a6e-88a5-b4618370ef15 service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:18.516882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7cf9-e0f2-4a6e-88a5-b4618370ef15 service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:18.517159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f7cf9-e0f2-4a6e-88a5-b4618370ef15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:18.525535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f7cf9-e0f2-4a6e-88a5-b4618370ef15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:18.527103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f7cf9-e0f2-4a6e-88a5-b4618370ef15 service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:18.535641 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1160/2348] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:25:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:25:21.874312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14af899-c29c-403f-a1ba-391ed9be4354 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:21.875874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f14af899-c29c-403f-a1ba-391ed9be4354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:21.963417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14af899-c29c-403f-a1ba-391ed9be4354 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:21.967791 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fde7f-9b98-4d09-bf05-bbf869683247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:21.968492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fde7f-9b98-4d09-bf05-bbf869683247 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:21.968922 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fde7f-9b98-4d09-bf05-bbf869683247 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:21.969265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fde7f-9b98-4d09-bf05-bbf869683247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:21.991698 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fde7f-9b98-4d09-bf05-bbf869683247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:21.991961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fde7f-9b98-4d09-bf05-bbf869683247 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:22.007197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1189/2349] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:25:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:25:28.532599 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=32 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:31.998480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=51 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:37.891000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6289a4-8be0-4863-ade2-11d15fd21d42 None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:37.891527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6289a4-8be0-4863-ade2-11d15fd21d42 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:37.891527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6289a4-8be0-4863-ade2-11d15fd21d42 None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:37.892852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1161/2350] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:25:37.898587 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753660b-7e2f-4f96-a584-e31224a2d1ce None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:37.899011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753660b-7e2f-4f96-a584-e31224a2d1ce None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:37.899168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753660b-7e2f-4f96-a584-e31224a2d1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:37.968235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f753660b-7e2f-4f96-a584-e31224a2d1ce None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:37.969522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f753660b-7e2f-4f96-a584-e31224a2d1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:38.038479 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1190/2351] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:25:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:25:38.050368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6289a4-8be0-4863-ade2-11d15fd21d42 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:38.052638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7f6289a4-8be0-4863-ade2-11d15fd21d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:38.109098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6289a4-8be0-4863-ade2-11d15fd21d42 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:38.112616 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ba43e-6d49-402d-8d95-15bc8a980f9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0892bfab3ce435b90b93b0786899f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:38.113211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ba43e-6d49-402d-8d95-15bc8a980f9e service glance] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:38.113491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ba43e-6d49-402d-8d95-15bc8a980f9e service glance] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:38.113771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ba43e-6d49-402d-8d95-15bc8a980f9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:38.124242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ba43e-6d49-402d-8d95-15bc8a980f9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:38.125665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ba43e-6d49-402d-8d95-15bc8a980f9e service glance] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:38.136960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1162/2352] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:25:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:25:38.341370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537a80c-3ea7-4579-af40-b3fa99e9ded8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:38.341654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537a80c-3ea7-4579-af40-b3fa99e9ded8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:38.341932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537a80c-3ea7-4579-af40-b3fa99e9ded8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:38.343351 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1191/2353] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:25:38.348049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a694-506a-47de-9420-6b5ff042c580 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:38.348329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a694-506a-47de-9420-6b5ff042c580 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:38.349128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a694-506a-47de-9420-6b5ff042c580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:38.369202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3d06a694-506a-47de-9420-6b5ff042c580 None None] MFA Rules not processed for user `e08c9de660c04ed98f6100be2d687ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:38.370398 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3d06a694-506a-47de-9420-6b5ff042c580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:38.420759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1163/2354] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:25:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:38.433184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537a80c-3ea7-4579-af40-b3fa99e9ded8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:38.434947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7537a80c-3ea7-4579-af40-b3fa99e9ded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:38.448055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537a80c-3ea7-4579-af40-b3fa99e9ded8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:38.451763 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41ead4-1227-4f81-8455-67accd66cdce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:38.452359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41ead4-1227-4f81-8455-67accd66cdce service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:38.452637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41ead4-1227-4f81-8455-67accd66cdce service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:38.452908 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41ead4-1227-4f81-8455-67accd66cdce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:38.460067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41ead4-1227-4f81-8455-67accd66cdce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:38.461490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41ead4-1227-4f81-8455-67accd66cdce service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:38.469412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1192/2355] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:25:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:25:38.552282 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713bb93-89de-4c94-91c4-243f771c0a4e None None] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:38.552565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713bb93-89de-4c94-91c4-243f771c0a4e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:38.552833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713bb93-89de-4c94-91c4-243f771c0a4e None None] PATH_INFO: `/` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:38.554151 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1164/2356] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:25:38.559747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f7562-bd91-4782-950f-862e0243ff05 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:38.560150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f7562-bd91-4782-950f-862e0243ff05 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:38.560487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f7562-bd91-4782-950f-862e0243ff05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:38.580903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bb5f7562-bd91-4782-950f-862e0243ff05 None None] MFA Rules not processed for user `41f7a6292d004a648c3c92526d1304ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:38.582196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bb5f7562-bd91-4782-950f-862e0243ff05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:38.592215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1193/2357] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:25:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:38.603694 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713bb93-89de-4c94-91c4-243f771c0a4e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:38.614547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713bb93-89de-4c94-91c4-243f771c0a4e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:38.618131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1023-b01b-4ed0-bd38-48557c791779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:38.618800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1023-b01b-4ed0-bd38-48557c791779 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:38.619079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1023-b01b-4ed0-bd38-48557c791779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:38.619347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1023-b01b-4ed0-bd38-48557c791779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:38.629397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b1023-b01b-4ed0-bd38-48557c791779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:38.630952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b1023-b01b-4ed0-bd38-48557c791779 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:38.641490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1165/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:25:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:25:41.135840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c528c-699c-41c9-83ce-b5f3949e03eb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:41.142564 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c528c-699c-41c9-83ce-b5f3949e03eb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:41.142564 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c528c-699c-41c9-83ce-b5f3949e03eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:41.156197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7f1c528c-699c-41c9-83ce-b5f3949e03eb None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:41.157396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7f1c528c-699c-41c9-83ce-b5f3949e03eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:41.165108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1194/2359] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:25:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:41.179610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1023-b01b-4ed0-bd38-48557c791779 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:41.191651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1023-b01b-4ed0-bd38-48557c791779 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:41.197190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41173a60-706e-4640-942f-8c0345aba458 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:41.197790 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41173a60-706e-4640-942f-8c0345aba458 service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:41.198067 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41173a60-706e-4640-942f-8c0345aba458 service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:41.198333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41173a60-706e-4640-942f-8c0345aba458 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:41.207051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41173a60-706e-4640-942f-8c0345aba458 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:41.208682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41173a60-706e-4640-942f-8c0345aba458 service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:41.217079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1166/2360] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:25:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:25:45.985297 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70764d-9544-428b-bb80-eb2be7f4b10e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:45.985861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70764d-9544-428b-bb80-eb2be7f4b10e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:45.985861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70764d-9544-428b-bb80-eb2be7f4b10e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:45.987348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1195/2361] 10.222.0.23 () {54 vars in 921 bytes} [Thu Sep 8 16:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 16:25:46.008945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bdc8b-e177-48fb-bf4f-cfab1603f49c None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:46.009481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bdc8b-e177-48fb-bf4f-cfab1603f49c None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:46.009481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bdc8b-e177-48fb-bf4f-cfab1603f49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:46.066652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0b7bdc8b-e177-48fb-bf4f-cfab1603f49c None None] MFA Rules not processed for user `7e6c855e2692410d83c78cc95cb4f37e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:46.068921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0b7bdc8b-e177-48fb-bf4f-cfab1603f49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:46.126102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:46.161385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1167/2362] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Sep 8 16:25:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:46.179271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70764d-9544-428b-bb80-eb2be7f4b10e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:46.181572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5f70764d-9544-428b-bb80-eb2be7f4b10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:46.204580 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70764d-9544-428b-bb80-eb2be7f4b10e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:46.214180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3b647-7622-4402-86e7-8b664cca5ea2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:46.215028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b647-7622-4402-86e7-8b664cca5ea2 service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:46.215368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b647-7622-4402-86e7-8b664cca5ea2 service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:46.216427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b647-7622-4402-86e7-8b664cca5ea2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:46.228798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3b647-7622-4402-86e7-8b664cca5ea2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:46.230507 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3b647-7622-4402-86e7-8b664cca5ea2 service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:46.243044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1196/2363] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:25:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:25:46.908896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bdc8b-e177-48fb-bf4f-cfab1603f49c None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:46.997378 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bdc8b-e177-48fb-bf4f-cfab1603f49c None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:47.002205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:47.002894 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:47.003170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:47.003441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] PATH_INFO: `/v3/users/47385dc912d34db290fcf24ec196c97b` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:47.004565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47385dc912d34db290fcf24ec196c97b)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:47.006554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:47.203609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47385dc912d34db290fcf24ec196c97b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:47.204310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47385dc912d34db290fcf24ec196c97b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:47.272955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47385dc912d34db290fcf24ec196c97b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:47.273553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47385dc912d34db290fcf24ec196c97b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:47.281109 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47385dc912d34db290fcf24ec196c97b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:47.304347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1168/2364] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:25:46 2022] DELETE /identity/v3/users/47385dc912d34db290fcf24ec196c97b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:47.581348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3b647-7622-4402-86e7-8b664cca5ea2 service placement] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:47.611634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3b647-7622-4402-86e7-8b664cca5ea2 service placement] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:47.674476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:47.675151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:47.675430 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:47.675704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] PATH_INFO: `/v3/projects/f5697f3f6259404b949c8d67333d1938` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:47.676823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5697f3f6259404b949c8d67333d1938)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:47.679307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:47.706425 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:47.791546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5697f3f6259404b949c8d67333d1938', 'request_id': 'req-aeb72e51-b31e-465a-90ff-0ff0c08eda62'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:47.798047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5697f3f6259404b949c8d67333d1938', 'request_id': 'req-aeb72e51-b31e-465a-90ff-0ff0c08eda62'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:47.804877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5697f3f6259404b949c8d67333d1938', 'request_id': 'req-aeb72e51-b31e-465a-90ff-0ff0c08eda62'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:47.886302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] The token cache is being invalidate because project f5697f3f6259404b949c8d67333d1938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:25:47.886519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:47.887201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:47.888692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1197/2365] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:25:47 2022] DELETE /identity/v3/projects/f5697f3f6259404b949c8d67333d1938 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:47.892709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:47.894386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:47.908221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd16334-624d-46ce-bfca-6d3b915dc1b9 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:47.984454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:47.994850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62b42f-b991-48d5-8c32-fa3a9aa6e980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:47.995479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b42f-b991-48d5-8c32-fa3a9aa6e980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:47.995776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b42f-b991-48d5-8c32-fa3a9aa6e980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:47.996043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62b42f-b991-48d5-8c32-fa3a9aa6e980 admin admin] PATH_INFO: `/v3/users/def75ad079364bda809192afb82af4ab` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:47.997190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62b42f-b991-48d5-8c32-fa3a9aa6e980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def75ad079364bda809192afb82af4ab)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:47.999277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62b42f-b991-48d5-8c32-fa3a9aa6e980 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:48.196321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-de62b42f-b991-48d5-8c32-fa3a9aa6e980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def75ad079364bda809192afb82af4ab'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:48.197614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-de62b42f-b991-48d5-8c32-fa3a9aa6e980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def75ad079364bda809192afb82af4ab'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:48.283442 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-de62b42f-b991-48d5-8c32-fa3a9aa6e980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def75ad079364bda809192afb82af4ab'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:48.284119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-de62b42f-b991-48d5-8c32-fa3a9aa6e980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def75ad079364bda809192afb82af4ab'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:48.298049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-de62b42f-b991-48d5-8c32-fa3a9aa6e980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def75ad079364bda809192afb82af4ab'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:48.312532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1169/2366] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:25:47 2022] DELETE /identity/v3/users/def75ad079364bda809192afb82af4ab => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:48.576343 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:48.577820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:48.611164 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb72e51-b31e-465a-90ff-0ff0c08eda62 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:48.672444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:48.673081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:48.673357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:48.673636 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] PATH_INFO: `/v3/projects/0ee033d7542e4f969dc97f2f44e9fb52` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:48.674933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee033d7542e4f969dc97f2f44e9fb52)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:48.676998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:48.803957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee033d7542e4f969dc97f2f44e9fb52', 'request_id': 'req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:48.811749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee033d7542e4f969dc97f2f44e9fb52', 'request_id': 'req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:48.819674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee033d7542e4f969dc97f2f44e9fb52', 'request_id': 'req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:48.884324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] The token cache is being invalidate because project 0ee033d7542e4f969dc97f2f44e9fb52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:25:48.884686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:48.885440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ef25e06a-8da3-4a11-8a22-6d342a4eaa4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:48.887025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1198/2367] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:25:48 2022] DELETE /identity/v3/projects/0ee033d7542e4f969dc97f2f44e9fb52 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:48.891930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc274f1-ddf8-476a-a637-7cd2791f1359 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:48.892209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc274f1-ddf8-476a-a637-7cd2791f1359 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:48.892481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc274f1-ddf8-476a-a637-7cd2791f1359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:48.941920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-1cc274f1-ddf8-476a-a637-7cd2791f1359 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:48.943819 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1cc274f1-ddf8-476a-a637-7cd2791f1359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:49.012765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1170/2368] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:49.020426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e80f9c-4f17-46c6-8e59-a107d175fdaa None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:49.020730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e80f9c-4f17-46c6-8e59-a107d175fdaa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:49.021011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e80f9c-4f17-46c6-8e59-a107d175fdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:49.057750 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f4e80f9c-4f17-46c6-8e59-a107d175fdaa None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:49.060224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f4e80f9c-4f17-46c6-8e59-a107d175fdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:49.068875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1199/2369] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:49.073145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc274f1-ddf8-476a-a637-7cd2791f1359 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:49.084196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc274f1-ddf8-476a-a637-7cd2791f1359 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:49.089153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9207ce0-8b32-448f-8e71-3f86b7e80863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:49.089895 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9207ce0-8b32-448f-8e71-3f86b7e80863 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:49.090286 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9207ce0-8b32-448f-8e71-3f86b7e80863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:49.090656 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9207ce0-8b32-448f-8e71-3f86b7e80863 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:49.091445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9207ce0-8b32-448f-8e71-3f86b7e80863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:25:49.091851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9207ce0-8b32-448f-8e71-3f86b7e80863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:49.093720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9207ce0-8b32-448f-8e71-3f86b7e80863 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:49.106242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1171/2370] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:25:49.113988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e80f9c-4f17-46c6-8e59-a107d175fdaa None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:49.125820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e80f9c-4f17-46c6-8e59-a107d175fdaa None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:49.132341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69932208-a6db-49cb-83a3-d1d5099682ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:49.132341 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932208-a6db-49cb-83a3-d1d5099682ea admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:49.132652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932208-a6db-49cb-83a3-d1d5099682ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:49.132735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932208-a6db-49cb-83a3-d1d5099682ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:49.133439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69932208-a6db-49cb-83a3-d1d5099682ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:49.135568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69932208-a6db-49cb-83a3-d1d5099682ea admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:49.468620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1200/2371] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:25:49 2022] POST /identity/v3/projects => generated 359 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:25:49.472888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9207ce0-8b32-448f-8e71-3f86b7e80863 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:49.485172 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9207ce0-8b32-448f-8e71-3f86b7e80863 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:49.519700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:49.544213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd436604-1a28-4511-9c7d-be9ce3bd492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:49.545094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd436604-1a28-4511-9c7d-be9ce3bd492f admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:49.545370 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd436604-1a28-4511-9c7d-be9ce3bd492f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:49.545642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd436604-1a28-4511-9c7d-be9ce3bd492f admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:49.546289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd436604-1a28-4511-9c7d-be9ce3bd492f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:49.548252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd436604-1a28-4511-9c7d-be9ce3bd492f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:49.621197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1172/2372] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:25:49 2022] POST /identity/v3/users => generated 280 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:25:49.625305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69932208-a6db-49cb-83a3-d1d5099682ea admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:49.632326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:49.638251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69932208-a6db-49cb-83a3-d1d5099682ea admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:49.644120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ceed8-ef34-4529-b699-9ca186ce7358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:49.644977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ceed8-ef34-4529-b699-9ca186ce7358 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:49.645368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ceed8-ef34-4529-b699-9ca186ce7358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:49.645817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ceed8-ef34-4529-b699-9ca186ce7358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:49.646606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ceed8-ef34-4529-b699-9ca186ce7358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:49.648391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ceed8-ef34-4529-b699-9ca186ce7358 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:49.659128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1201/2373] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:25:49.663841 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd436604-1a28-4511-9c7d-be9ce3bd492f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:49.674094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd436604-1a28-4511-9c7d-be9ce3bd492f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:49.679388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55883fcf-c81f-4476-abdc-3f72a5fc4937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:49.679931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55883fcf-c81f-4476-abdc-3f72a5fc4937 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:49.680211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55883fcf-c81f-4476-abdc-3f72a5fc4937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:49.680481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55883fcf-c81f-4476-abdc-3f72a5fc4937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:49.681114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55883fcf-c81f-4476-abdc-3f72a5fc4937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:49.682753 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55883fcf-c81f-4476-abdc-3f72a5fc4937 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:49.693182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1173/2374] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:25:49.697440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ceed8-ef34-4529-b699-9ca186ce7358 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:49.711103 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ceed8-ef34-4529-b699-9ca186ce7358 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:49.716209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e7b27-ed05-4fac-b7c3-76f4fde7c16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:49.717044 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e7b27-ed05-4fac-b7c3-76f4fde7c16d admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:49.717562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e7b27-ed05-4fac-b7c3-76f4fde7c16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:49.718012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e7b27-ed05-4fac-b7c3-76f4fde7c16d admin admin] PATH_INFO: `/v3/projects/384eac94c7cc40fb9ffc083da3644679/users/2d1b68b030f54b8bb4e57429cc0edb3e/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:49.735264 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e7b27-ed05-4fac-b7c3-76f4fde7c16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=384eac94c7cc40fb9ffc083da3644679, user_id=2d1b68b030f54b8bb4e57429cc0edb3e, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:49.737942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e7b27-ed05-4fac-b7c3-76f4fde7c16d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:49.810691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1202/2375] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:25:49 2022] PUT /identity/v3/projects/384eac94c7cc40fb9ffc083da3644679/users/2d1b68b030f54b8bb4e57429cc0edb3e/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:49.823850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf75d7-1330-4201-a9a4-f55a14a3197f None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:49.824209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf75d7-1330-4201-a9a4-f55a14a3197f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:49.824551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf75d7-1330-4201-a9a4-f55a14a3197f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:49.856281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-99bf75d7-1330-4201-a9a4-f55a14a3197f None None] MFA Rules not processed for user `2d1b68b030f54b8bb4e57429cc0edb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:49.865761 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-99bf75d7-1330-4201-a9a4-f55a14a3197f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:49.962027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1174/2376] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:49.999223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e7b27-ed05-4fac-b7c3-76f4fde7c16d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:50.007965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f53e7b27-ed05-4fac-b7c3-76f4fde7c16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:50.070262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e7b27-ed05-4fac-b7c3-76f4fde7c16d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:50.074220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a34915-0bb1-4893-a1b5-769e78009ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:50.074993 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34915-0bb1-4893-a1b5-769e78009ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:50.075362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34915-0bb1-4893-a1b5-769e78009ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:50.075729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34915-0bb1-4893-a1b5-769e78009ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:50.085511 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a34915-0bb1-4893-a1b5-769e78009ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:50.086975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a34915-0bb1-4893-a1b5-769e78009ee2 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:50.095810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1203/2377] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:25:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:25:50.111707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf75d7-1330-4201-a9a4-f55a14a3197f None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:50.177407 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf75d7-1330-4201-a9a4-f55a14a3197f None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:50.182127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:50.182788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:50.183068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:50.183348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] PATH_INFO: `/v3/users/2d1b68b030f54b8bb4e57429cc0edb3e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:50.184487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1b68b030f54b8bb4e57429cc0edb3e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:50.186427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:50.399699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:50.401369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1b68b030f54b8bb4e57429cc0edb3e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:50.402069 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1b68b030f54b8bb4e57429cc0edb3e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:50.488944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1b68b030f54b8bb4e57429cc0edb3e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:50.490638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1b68b030f54b8bb4e57429cc0edb3e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:50.498658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1b68b030f54b8bb4e57429cc0edb3e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:50.517572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1175/2378] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:25:50 2022] DELETE /identity/v3/users/2d1b68b030f54b8bb4e57429cc0edb3e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:50.522125 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4fce-0c79-4d2e-bc7b-562ccca16c8e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:50.522408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4fce-0c79-4d2e-bc7b-562ccca16c8e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:50.522694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd4fce-0c79-4d2e-bc7b-562ccca16c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:50.543123 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d8fd4fce-0c79-4d2e-bc7b-562ccca16c8e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:50.544355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d8fd4fce-0c79-4d2e-bc7b-562ccca16c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:50.612583 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1204/2379] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:25:50.620052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:50.621497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:50.681091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91eaab9-fc7c-4a80-a748-98711077bb85 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:50.684726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21e6f7-d75d-4243-9886-cd9ddced94c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:50.685341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e6f7-d75d-4243-9886-cd9ddced94c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:50.685618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e6f7-d75d-4243-9886-cd9ddced94c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:50.685892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e6f7-d75d-4243-9886-cd9ddced94c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:50.696369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21e6f7-d75d-4243-9886-cd9ddced94c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:50.697838 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21e6f7-d75d-4243-9886-cd9ddced94c2 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:50.709459 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1176/2380] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:25:51.243542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd4fce-0c79-4d2e-bc7b-562ccca16c8e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:51.245599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d8fd4fce-0c79-4d2e-bc7b-562ccca16c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:51.260801 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd4fce-0c79-4d2e-bc7b-562ccca16c8e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:51.284395 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:51.285588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:51.286155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:51.287362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] PATH_INFO: `/v3/projects/384eac94c7cc40fb9ffc083da3644679` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:51.289121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=384eac94c7cc40fb9ffc083da3644679)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:51.291891 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:51.466909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384eac94c7cc40fb9ffc083da3644679', 'request_id': 'req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:51.472496 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384eac94c7cc40fb9ffc083da3644679', 'request_id': 'req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:51.479471 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384eac94c7cc40fb9ffc083da3644679', 'request_id': 'req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:51.482692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:51.581762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] The token cache is being invalidate because project 384eac94c7cc40fb9ffc083da3644679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:25:51.582042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:51.582694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ae2fc27-de53-4f32-a4d7-d595592bbd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:51.596957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1205/2381] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:25:51 2022] DELETE /identity/v3/projects/384eac94c7cc40fb9ffc083da3644679 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:25:51.597192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d68f8-421b-43a2-9e88-eaf4f4fd9509 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:51.597192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d68f8-421b-43a2-9e88-eaf4f4fd9509 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:51.597192 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d68f8-421b-43a2-9e88-eaf4f4fd9509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:51.616591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-4c4d68f8-421b-43a2-9e88-eaf4f4fd9509 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:51.621977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4c4d68f8-421b-43a2-9e88-eaf4f4fd9509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:51.682400 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1177/2382] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:25:51.690045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1566-b907-4631-a413-39b45500f508 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:51.690328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1566-b907-4631-a413-39b45500f508 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:51.690600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1566-b907-4631-a413-39b45500f508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:51.716201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8c1b1566-b907-4631-a413-39b45500f508 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:51.717832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8c1b1566-b907-4631-a413-39b45500f508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:51.726114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1206/2383] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:51.730492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d68f8-421b-43a2-9e88-eaf4f4fd9509 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:51.741519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d68f8-421b-43a2-9e88-eaf4f4fd9509 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:51.746888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef722-da23-4b3b-be95-0a35b1234c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:51.747666 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef722-da23-4b3b-be95-0a35b1234c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:51.747957 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef722-da23-4b3b-be95-0a35b1234c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:51.748230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef722-da23-4b3b-be95-0a35b1234c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:51.748892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aef722-da23-4b3b-be95-0a35b1234c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:25:51.749193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aef722-da23-4b3b-be95-0a35b1234c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:51.750842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aef722-da23-4b3b-be95-0a35b1234c6e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:51.763546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1178/2384] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:25:51.768089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b1566-b907-4631-a413-39b45500f508 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:51.777877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b1566-b907-4631-a413-39b45500f508 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:51.782505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abdd4c-2eed-48be-9c4e-088d32dde85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:51.783128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abdd4c-2eed-48be-9c4e-088d32dde85c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:51.783403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abdd4c-2eed-48be-9c4e-088d32dde85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:51.783673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abdd4c-2eed-48be-9c4e-088d32dde85c admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:51.784304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abdd4c-2eed-48be-9c4e-088d32dde85c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:51.786223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abdd4c-2eed-48be-9c4e-088d32dde85c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:51.885117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1207/2385] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:25:51 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:25:51.889219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef722-da23-4b3b-be95-0a35b1234c6e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:51.899824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef722-da23-4b3b-be95-0a35b1234c6e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:51.950439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:51.963944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651a9f9-2e5d-4930-9cb4-2f44c5b5a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:51.964553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651a9f9-2e5d-4930-9cb4-2f44c5b5a98c admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:51.964828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651a9f9-2e5d-4930-9cb4-2f44c5b5a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:51.965099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651a9f9-2e5d-4930-9cb4-2f44c5b5a98c admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:51.965737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651a9f9-2e5d-4930-9cb4-2f44c5b5a98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:51.967741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651a9f9-2e5d-4930-9cb4-2f44c5b5a98c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:52.285222 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1179/2386] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:25:51 2022] POST /identity/v3/users => generated 288 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:25:52.298940 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abdd4c-2eed-48be-9c4e-088d32dde85c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:52.311170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abdd4c-2eed-48be-9c4e-088d32dde85c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:52.316686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc8926-d306-4fcb-abc6-a847fefa4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:52.317360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc8926-d306-4fcb-abc6-a847fefa4bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:52.317710 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc8926-d306-4fcb-abc6-a847fefa4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:52.318645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc8926-d306-4fcb-abc6-a847fefa4bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:52.319390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc8926-d306-4fcb-abc6-a847fefa4bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:52.321078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc8926-d306-4fcb-abc6-a847fefa4bc5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:52.342358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1208/2387] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:25:52.345775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651a9f9-2e5d-4930-9cb4-2f44c5b5a98c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:52.357612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651a9f9-2e5d-4930-9cb4-2f44c5b5a98c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:52.362250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c8806-de43-44d2-abe1-e35b6ea7f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:52.362903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8806-de43-44d2-abe1-e35b6ea7f729 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:52.363180 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8806-de43-44d2-abe1-e35b6ea7f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:52.363451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c8806-de43-44d2-abe1-e35b6ea7f729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:52.364098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c8806-de43-44d2-abe1-e35b6ea7f729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:52.366253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c8806-de43-44d2-abe1-e35b6ea7f729 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:52.380203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1180/2388] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:25:52.386267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc8926-d306-4fcb-abc6-a847fefa4bc5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:52.397276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc8926-d306-4fcb-abc6-a847fefa4bc5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:52.409083 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746052ed-7de8-4086-9d62-f82082a73c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:52.409907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746052ed-7de8-4086-9d62-f82082a73c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:52.410260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746052ed-7de8-4086-9d62-f82082a73c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:52.410608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746052ed-7de8-4086-9d62-f82082a73c45 admin admin] PATH_INFO: `/v3/projects/e148cfe126f74693943602069a7e954d/users/e793ad1730fe412a926f5f5df83cb840/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:52.428898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746052ed-7de8-4086-9d62-f82082a73c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e148cfe126f74693943602069a7e954d, user_id=e793ad1730fe412a926f5f5df83cb840, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:52.431712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746052ed-7de8-4086-9d62-f82082a73c45 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:53.209793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1209/2389] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:25:52 2022] PUT /identity/v3/projects/e148cfe126f74693943602069a7e954d/users/e793ad1730fe412a926f5f5df83cb840/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:25:53.220814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aaa07-337e-401c-aaca-8a595df1deb3 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:53.221314 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aaa07-337e-401c-aaca-8a595df1deb3 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:53.221419 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aaa07-337e-401c-aaca-8a595df1deb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:53.248278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-d99aaa07-337e-401c-aaca-8a595df1deb3 None None] MFA Rules not processed for user `e793ad1730fe412a926f5f5df83cb840`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:53.249480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d99aaa07-337e-401c-aaca-8a595df1deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:53.315514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1181/2390] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:53.320522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746052ed-7de8-4086-9d62-f82082a73c45 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:53.383191 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746052ed-7de8-4086-9d62-f82082a73c45 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:53.387774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f146f-6c6b-490b-ae19-42238be62196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:53.388369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f146f-6c6b-490b-ae19-42238be62196 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:53.388643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f146f-6c6b-490b-ae19-42238be62196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:53.388910 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f146f-6c6b-490b-ae19-42238be62196 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:53.389560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f146f-6c6b-490b-ae19-42238be62196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:53.391446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f146f-6c6b-490b-ae19-42238be62196 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:53.456641 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1210/2391] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:25:53 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:25:53.461278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aaa07-337e-401c-aaca-8a595df1deb3 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:53.472273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aaa07-337e-401c-aaca-8a595df1deb3 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:53.527073 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f053ad-e75d-4e0c-9086-31b6fcf04501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:53.527685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f053ad-e75d-4e0c-9086-31b6fcf04501 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:53.527962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f053ad-e75d-4e0c-9086-31b6fcf04501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:53.528237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f053ad-e75d-4e0c-9086-31b6fcf04501 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:53.528872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f053ad-e75d-4e0c-9086-31b6fcf04501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:53.530822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f053ad-e75d-4e0c-9086-31b6fcf04501 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:53.601213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1182/2392] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:25:53 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:25:53.602688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f146f-6c6b-490b-ae19-42238be62196 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:53.613242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f146f-6c6b-490b-ae19-42238be62196 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:53.623526 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fca4d-7385-4c4c-838d-55bfc007e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:53.624242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fca4d-7385-4c4c-838d-55bfc007e20a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:53.624607 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fca4d-7385-4c4c-838d-55bfc007e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:53.624942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fca4d-7385-4c4c-838d-55bfc007e20a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:53.625762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fca4d-7385-4c4c-838d-55bfc007e20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:53.627460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fca4d-7385-4c4c-838d-55bfc007e20a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:53.638643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1211/2393] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:25:53.642912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f053ad-e75d-4e0c-9086-31b6fcf04501 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:53.653840 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f053ad-e75d-4e0c-9086-31b6fcf04501 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:53.658794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b2c6c-c524-4973-9348-2d023851aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:53.659396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2c6c-c524-4973-9348-2d023851aa42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:53.659671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2c6c-c524-4973-9348-2d023851aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:53.659943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2c6c-c524-4973-9348-2d023851aa42 admin admin] PATH_INFO: `/v3/projects/79484854e983447abf6bbe303132a76d/users/55a3a2fd929a4be8975f6d6f4fb2075b/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:53.675999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b2c6c-c524-4973-9348-2d023851aa42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79484854e983447abf6bbe303132a76d, user_id=55a3a2fd929a4be8975f6d6f4fb2075b, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:53.678765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b2c6c-c524-4973-9348-2d023851aa42 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:53.769120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1183/2394] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:25:53 2022] PUT /identity/v3/projects/79484854e983447abf6bbe303132a76d/users/55a3a2fd929a4be8975f6d6f4fb2075b/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:53.773765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fca4d-7385-4c4c-838d-55bfc007e20a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:53.784116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fca4d-7385-4c4c-838d-55bfc007e20a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:53.839520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcf7b7-4587-4351-a5b8-cabaaf9bfea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:53.840115 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcf7b7-4587-4351-a5b8-cabaaf9bfea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:53.840389 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcf7b7-4587-4351-a5b8-cabaaf9bfea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:53.840660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcf7b7-4587-4351-a5b8-cabaaf9bfea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:53.841287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcf7b7-4587-4351-a5b8-cabaaf9bfea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:53.842948 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcf7b7-4587-4351-a5b8-cabaaf9bfea7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:53.847887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:53.853267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1212/2395] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:25:53.858523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b2c6c-c524-4973-9348-2d023851aa42 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:53.867976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b2c6c-c524-4973-9348-2d023851aa42 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:53.872660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fd541-630f-45f5-b9a1-dcee58b48ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:53.873302 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fd541-630f-45f5-b9a1-dcee58b48ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:53.873577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fd541-630f-45f5-b9a1-dcee58b48ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:53.873847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fd541-630f-45f5-b9a1-dcee58b48ccd admin admin] PATH_INFO: `/v3/projects/79484854e983447abf6bbe303132a76d/users/55a3a2fd929a4be8975f6d6f4fb2075b/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:53.875836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fd541-630f-45f5-b9a1-dcee58b48ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=79484854e983447abf6bbe303132a76d, user_id=55a3a2fd929a4be8975f6d6f4fb2075b, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:53.878479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fd541-630f-45f5-b9a1-dcee58b48ccd admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:53.889271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1184/2396] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:25:53 2022] PUT /identity/v3/projects/79484854e983447abf6bbe303132a76d/users/55a3a2fd929a4be8975f6d6f4fb2075b/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:53.954610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b1069-e0ea-4be7-a876-5759ff6d9110 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:53.954937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b1069-e0ea-4be7-a876-5759ff6d9110 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:53.955209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b1069-e0ea-4be7-a876-5759ff6d9110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:53.983694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9d3b1069-e0ea-4be7-a876-5759ff6d9110 None None] MFA Rules not processed for user `55a3a2fd929a4be8975f6d6f4fb2075b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:53.984932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9d3b1069-e0ea-4be7-a876-5759ff6d9110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:54.052516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1213/2397] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:54.063060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fd541-630f-45f5-b9a1-dcee58b48ccd admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:54.064740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-403fd541-630f-45f5-b9a1-dcee58b48ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:54.079659 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:54.120923 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fd541-630f-45f5-b9a1-dcee58b48ccd admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:54.124551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57417f-1d7a-424b-b0b6-3ee120117ea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:54.125138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57417f-1d7a-424b-b0b6-3ee120117ea8 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:54.125411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57417f-1d7a-424b-b0b6-3ee120117ea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:54.125679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57417f-1d7a-424b-b0b6-3ee120117ea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:54.180994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57417f-1d7a-424b-b0b6-3ee120117ea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:54.182435 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57417f-1d7a-424b-b0b6-3ee120117ea8 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:54.191071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1185/2398] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:25:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:25:58.265983 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b1069-e0ea-4be7-a876-5759ff6d9110 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:58.335827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b1069-e0ea-4be7-a876-5759ff6d9110 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:58.340566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:58.341201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:58.341478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:58.341745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] PATH_INFO: `/v3/users/e793ad1730fe412a926f5f5df83cb840` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:58.342896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e793ad1730fe412a926f5f5df83cb840)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:58.344825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:58.536159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e793ad1730fe412a926f5f5df83cb840'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:58.536735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e793ad1730fe412a926f5f5df83cb840'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:58.602734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e793ad1730fe412a926f5f5df83cb840'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:58.603357 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e793ad1730fe412a926f5f5df83cb840'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:58.611441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e793ad1730fe412a926f5f5df83cb840'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:58.630432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1214/2399] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:25:58 2022] DELETE /identity/v3/users/e793ad1730fe412a926f5f5df83cb840 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:58.635064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b2ab2-3066-4aa4-a70e-6a18e16f6188 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:58.635538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b2ab2-3066-4aa4-a70e-6a18e16f6188 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:58.635766 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b2ab2-3066-4aa4-a70e-6a18e16f6188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:58.656580 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-ec8b2ab2-3066-4aa4-a70e-6a18e16f6188 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:25:58.660573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ec8b2ab2-3066-4aa4-a70e-6a18e16f6188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:58.723294 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1186/2400] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:25:58.737836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:58.739699 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:58.744797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:58.825545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058cfd7-e97d-476a-a882-9864710e16dc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:58.829114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee7d25-d03a-42b4-a634-b12fec197620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:58.829718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee7d25-d03a-42b4-a634-b12fec197620 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:58.829991 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee7d25-d03a-42b4-a634-b12fec197620 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:58.830259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee7d25-d03a-42b4-a634-b12fec197620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:58.840250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee7d25-d03a-42b4-a634-b12fec197620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:58.842568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee7d25-d03a-42b4-a634-b12fec197620 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:58.851966 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1215/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:25:59.257006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b2ab2-3066-4aa4-a70e-6a18e16f6188 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:59.257311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ec8b2ab2-3066-4aa4-a70e-6a18e16f6188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:59.270167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b2ab2-3066-4aa4-a70e-6a18e16f6188 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:59.275813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:59.276547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:59.276903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:59.277249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] PATH_INFO: `/v3/projects/e148cfe126f74693943602069a7e954d` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:59.278593 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e148cfe126f74693943602069a7e954d)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:59.280637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:59.391870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e148cfe126f74693943602069a7e954d', 'request_id': 'req-9081713b-2004-4344-9aeb-ad272926fa8a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:59.397414 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e148cfe126f74693943602069a7e954d', 'request_id': 'req-9081713b-2004-4344-9aeb-ad272926fa8a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:59.403665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e148cfe126f74693943602069a7e954d', 'request_id': 'req-9081713b-2004-4344-9aeb-ad272926fa8a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:59.405317 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:25:59.494525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] The token cache is being invalidate because project e148cfe126f74693943602069a7e954d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:25:59.498417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:59.498417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:59.498417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1187/2402] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:25:59 2022] DELETE /identity/v3/projects/e148cfe126f74693943602069a7e954d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:25:59.501268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee7d25-d03a-42b4-a634-b12fec197620 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:59.511059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee7d25-d03a-42b4-a634-b12fec197620 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:59.578772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51faef5-e3e9-4f04-983b-41ddd9f31f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:59.579339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51faef5-e3e9-4f04-983b-41ddd9f31f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:59.579618 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51faef5-e3e9-4f04-983b-41ddd9f31f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:59.580214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51faef5-e3e9-4f04-983b-41ddd9f31f79 admin admin] PATH_INFO: `/v3/users/55a3a2fd929a4be8975f6d6f4fb2075b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:59.581040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51faef5-e3e9-4f04-983b-41ddd9f31f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55a3a2fd929a4be8975f6d6f4fb2075b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:59.583050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51faef5-e3e9-4f04-983b-41ddd9f31f79 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:59.586082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:25:59.587610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:59.672328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081713b-2004-4344-9aeb-ad272926fa8a admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:25:59.677622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10932059-9540-4b07-83ec-2f2d0f3e055c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:25:59.678384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932059-9540-4b07-83ec-2f2d0f3e055c service placement] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:25:59.678689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932059-9540-4b07-83ec-2f2d0f3e055c service placement] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:25:59.678962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932059-9540-4b07-83ec-2f2d0f3e055c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:25:59.680747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-10932059-9540-4b07-83ec-2f2d0f3e055c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:25:59.692475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10932059-9540-4b07-83ec-2f2d0f3e055c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:25:59.694163 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10932059-9540-4b07-83ec-2f2d0f3e055c service placement] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:25:59.710104 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1188/2403] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:25:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:25:59.748299 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f51faef5-e3e9-4f04-983b-41ddd9f31f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55a3a2fd929a4be8975f6d6f4fb2075b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:59.748938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f51faef5-e3e9-4f04-983b-41ddd9f31f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55a3a2fd929a4be8975f6d6f4fb2075b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:59.797422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f51faef5-e3e9-4f04-983b-41ddd9f31f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55a3a2fd929a4be8975f6d6f4fb2075b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:59.798059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f51faef5-e3e9-4f04-983b-41ddd9f31f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55a3a2fd929a4be8975f6d6f4fb2075b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:59.806892 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f51faef5-e3e9-4f04-983b-41ddd9f31f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55a3a2fd929a4be8975f6d6f4fb2075b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:25:59.826613 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1216/2404] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:25:59 2022] DELETE /identity/v3/users/55a3a2fd929a4be8975f6d6f4fb2075b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:00.349770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10932059-9540-4b07-83ec-2f2d0f3e055c service placement] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:00.352009 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-10932059-9540-4b07-83ec-2f2d0f3e055c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:00.365967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10932059-9540-4b07-83ec-2f2d0f3e055c service placement] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:00.436389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:00.436389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:00.436389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:00.436389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] PATH_INFO: `/v3/projects/79484854e983447abf6bbe303132a76d` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:00.436861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] RBAC: Authorizing `identity:delete_project(project_id=79484854e983447abf6bbe303132a76d)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:00.436861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:00.557975 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79484854e983447abf6bbe303132a76d', 'request_id': 'req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:00.563844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79484854e983447abf6bbe303132a76d', 'request_id': 'req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:00.570544 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79484854e983447abf6bbe303132a76d', 'request_id': 'req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:00.613197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] The token cache is being invalidate because project 79484854e983447abf6bbe303132a76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:00.613505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:00.614120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-c90b5df6-9e75-41f8-9b36-2d15d3bf405a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:00.615683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1189/2405] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:00 2022] DELETE /identity/v3/projects/79484854e983447abf6bbe303132a76d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:26:00.622001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f9512-b26c-491b-a033-0a743358e9f6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:00.622514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f9512-b26c-491b-a033-0a743358e9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:00.623008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f9512-b26c-491b-a033-0a743358e9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:00.638404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:00.649174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ae6f9512-b26c-491b-a033-0a743358e9f6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:00.649174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ae6f9512-b26c-491b-a033-0a743358e9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:00.716219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1217/2406] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:00.724308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c341f0-3356-486f-ac1c-21ff40a4fb67 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:00.724308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c341f0-3356-486f-ac1c-21ff40a4fb67 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:00.724308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c341f0-3356-486f-ac1c-21ff40a4fb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:00.755119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-53c341f0-3356-486f-ac1c-21ff40a4fb67 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:00.755119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-53c341f0-3356-486f-ac1c-21ff40a4fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:00.757312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1190/2407] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:00.761742 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f9512-b26c-491b-a033-0a743358e9f6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:00.773137 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f9512-b26c-491b-a033-0a743358e9f6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:00.777918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa43bed-3edb-4301-8d8d-470a2dfa847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:00.778907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa43bed-3edb-4301-8d8d-470a2dfa847b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:00.783570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa43bed-3edb-4301-8d8d-470a2dfa847b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:00.783570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa43bed-3edb-4301-8d8d-470a2dfa847b admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:00.783570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa43bed-3edb-4301-8d8d-470a2dfa847b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:26:00.783570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa43bed-3edb-4301-8d8d-470a2dfa847b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:00.783570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa43bed-3edb-4301-8d8d-470a2dfa847b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:00.802328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1218/2408] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:26:00.803599 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c341f0-3356-486f-ac1c-21ff40a4fb67 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:00.814055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:00.819467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c341f0-3356-486f-ac1c-21ff40a4fb67 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:00.825393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc69dea-80a3-43c8-bb89-29a1f36b9892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:00.827394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69dea-80a3-43c8-bb89-29a1f36b9892 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:00.827781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69dea-80a3-43c8-bb89-29a1f36b9892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:00.828157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69dea-80a3-43c8-bb89-29a1f36b9892 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:00.828902 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc69dea-80a3-43c8-bb89-29a1f36b9892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:00.830981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc69dea-80a3-43c8-bb89-29a1f36b9892 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:00.936873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1191/2409] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:26:00 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:00.940895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa43bed-3edb-4301-8d8d-470a2dfa847b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:00.953567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa43bed-3edb-4301-8d8d-470a2dfa847b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:01.010196 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d4be7-87c6-4692-be02-d1013ae4099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:01.010831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d4be7-87c6-4692-be02-d1013ae4099e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:01.011109 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d4be7-87c6-4692-be02-d1013ae4099e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:01.011378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d4be7-87c6-4692-be02-d1013ae4099e admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:01.012007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d4be7-87c6-4692-be02-d1013ae4099e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:01.013927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d4be7-87c6-4692-be02-d1013ae4099e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:01.121353 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1219/2410] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:26:00 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:01.122557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc69dea-80a3-43c8-bb89-29a1f36b9892 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:01.134821 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc69dea-80a3-43c8-bb89-29a1f36b9892 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:01.141981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04856c0c-b8ee-40d0-8d6c-99eea93a589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:01.143142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04856c0c-b8ee-40d0-8d6c-99eea93a589c admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:01.143142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04856c0c-b8ee-40d0-8d6c-99eea93a589c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:01.143402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04856c0c-b8ee-40d0-8d6c-99eea93a589c admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:01.144119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04856c0c-b8ee-40d0-8d6c-99eea93a589c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:01.145804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04856c0c-b8ee-40d0-8d6c-99eea93a589c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:01.157542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1192/2411] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:01.161888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d4be7-87c6-4692-be02-d1013ae4099e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:01.172850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d4be7-87c6-4692-be02-d1013ae4099e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:01.177546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2665d75-d3ff-4484-ae93-58865e3057f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:01.178147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665d75-d3ff-4484-ae93-58865e3057f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:01.178424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665d75-d3ff-4484-ae93-58865e3057f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:01.178737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665d75-d3ff-4484-ae93-58865e3057f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:01.180015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2665d75-d3ff-4484-ae93-58865e3057f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:01.181619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2665d75-d3ff-4484-ae93-58865e3057f3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:01.192762 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1220/2412] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:01.197406 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04856c0c-b8ee-40d0-8d6c-99eea93a589c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:01.208170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04856c0c-b8ee-40d0-8d6c-99eea93a589c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:01.220679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa8a4-7e7e-45ec-8b2b-2524b29bb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:01.220679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa8a4-7e7e-45ec-8b2b-2524b29bb296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:01.220679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa8a4-7e7e-45ec-8b2b-2524b29bb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:01.220679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaa8a4-7e7e-45ec-8b2b-2524b29bb296 admin admin] PATH_INFO: `/v3/projects/8f85140af1514dbf998aa6ffb8b48d28/users/73143a267c38445eabd106950531c1fe/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:01.228965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaa8a4-7e7e-45ec-8b2b-2524b29bb296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f85140af1514dbf998aa6ffb8b48d28, user_id=73143a267c38445eabd106950531c1fe, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:01.231746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaa8a4-7e7e-45ec-8b2b-2524b29bb296 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:01.289789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1193/2413] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:01 2022] PUT /identity/v3/projects/8f85140af1514dbf998aa6ffb8b48d28/users/73143a267c38445eabd106950531c1fe/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:01.294692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad010-7657-4ade-b0da-e43fb5b622e3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:01.295224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad010-7657-4ade-b0da-e43fb5b622e3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:01.295500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad010-7657-4ade-b0da-e43fb5b622e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:01.316555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1e5ad010-7657-4ade-b0da-e43fb5b622e3 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:01.316660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1e5ad010-7657-4ade-b0da-e43fb5b622e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:01.378493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1221/2414] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:01.389175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa8a4-7e7e-45ec-8b2b-2524b29bb296 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:01.390991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-bccaa8a4-7e7e-45ec-8b2b-2524b29bb296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:01.454918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaa8a4-7e7e-45ec-8b2b-2524b29bb296 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:01.458552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb472cfd-48e6-4116-89f5-46187562b45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:01.459199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb472cfd-48e6-4116-89f5-46187562b45a service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:01.459476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb472cfd-48e6-4116-89f5-46187562b45a service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:01.459745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb472cfd-48e6-4116-89f5-46187562b45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:01.470725 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb472cfd-48e6-4116-89f5-46187562b45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:01.472230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb472cfd-48e6-4116-89f5-46187562b45a service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:01.486638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1194/2415] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:02.850636 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902402f0-1e57-4dc4-b51c-5212438ac7ab None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:02.851782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902402f0-1e57-4dc4-b51c-5212438ac7ab None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:02.851782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902402f0-1e57-4dc4-b51c-5212438ac7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:02.880539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:02.884251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-902402f0-1e57-4dc4-b51c-5212438ac7ab None None] MFA Rules not processed for user `73143a267c38445eabd106950531c1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:02.885506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-902402f0-1e57-4dc4-b51c-5212438ac7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:02.964423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1222/2416] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:02.975447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb472cfd-48e6-4116-89f5-46187562b45a service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:02.978029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-fb472cfd-48e6-4116-89f5-46187562b45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:03.062232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb472cfd-48e6-4116-89f5-46187562b45a service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:03.066125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51462cfc-969c-4e33-a0ff-999204c9246a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:03.066780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51462cfc-969c-4e33-a0ff-999204c9246a service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:03.067064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51462cfc-969c-4e33-a0ff-999204c9246a service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:03.067336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51462cfc-969c-4e33-a0ff-999204c9246a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:03.076573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51462cfc-969c-4e33-a0ff-999204c9246a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:03.078015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51462cfc-969c-4e33-a0ff-999204c9246a service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:03.086903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1195/2417] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:04.322874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9882-6e42-46ab-ab22-083881343c8d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:04.323265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9882-6e42-46ab-ab22-083881343c8d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:04.323353 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9882-6e42-46ab-ab22-083881343c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:04.345475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ae5d9882-6e42-46ab-ab22-083881343c8d None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:04.347435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ae5d9882-6e42-46ab-ab22-083881343c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:04.414039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1223/2418] 10.222.0.23 () {58 vars in 967 bytes} [Thu Sep 8 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:04.432272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51462cfc-969c-4e33-a0ff-999204c9246a service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:04.434338 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-51462cfc-969c-4e33-a0ff-999204c9246a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:04.484099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:04.526507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51462cfc-969c-4e33-a0ff-999204c9246a service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:04.532500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e37ad-d795-48ce-af2b-385b3d8ecc46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:04.533167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e37ad-d795-48ce-af2b-385b3d8ecc46 service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:04.533447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e37ad-d795-48ce-af2b-385b3d8ecc46 service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:04.533724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e37ad-d795-48ce-af2b-385b3d8ecc46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:04.542796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e37ad-d795-48ce-af2b-385b3d8ecc46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:04.544388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e37ad-d795-48ce-af2b-385b3d8ecc46 service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:04.552655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1196/2419] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:26:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:26:04.811161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa55d-659d-4610-9eb6-7e0d196b792f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:04.811451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa55d-659d-4610-9eb6-7e0d196b792f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:04.811752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fa55d-659d-4610-9eb6-7e0d196b792f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:04.832478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8a6fa55d-659d-4610-9eb6-7e0d196b792f None None] MFA Rules not processed for user `73143a267c38445eabd106950531c1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:04.833689 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8a6fa55d-659d-4610-9eb6-7e0d196b792f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:04.840733 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1224/2420] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:14.597082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=17 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:14.826630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=54 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:24.197364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e37ad-d795-48ce-af2b-385b3d8ecc46 service swift] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:24.206872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e37ad-d795-48ce-af2b-385b3d8ecc46 service swift] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:24.210495 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7757c8-bc2d-46e3-8e0c-5e6e929f69a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:24.211136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7757c8-bc2d-46e3-8e0c-5e6e929f69a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:24.211410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7757c8-bc2d-46e3-8e0c-5e6e929f69a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:24.211679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7757c8-bc2d-46e3-8e0c-5e6e929f69a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:24.213389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-bd7757c8-bc2d-46e3-8e0c-5e6e929f69a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:24.224925 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7757c8-bc2d-46e3-8e0c-5e6e929f69a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:24.226340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7757c8-bc2d-46e3-8e0c-5e6e929f69a4 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:24.235804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1197/2421] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:26:24.770831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fa55d-659d-4610-9eb6-7e0d196b792f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:24.782718 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fa55d-659d-4610-9eb6-7e0d196b792f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:24.786412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34130bbb-083f-4d52-8c42-12a4659d4423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:24.787123 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34130bbb-083f-4d52-8c42-12a4659d4423 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:24.787398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34130bbb-083f-4d52-8c42-12a4659d4423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:24.787669 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34130bbb-083f-4d52-8c42-12a4659d4423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:24.789746 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-34130bbb-083f-4d52-8c42-12a4659d4423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:24.858597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34130bbb-083f-4d52-8c42-12a4659d4423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:24.863376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34130bbb-083f-4d52-8c42-12a4659d4423 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:24.870254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1225/2422] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:28.891016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7757c8-bc2d-46e3-8e0c-5e6e929f69a4 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:28.893130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-bd7757c8-bc2d-46e3-8e0c-5e6e929f69a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:28.908233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7757c8-bc2d-46e3-8e0c-5e6e929f69a4 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:28.913245 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738f949-8c28-49f5-82a8-7098ad2b4cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:28.915241 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738f949-8c28-49f5-82a8-7098ad2b4cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:28.915241 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738f949-8c28-49f5-82a8-7098ad2b4cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:28.915241 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738f949-8c28-49f5-82a8-7098ad2b4cf6 admin admin] PATH_INFO: `/v3/users/73f357cb7b2d4214bde8d5d0d212c91f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:28.915645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738f949-8c28-49f5-82a8-7098ad2b4cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f357cb7b2d4214bde8d5d0d212c91f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:28.917582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738f949-8c28-49f5-82a8-7098ad2b4cf6 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:29.103119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d738f949-8c28-49f5-82a8-7098ad2b4cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f357cb7b2d4214bde8d5d0d212c91f'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:29.103778 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d738f949-8c28-49f5-82a8-7098ad2b4cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f357cb7b2d4214bde8d5d0d212c91f'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:29.157040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d738f949-8c28-49f5-82a8-7098ad2b4cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f357cb7b2d4214bde8d5d0d212c91f'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:29.157661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d738f949-8c28-49f5-82a8-7098ad2b4cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f357cb7b2d4214bde8d5d0d212c91f'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:29.166290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d738f949-8c28-49f5-82a8-7098ad2b4cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f357cb7b2d4214bde8d5d0d212c91f'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:29.184735 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1198/2423] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:26:28 2022] DELETE /identity/v3/users/73f357cb7b2d4214bde8d5d0d212c91f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:29.423715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34130bbb-083f-4d52-8c42-12a4659d4423 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:29.437856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34130bbb-083f-4d52-8c42-12a4659d4423 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:29.498221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:29.498819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:29.499101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:29.499673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] PATH_INFO: `/v3/projects/7d382b305c5c420a810036dd208f56d6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:29.500848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d382b305c5c420a810036dd208f56d6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:29.502857 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:29.601095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d382b305c5c420a810036dd208f56d6', 'request_id': 'req-49868ed0-c6b0-4199-808f-3f36da4360b3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:29.607366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d382b305c5c420a810036dd208f56d6', 'request_id': 'req-49868ed0-c6b0-4199-808f-3f36da4360b3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:29.613742 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d382b305c5c420a810036dd208f56d6', 'request_id': 'req-49868ed0-c6b0-4199-808f-3f36da4360b3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:29.682878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] The token cache is being invalidate because project 7d382b305c5c420a810036dd208f56d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:29.683172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:29.683943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-49868ed0-c6b0-4199-808f-3f36da4360b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:29.686278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1226/2424] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:29 2022] DELETE /identity/v3/projects/7d382b305c5c420a810036dd208f56d6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:29.692647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b33c8d-4acd-49d9-ab80-c2b37dec570f None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:29.693021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b33c8d-4acd-49d9-ab80-c2b37dec570f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:29.693415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b33c8d-4acd-49d9-ab80-c2b37dec570f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:29.716031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-17b33c8d-4acd-49d9-ab80-c2b37dec570f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:29.717549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-17b33c8d-4acd-49d9-ab80-c2b37dec570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:29.803081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1199/2425] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:29.811080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd897fc-d93b-4fe9-aa23-868aac6cc93b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:29.811404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd897fc-d93b-4fe9-aa23-868aac6cc93b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:29.811711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd897fc-d93b-4fe9-aa23-868aac6cc93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:29.838205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2cd897fc-d93b-4fe9-aa23-868aac6cc93b None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:29.849963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2cd897fc-d93b-4fe9-aa23-868aac6cc93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:29.849963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1227/2426] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:29.853078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b33c8d-4acd-49d9-ab80-c2b37dec570f None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:29.864058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b33c8d-4acd-49d9-ab80-c2b37dec570f None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:29.870304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b0215-7566-46b4-9047-568fad408ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:29.870989 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0215-7566-46b4-9047-568fad408ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:29.871262 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0215-7566-46b4-9047-568fad408ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:29.871533 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b0215-7566-46b4-9047-568fad408ec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:29.872191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b0215-7566-46b4-9047-568fad408ec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:26:29.872492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b0215-7566-46b4-9047-568fad408ec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:29.874110 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b0215-7566-46b4-9047-568fad408ec2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:29.887764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1200/2427] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:26:29.894391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd897fc-d93b-4fe9-aa23-868aac6cc93b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:29.903824 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd897fc-d93b-4fe9-aa23-868aac6cc93b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:29.908979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52fde-290d-4d48-b69e-1ee18b2502e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:29.910175 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52fde-290d-4d48-b69e-1ee18b2502e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:29.910487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52fde-290d-4d48-b69e-1ee18b2502e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:29.914315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf52fde-290d-4d48-b69e-1ee18b2502e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:29.914315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf52fde-290d-4d48-b69e-1ee18b2502e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:29.916340 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf52fde-290d-4d48-b69e-1ee18b2502e3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:30.015216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:30.021769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1228/2428] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:26:29 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:30.026183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b0215-7566-46b4-9047-568fad408ec2 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:30.036305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b0215-7566-46b4-9047-568fad408ec2 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:30.087888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:30.106558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9b62-2d45-4044-bcf9-634305205b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:30.107292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9b62-2d45-4044-bcf9-634305205b41 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:30.107642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9b62-2d45-4044-bcf9-634305205b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:30.108094 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9b62-2d45-4044-bcf9-634305205b41 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:30.108755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a9b62-2d45-4044-bcf9-634305205b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:30.110860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a9b62-2d45-4044-bcf9-634305205b41 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:30.261050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1201/2429] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:26:30 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:30.265412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52fde-290d-4d48-b69e-1ee18b2502e3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:30.276103 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf52fde-290d-4d48-b69e-1ee18b2502e3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:30.280896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650b647-29d0-4eb6-bcd6-4f376fa796ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:30.281487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650b647-29d0-4eb6-bcd6-4f376fa796ae admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:30.281768 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650b647-29d0-4eb6-bcd6-4f376fa796ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:30.282032 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650b647-29d0-4eb6-bcd6-4f376fa796ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:30.282708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650b647-29d0-4eb6-bcd6-4f376fa796ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:30.284326 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650b647-29d0-4eb6-bcd6-4f376fa796ae admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:30.295201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1229/2430] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:26:30.299753 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9b62-2d45-4044-bcf9-634305205b41 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:30.311835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9b62-2d45-4044-bcf9-634305205b41 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:30.316665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa784e-623e-4c77-9a6f-d734f35065e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:30.317268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa784e-623e-4c77-9a6f-d734f35065e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:30.317549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa784e-623e-4c77-9a6f-d734f35065e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:30.317822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa784e-623e-4c77-9a6f-d734f35065e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:30.318461 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa784e-623e-4c77-9a6f-d734f35065e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:30.320702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa784e-623e-4c77-9a6f-d734f35065e2 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:30.331273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1202/2431] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:30.336480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650b647-29d0-4eb6-bcd6-4f376fa796ae admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:30.346726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650b647-29d0-4eb6-bcd6-4f376fa796ae admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:30.351213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6b26-d9aa-40a8-8322-db9305fc0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:30.351849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6b26-d9aa-40a8-8322-db9305fc0ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:30.352123 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6b26-d9aa-40a8-8322-db9305fc0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:30.352407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6b26-d9aa-40a8-8322-db9305fc0ae7 admin admin] PATH_INFO: `/v3/projects/e7fcf73adbf047dcbb8334f2dca76aef/users/51afc3a76f00499884f2737cc7b55b97/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:30.372717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb6b26-d9aa-40a8-8322-db9305fc0ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fcf73adbf047dcbb8334f2dca76aef, user_id=51afc3a76f00499884f2737cc7b55b97, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:30.372717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb6b26-d9aa-40a8-8322-db9305fc0ae7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:30.507421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1230/2432] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:30 2022] PUT /identity/v3/projects/e7fcf73adbf047dcbb8334f2dca76aef/users/51afc3a76f00499884f2737cc7b55b97/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:30.522613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40383a7f-30dd-4547-9c2a-a3b2fccac69e None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:30.523266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40383a7f-30dd-4547-9c2a-a3b2fccac69e None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:30.523712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40383a7f-30dd-4547-9c2a-a3b2fccac69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:30.553655 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-40383a7f-30dd-4547-9c2a-a3b2fccac69e None None] MFA Rules not processed for user `51afc3a76f00499884f2737cc7b55b97`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:30.555513 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-40383a7f-30dd-4547-9c2a-a3b2fccac69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:30.623331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1203/2433] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:26:30.627795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6b26-d9aa-40a8-8322-db9305fc0ae7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:30.692622 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6b26-d9aa-40a8-8322-db9305fc0ae7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:30.697614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8957d-c029-475a-a4ed-6e2c0a10cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:30.705850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8957d-c029-475a-a4ed-6e2c0a10cf71 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:30.705850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8957d-c029-475a-a4ed-6e2c0a10cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:30.705850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8957d-c029-475a-a4ed-6e2c0a10cf71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:30.705850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8957d-c029-475a-a4ed-6e2c0a10cf71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:30.705850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8957d-c029-475a-a4ed-6e2c0a10cf71 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:30.776623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1231/2434] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:26:30 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:26:30.780678 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40383a7f-30dd-4547-9c2a-a3b2fccac69e None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:30.792193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40383a7f-30dd-4547-9c2a-a3b2fccac69e None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:30.860839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01612899-62a6-4798-81e3-99c25463eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:30.861455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01612899-62a6-4798-81e3-99c25463eed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:30.861734 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01612899-62a6-4798-81e3-99c25463eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:30.862141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01612899-62a6-4798-81e3-99c25463eed7 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:30.862816 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01612899-62a6-4798-81e3-99c25463eed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:30.864759 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01612899-62a6-4798-81e3-99c25463eed7 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:30.946611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1204/2435] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:26:30 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:26:30.952305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8957d-c029-475a-a4ed-6e2c0a10cf71 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:30.963487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8957d-c029-475a-a4ed-6e2c0a10cf71 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:30.968383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2e36d-8ddc-4fd7-9c84-d3201b0a909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:30.968975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e36d-8ddc-4fd7-9c84-d3201b0a909c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:30.969267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e36d-8ddc-4fd7-9c84-d3201b0a909c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:30.969522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e36d-8ddc-4fd7-9c84-d3201b0a909c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:30.970189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2e36d-8ddc-4fd7-9c84-d3201b0a909c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:30.971797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2e36d-8ddc-4fd7-9c84-d3201b0a909c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:30.983138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1232/2436] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:30.987625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01612899-62a6-4798-81e3-99c25463eed7 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:30.997821 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01612899-62a6-4798-81e3-99c25463eed7 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:31.002966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23697-7388-43bd-b70a-f7dd5f881e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:31.003744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23697-7388-43bd-b70a-f7dd5f881e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:31.004108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23697-7388-43bd-b70a-f7dd5f881e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:31.004488 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23697-7388-43bd-b70a-f7dd5f881e30 admin admin] PATH_INFO: `/v3/projects/c6b061a858cd4f529759f9b23c453245/users/fc6e5cf20e6a4ee6910aec3a4ba93e3f/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:31.021441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d23697-7388-43bd-b70a-f7dd5f881e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b061a858cd4f529759f9b23c453245, user_id=fc6e5cf20e6a4ee6910aec3a4ba93e3f, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:31.024767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d23697-7388-43bd-b70a-f7dd5f881e30 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:31.100651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1205/2437] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:30 2022] PUT /identity/v3/projects/c6b061a858cd4f529759f9b23c453245/users/fc6e5cf20e6a4ee6910aec3a4ba93e3f/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:31.106432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2e36d-8ddc-4fd7-9c84-d3201b0a909c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:31.122106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2e36d-8ddc-4fd7-9c84-d3201b0a909c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:31.190557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c88d12-7300-4c45-ad5c-3925e12d233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:31.191203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c88d12-7300-4c45-ad5c-3925e12d233a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:31.191479 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c88d12-7300-4c45-ad5c-3925e12d233a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:31.191751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c88d12-7300-4c45-ad5c-3925e12d233a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:31.192388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c88d12-7300-4c45-ad5c-3925e12d233a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:31.193978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c88d12-7300-4c45-ad5c-3925e12d233a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:31.203981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1233/2438] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:31.208392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23697-7388-43bd-b70a-f7dd5f881e30 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:31.219454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23697-7388-43bd-b70a-f7dd5f881e30 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:31.224052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854a7d2-0176-4f95-815b-25e0eee225c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:31.224740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854a7d2-0176-4f95-815b-25e0eee225c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:31.225023 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854a7d2-0176-4f95-815b-25e0eee225c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:31.225297 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854a7d2-0176-4f95-815b-25e0eee225c0 admin admin] PATH_INFO: `/v3/projects/c6b061a858cd4f529759f9b23c453245/users/fc6e5cf20e6a4ee6910aec3a4ba93e3f/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:31.227937 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854a7d2-0176-4f95-815b-25e0eee225c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b061a858cd4f529759f9b23c453245, user_id=fc6e5cf20e6a4ee6910aec3a4ba93e3f, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:31.231217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854a7d2-0176-4f95-815b-25e0eee225c0 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:31.242334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1206/2439] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:31 2022] PUT /identity/v3/projects/c6b061a858cd4f529759f9b23c453245/users/fc6e5cf20e6a4ee6910aec3a4ba93e3f/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:31.252616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c491d-983a-456d-9bda-b572ea902f4d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:31.252907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c491d-983a-456d-9bda-b572ea902f4d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:31.253188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c491d-983a-456d-9bda-b572ea902f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:31.282878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b50c491d-983a-456d-9bda-b572ea902f4d None None] MFA Rules not processed for user `fc6e5cf20e6a4ee6910aec3a4ba93e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:31.284121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b50c491d-983a-456d-9bda-b572ea902f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:31.311449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:31.357884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1234/2440] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:31.369000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854a7d2-0176-4f95-815b-25e0eee225c0 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:31.370800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d854a7d2-0176-4f95-815b-25e0eee225c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:31.386935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:31.436906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854a7d2-0176-4f95-815b-25e0eee225c0 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:31.440491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6343d-d9ca-43e6-bb69-de42b0f2665d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:31.441138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6343d-d9ca-43e6-bb69-de42b0f2665d service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:31.441365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6343d-d9ca-43e6-bb69-de42b0f2665d service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:31.441651 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6343d-d9ca-43e6-bb69-de42b0f2665d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:31.452040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6343d-d9ca-43e6-bb69-de42b0f2665d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:31.458232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6343d-d9ca-43e6-bb69-de42b0f2665d service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:31.464665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1207/2441] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:31.694255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c491d-983a-456d-9bda-b572ea902f4d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:31.704687 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c491d-983a-456d-9bda-b572ea902f4d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:31.708232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07f4a2-9212-48a9-9dff-e6e3a035319c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:31.710427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f4a2-9212-48a9-9dff-e6e3a035319c service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:31.710427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f4a2-9212-48a9-9dff-e6e3a035319c service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:31.710427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f4a2-9212-48a9-9dff-e6e3a035319c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:31.769220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07f4a2-9212-48a9-9dff-e6e3a035319c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:31.770650 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07f4a2-9212-48a9-9dff-e6e3a035319c service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:31.779572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1235/2442] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:32.316788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6343d-d9ca-43e6-bb69-de42b0f2665d service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:32.318852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2aa6343d-d9ca-43e6-bb69-de42b0f2665d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:32.375913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6343d-d9ca-43e6-bb69-de42b0f2665d service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:32.379719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66da9f4-14e6-44ec-a838-be67879f072d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:32.380321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66da9f4-14e6-44ec-a838-be67879f072d service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:32.380633 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66da9f4-14e6-44ec-a838-be67879f072d service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:32.380905 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66da9f4-14e6-44ec-a838-be67879f072d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:32.382640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f66da9f4-14e6-44ec-a838-be67879f072d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:32.446380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66da9f4-14e6-44ec-a838-be67879f072d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:32.447901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66da9f4-14e6-44ec-a838-be67879f072d service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:32.457449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1208/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:39.740702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07f4a2-9212-48a9-9dff-e6e3a035319c service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:39.742202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8c07f4a2-9212-48a9-9dff-e6e3a035319c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:39.756230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07f4a2-9212-48a9-9dff-e6e3a035319c service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:39.761440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:39.762071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:39.762347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:39.762619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] PATH_INFO: `/v3/users/2bea9545991f4bc08af66113ac8c72c8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:39.763781 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bea9545991f4bc08af66113ac8c72c8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:39.765717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:39.976973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bea9545991f4bc08af66113ac8c72c8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:39.977627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bea9545991f4bc08af66113ac8c72c8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:40.093560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bea9545991f4bc08af66113ac8c72c8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:40.094346 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bea9545991f4bc08af66113ac8c72c8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:40.101791 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bea9545991f4bc08af66113ac8c72c8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:40.119495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1236/2444] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:26:39 2022] DELETE /identity/v3/users/2bea9545991f4bc08af66113ac8c72c8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:40.388057 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66da9f4-14e6-44ec-a838-be67879f072d service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:40.399270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66da9f4-14e6-44ec-a838-be67879f072d service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:40.465465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:40.466103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:40.466382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:40.466681 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] PATH_INFO: `/v3/projects/7e35a35e4ac945669579d16de248d5a4` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:40.467853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e35a35e4ac945669579d16de248d5a4)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:40.469792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:40.471302 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:40.615611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e35a35e4ac945669579d16de248d5a4', 'request_id': 'req-aa6c12e3-b1c6-4572-aff5-ba604433560c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:40.621322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e35a35e4ac945669579d16de248d5a4', 'request_id': 'req-aa6c12e3-b1c6-4572-aff5-ba604433560c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:40.627681 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e35a35e4ac945669579d16de248d5a4', 'request_id': 'req-aa6c12e3-b1c6-4572-aff5-ba604433560c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:40.705609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] The token cache is being invalidate because project 7e35a35e4ac945669579d16de248d5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:40.705966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:40.708124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:40.708124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1209/2445] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:40 2022] DELETE /identity/v3/projects/7e35a35e4ac945669579d16de248d5a4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:40.712048 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:40.713453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:40.727373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b7218-d0ff-4272-b310-0585d1c8c602 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:40.764363 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:40.794908 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:40.795551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:40.796092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:40.796631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] PATH_INFO: `/v3/users/c22c69a2bebe449682f7e1a1be1078c1` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:40.799456 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22c69a2bebe449682f7e1a1be1078c1)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:40.801787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:40.988360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22c69a2bebe449682f7e1a1be1078c1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:40.988936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22c69a2bebe449682f7e1a1be1078c1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:41.070859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22c69a2bebe449682f7e1a1be1078c1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:41.071480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22c69a2bebe449682f7e1a1be1078c1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:41.079269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22c69a2bebe449682f7e1a1be1078c1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:41.101818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1237/2446] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:26:40 2022] DELETE /identity/v3/users/c22c69a2bebe449682f7e1a1be1078c1 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:41.335361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:41.336832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:41.350372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c12e3-b1c6-4572-aff5-ba604433560c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:41.408910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:41.409588 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:41.409809 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:41.410074 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] PATH_INFO: `/v3/projects/a7460c505dfc409c8b5a6249abb502e9` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:41.411270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7460c505dfc409c8b5a6249abb502e9)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:41.413205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:41.552634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7460c505dfc409c8b5a6249abb502e9', 'request_id': 'req-9626c985-1deb-424f-9392-0d27ef4a97ad'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:41.558330 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7460c505dfc409c8b5a6249abb502e9', 'request_id': 'req-9626c985-1deb-424f-9392-0d27ef4a97ad'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:41.564587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7460c505dfc409c8b5a6249abb502e9', 'request_id': 'req-9626c985-1deb-424f-9392-0d27ef4a97ad'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:41.694015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] The token cache is being invalidate because project a7460c505dfc409c8b5a6249abb502e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:41.705474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:41.705474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9626c985-1deb-424f-9392-0d27ef4a97ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:41.705474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1210/2447] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:41 2022] DELETE /identity/v3/projects/a7460c505dfc409c8b5a6249abb502e9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:42.540007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:42.541791 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:42.560938 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1b08a-525a-4dbe-8c43-04c58df21e09 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:42.619556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:42.620189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:42.620460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:42.620729 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] PATH_INFO: `/v3/users/51afc3a76f00499884f2737cc7b55b97` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:42.621835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51afc3a76f00499884f2737cc7b55b97)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:42.623831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:42.857860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51afc3a76f00499884f2737cc7b55b97'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:42.858598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51afc3a76f00499884f2737cc7b55b97'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:42.862503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:42.922960 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51afc3a76f00499884f2737cc7b55b97'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:42.923577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51afc3a76f00499884f2737cc7b55b97'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:42.931038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51afc3a76f00499884f2737cc7b55b97'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:42.948153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1238/2448] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:26:42 2022] DELETE /identity/v3/users/51afc3a76f00499884f2737cc7b55b97 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:42.953064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e66bdf-3880-4a2e-933b-8eac1994a624 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:42.953561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e66bdf-3880-4a2e-933b-8eac1994a624 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:42.953676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e66bdf-3880-4a2e-933b-8eac1994a624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:42.974724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-78e66bdf-3880-4a2e-933b-8eac1994a624 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:42.975970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-78e66bdf-3880-4a2e-933b-8eac1994a624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:42.990369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:43.035762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1211/2449] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:43.046210 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:43.047692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:43.107224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3abf3-57de-4343-9ef5-d8086ccd4983 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:43.110902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285c44-8d38-4943-b024-ceb2b9304802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:43.111504 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285c44-8d38-4943-b024-ceb2b9304802 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:43.111782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285c44-8d38-4943-b024-ceb2b9304802 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:43.112054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285c44-8d38-4943-b024-ceb2b9304802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:43.121520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53285c44-8d38-4943-b024-ceb2b9304802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:43.122917 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53285c44-8d38-4943-b024-ceb2b9304802 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:43.133716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1239/2450] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:43.512737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e66bdf-3880-4a2e-933b-8eac1994a624 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:43.516219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-78e66bdf-3880-4a2e-933b-8eac1994a624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:43.527296 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e66bdf-3880-4a2e-933b-8eac1994a624 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:43.532187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:43.533060 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:43.533342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:43.533616 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] PATH_INFO: `/v3/projects/e7fcf73adbf047dcbb8334f2dca76aef` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:43.534807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fcf73adbf047dcbb8334f2dca76aef)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:43.536754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:43.671230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fcf73adbf047dcbb8334f2dca76aef', 'request_id': 'req-5ce9d157-f192-43d9-9658-d75299505f7c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:43.676864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fcf73adbf047dcbb8334f2dca76aef', 'request_id': 'req-5ce9d157-f192-43d9-9658-d75299505f7c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:43.683585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fcf73adbf047dcbb8334f2dca76aef', 'request_id': 'req-5ce9d157-f192-43d9-9658-d75299505f7c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:43.763069 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] The token cache is being invalidate because project e7fcf73adbf047dcbb8334f2dca76aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:43.763364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:43.764005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:43.765538 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1212/2451] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:43 2022] DELETE /identity/v3/projects/e7fcf73adbf047dcbb8334f2dca76aef => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:43.769620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285c44-8d38-4943-b024-ceb2b9304802 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:43.783248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285c44-8d38-4943-b024-ceb2b9304802 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:43.836943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf0b23-a48c-460a-adb2-b41375bcff70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:43.837561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf0b23-a48c-460a-adb2-b41375bcff70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:43.837834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf0b23-a48c-460a-adb2-b41375bcff70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:43.838101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf0b23-a48c-460a-adb2-b41375bcff70 admin admin] PATH_INFO: `/v3/users/fc6e5cf20e6a4ee6910aec3a4ba93e3f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:43.839234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf0b23-a48c-460a-adb2-b41375bcff70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6e5cf20e6a4ee6910aec3a4ba93e3f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:43.841146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf0b23-a48c-460a-adb2-b41375bcff70 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:44.042477 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5aaf0b23-a48c-460a-adb2-b41375bcff70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6e5cf20e6a4ee6910aec3a4ba93e3f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:44.043172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5aaf0b23-a48c-460a-adb2-b41375bcff70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6e5cf20e6a4ee6910aec3a4ba93e3f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:44.128931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5aaf0b23-a48c-460a-adb2-b41375bcff70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6e5cf20e6a4ee6910aec3a4ba93e3f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:44.130088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5aaf0b23-a48c-460a-adb2-b41375bcff70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6e5cf20e6a4ee6910aec3a4ba93e3f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:44.138447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5aaf0b23-a48c-460a-adb2-b41375bcff70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6e5cf20e6a4ee6910aec3a4ba93e3f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:44.151078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:44.162470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1240/2452] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:26:43 2022] DELETE /identity/v3/users/fc6e5cf20e6a4ee6910aec3a4ba93e3f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:44.638945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:44.640671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:44.661471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d157-f192-43d9-9658-d75299505f7c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:44.726575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:44.727255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:44.728133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:44.728458 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] PATH_INFO: `/v3/projects/c6b061a858cd4f529759f9b23c453245` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:44.729614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b061a858cd4f529759f9b23c453245)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:44.731625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:44.812227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:44.815140 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b061a858cd4f529759f9b23c453245', 'request_id': 'req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:44.820636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b061a858cd4f529759f9b23c453245', 'request_id': 'req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:44.827351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b061a858cd4f529759f9b23c453245', 'request_id': 'req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:44.928658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] The token cache is being invalidate because project c6b061a858cd4f529759f9b23c453245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:44.929050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:44.929715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-888bfb92-6535-4d4d-a98f-4d2ac46d53d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:44.931310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1213/2453] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:44 2022] DELETE /identity/v3/projects/c6b061a858cd4f529759f9b23c453245 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:44.937205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b138-9874-47dd-a077-226d16d1b6d8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:44.937713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b138-9874-47dd-a077-226d16d1b6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:44.937825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b138-9874-47dd-a077-226d16d1b6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:44.959619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1880b138-9874-47dd-a077-226d16d1b6d8 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:44.961172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1880b138-9874-47dd-a077-226d16d1b6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:45.028423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1241/2454] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:45.037767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ef4a6-77c9-42e8-8525-0979a307d706 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:45.038056 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ef4a6-77c9-42e8-8525-0979a307d706 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:45.038330 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ef4a6-77c9-42e8-8525-0979a307d706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:45.063617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-6f7ef4a6-77c9-42e8-8525-0979a307d706 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:45.064900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6f7ef4a6-77c9-42e8-8525-0979a307d706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:45.075195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1214/2455] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:45.081097 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880b138-9874-47dd-a077-226d16d1b6d8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:45.094981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880b138-9874-47dd-a077-226d16d1b6d8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:45.101623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29cf45-e28a-4e91-803b-f4b6dc2a4091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:45.102490 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29cf45-e28a-4e91-803b-f4b6dc2a4091 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:45.103262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29cf45-e28a-4e91-803b-f4b6dc2a4091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:45.103262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29cf45-e28a-4e91-803b-f4b6dc2a4091 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:45.104080 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29cf45-e28a-4e91-803b-f4b6dc2a4091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:26:45.104453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29cf45-e28a-4e91-803b-f4b6dc2a4091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:45.106280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29cf45-e28a-4e91-803b-f4b6dc2a4091 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:45.120907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1242/2456] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:26:45.124910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ef4a6-77c9-42e8-8525-0979a307d706 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:45.137399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ef4a6-77c9-42e8-8525-0979a307d706 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:45.145374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7a8b9-d62d-4fe2-9b3e-3ef587d772e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:45.148272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7a8b9-d62d-4fe2-9b3e-3ef587d772e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:45.148272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7a8b9-d62d-4fe2-9b3e-3ef587d772e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:45.148272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7a8b9-d62d-4fe2-9b3e-3ef587d772e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:45.148272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7a8b9-d62d-4fe2-9b3e-3ef587d772e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:45.150869 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7a8b9-d62d-4fe2-9b3e-3ef587d772e0 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:45.245380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1215/2457] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:26:45 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:45.249688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29cf45-e28a-4e91-803b-f4b6dc2a4091 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:45.260663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29cf45-e28a-4e91-803b-f4b6dc2a4091 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:45.324967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c0233-b6ed-4c30-b32c-a06eda1c53e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:45.325567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0233-b6ed-4c30-b32c-a06eda1c53e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:45.325842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0233-b6ed-4c30-b32c-a06eda1c53e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:45.326107 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0233-b6ed-4c30-b32c-a06eda1c53e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:45.326801 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c0233-b6ed-4c30-b32c-a06eda1c53e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:45.328724 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c0233-b6ed-4c30-b32c-a06eda1c53e1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:45.463005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1243/2458] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:26:45 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:45.464597 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7a8b9-d62d-4fe2-9b3e-3ef587d772e0 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:45.475264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7a8b9-d62d-4fe2-9b3e-3ef587d772e0 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:45.483514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77180e-107c-4abd-a1f1-4e9d4638fe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:45.483514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77180e-107c-4abd-a1f1-4e9d4638fe6e admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:45.483514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77180e-107c-4abd-a1f1-4e9d4638fe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:45.483514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77180e-107c-4abd-a1f1-4e9d4638fe6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:45.483944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77180e-107c-4abd-a1f1-4e9d4638fe6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:45.483944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77180e-107c-4abd-a1f1-4e9d4638fe6e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:45.494073 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1216/2459] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:45.498152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c0233-b6ed-4c30-b32c-a06eda1c53e1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:45.508318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c0233-b6ed-4c30-b32c-a06eda1c53e1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:45.513660 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0eea3-38d8-4589-a54f-6ea957d6c54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:45.514254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0eea3-38d8-4589-a54f-6ea957d6c54a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:45.514530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0eea3-38d8-4589-a54f-6ea957d6c54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:45.514832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0eea3-38d8-4589-a54f-6ea957d6c54a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:45.515472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0eea3-38d8-4589-a54f-6ea957d6c54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:45.517061 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0eea3-38d8-4589-a54f-6ea957d6c54a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:45.527707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1244/2460] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:45.532365 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77180e-107c-4abd-a1f1-4e9d4638fe6e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:45.542395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77180e-107c-4abd-a1f1-4e9d4638fe6e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:45.547214 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a37333-3cc0-4323-85fb-88be2511e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:45.547857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37333-3cc0-4323-85fb-88be2511e580 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:45.548138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37333-3cc0-4323-85fb-88be2511e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:45.548412 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37333-3cc0-4323-85fb-88be2511e580 admin admin] PATH_INFO: `/v3/projects/5aa3ac86b258447d9318405e0b1f7a39/users/899e097db72c42d5b7c61881522784ab/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:45.564203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a37333-3cc0-4323-85fb-88be2511e580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa3ac86b258447d9318405e0b1f7a39, user_id=899e097db72c42d5b7c61881522784ab, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:45.566909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a37333-3cc0-4323-85fb-88be2511e580 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:45.625468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1217/2461] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:45 2022] PUT /identity/v3/projects/5aa3ac86b258447d9318405e0b1f7a39/users/899e097db72c42d5b7c61881522784ab/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:45.635796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec56635-6e97-401f-bce8-1f29de52bc59 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:45.636078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec56635-6e97-401f-bce8-1f29de52bc59 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:45.636354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec56635-6e97-401f-bce8-1f29de52bc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:45.663312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-aec56635-6e97-401f-bce8-1f29de52bc59 None None] MFA Rules not processed for user `899e097db72c42d5b7c61881522784ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:45.664534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-aec56635-6e97-401f-bce8-1f29de52bc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:45.711227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:45.732128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1245/2462] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:45.736451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a37333-3cc0-4323-85fb-88be2511e580 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:45.799482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a37333-3cc0-4323-85fb-88be2511e580 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:45.804182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f373e-aaf1-4e79-aeac-692f5579864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:45.804794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f373e-aaf1-4e79-aeac-692f5579864d admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:45.805075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f373e-aaf1-4e79-aeac-692f5579864d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:45.805374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f373e-aaf1-4e79-aeac-692f5579864d admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:45.806687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f373e-aaf1-4e79-aeac-692f5579864d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:45.808646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f373e-aaf1-4e79-aeac-692f5579864d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:45.889247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1218/2463] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:26:45 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:45.890503 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec56635-6e97-401f-bce8-1f29de52bc59 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:45.919921 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec56635-6e97-401f-bce8-1f29de52bc59 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:45.986441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ba65-57fd-4900-8c2c-83c65e7fc186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:45.987901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ba65-57fd-4900-8c2c-83c65e7fc186 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:45.988375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ba65-57fd-4900-8c2c-83c65e7fc186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:45.989293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ba65-57fd-4900-8c2c-83c65e7fc186 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:45.990148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ba65-57fd-4900-8c2c-83c65e7fc186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:45.992293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ba65-57fd-4900-8c2c-83c65e7fc186 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:46.083350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1246/2464] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:26:45 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:26:46.087966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f373e-aaf1-4e79-aeac-692f5579864d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:46.098348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f373e-aaf1-4e79-aeac-692f5579864d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:46.103784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683cef1-f681-4706-863f-cd59fdaa346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:46.104375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683cef1-f681-4706-863f-cd59fdaa346d admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:46.104650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683cef1-f681-4706-863f-cd59fdaa346d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:46.104917 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683cef1-f681-4706-863f-cd59fdaa346d admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:46.105546 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683cef1-f681-4706-863f-cd59fdaa346d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:46.107204 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683cef1-f681-4706-863f-cd59fdaa346d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:46.118249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1219/2465] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:46.122647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ba65-57fd-4900-8c2c-83c65e7fc186 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:46.132894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ba65-57fd-4900-8c2c-83c65e7fc186 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:46.137610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf68393-e52d-4ef3-95f3-2fbf734af72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:46.138262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68393-e52d-4ef3-95f3-2fbf734af72e admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:46.138545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68393-e52d-4ef3-95f3-2fbf734af72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:46.138847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68393-e52d-4ef3-95f3-2fbf734af72e admin admin] PATH_INFO: `/v3/projects/86eb45e8429246679fa23ceb2e34d3e4/users/9cfef350cd1148a2a05265b8b669ce0b/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:46.157663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf68393-e52d-4ef3-95f3-2fbf734af72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86eb45e8429246679fa23ceb2e34d3e4, user_id=9cfef350cd1148a2a05265b8b669ce0b, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:46.160367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf68393-e52d-4ef3-95f3-2fbf734af72e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:46.219700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1247/2466] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:46 2022] PUT /identity/v3/projects/86eb45e8429246679fa23ceb2e34d3e4/users/9cfef350cd1148a2a05265b8b669ce0b/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:46.224122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683cef1-f681-4706-863f-cd59fdaa346d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:46.237844 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683cef1-f681-4706-863f-cd59fdaa346d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:46.281078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:46.295623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb137aa-e5ff-4a53-8b04-46183af118b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:46.299340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb137aa-e5ff-4a53-8b04-46183af118b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:46.299340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb137aa-e5ff-4a53-8b04-46183af118b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:46.299340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb137aa-e5ff-4a53-8b04-46183af118b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:46.299340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb137aa-e5ff-4a53-8b04-46183af118b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:46.299340 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb137aa-e5ff-4a53-8b04-46183af118b3 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:46.312318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1220/2467] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:46.313449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf68393-e52d-4ef3-95f3-2fbf734af72e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:46.326655 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf68393-e52d-4ef3-95f3-2fbf734af72e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:46.332832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7410d6-bb35-4c29-9098-a5f9746d6d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:46.333854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7410d6-bb35-4c29-9098-a5f9746d6d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:46.334136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7410d6-bb35-4c29-9098-a5f9746d6d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:46.334861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7410d6-bb35-4c29-9098-a5f9746d6d64 admin admin] PATH_INFO: `/v3/projects/86eb45e8429246679fa23ceb2e34d3e4/users/9cfef350cd1148a2a05265b8b669ce0b/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:46.337595 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7410d6-bb35-4c29-9098-a5f9746d6d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86eb45e8429246679fa23ceb2e34d3e4, user_id=9cfef350cd1148a2a05265b8b669ce0b, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:46.340362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7410d6-bb35-4c29-9098-a5f9746d6d64 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:46.351965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1248/2468] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:46 2022] PUT /identity/v3/projects/86eb45e8429246679fa23ceb2e34d3e4/users/9cfef350cd1148a2a05265b8b669ce0b/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:26:46.362787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6603-a219-4276-ba22-1e2852418bc0 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:46.363131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6603-a219-4276-ba22-1e2852418bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:46.363381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe6603-a219-4276-ba22-1e2852418bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:46.394231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-34fe6603-a219-4276-ba22-1e2852418bc0 None None] MFA Rules not processed for user `9cfef350cd1148a2a05265b8b669ce0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:46.396229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-34fe6603-a219-4276-ba22-1e2852418bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:46.481616 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1221/2469] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:26:46.493383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7410d6-bb35-4c29-9098-a5f9746d6d64 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:46.495136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ad7410d6-bb35-4c29-9098-a5f9746d6d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:46.554755 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7410d6-bb35-4c29-9098-a5f9746d6d64 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:46.558373 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2577e5-790d-4435-99f3-aa51b1d602ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:46.558976 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2577e5-790d-4435-99f3-aa51b1d602ee service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:46.559251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2577e5-790d-4435-99f3-aa51b1d602ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:46.559509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2577e5-790d-4435-99f3-aa51b1d602ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:46.569709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2577e5-790d-4435-99f3-aa51b1d602ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:46.572156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2577e5-790d-4435-99f3-aa51b1d602ee service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:46.582109 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1249/2470] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:46.610757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe6603-a219-4276-ba22-1e2852418bc0 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:46.673451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe6603-a219-4276-ba22-1e2852418bc0 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:46.678274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85751549-1670-479d-8108-d83110fa1ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:46.678920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85751549-1670-479d-8108-d83110fa1ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:46.679199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85751549-1670-479d-8108-d83110fa1ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:46.679467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85751549-1670-479d-8108-d83110fa1ec0 admin admin] PATH_INFO: `/v3/users/899e097db72c42d5b7c61881522784ab` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:46.681120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85751549-1670-479d-8108-d83110fa1ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899e097db72c42d5b7c61881522784ab)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:46.683076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85751549-1670-479d-8108-d83110fa1ec0 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:46.867271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-85751549-1670-479d-8108-d83110fa1ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899e097db72c42d5b7c61881522784ab'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:46.868445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-85751549-1670-479d-8108-d83110fa1ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899e097db72c42d5b7c61881522784ab'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:46.916531 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-85751549-1670-479d-8108-d83110fa1ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899e097db72c42d5b7c61881522784ab'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:46.917194 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-85751549-1670-479d-8108-d83110fa1ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899e097db72c42d5b7c61881522784ab'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:46.924559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-85751549-1670-479d-8108-d83110fa1ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899e097db72c42d5b7c61881522784ab'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:46.929016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:46.938973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97b2c3-3396-4809-a290-4c0f15035f53 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:46.939252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97b2c3-3396-4809-a290-4c0f15035f53 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:46.939523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97b2c3-3396-4809-a290-4c0f15035f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:46.942805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1222/2471] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:26:46 2022] DELETE /identity/v3/users/899e097db72c42d5b7c61881522784ab => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:46.947770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50540847-2481-4fbf-aeed-7f231edc9e44 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:46.948159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50540847-2481-4fbf-aeed-7f231edc9e44 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:46.948567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50540847-2481-4fbf-aeed-7f231edc9e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:46.960016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0f97b2c3-3396-4809-a290-4c0f15035f53 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:46.961241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0f97b2c3-3396-4809-a290-4c0f15035f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:46.977014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-50540847-2481-4fbf-aeed-7f231edc9e44 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:46.978301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-50540847-2481-4fbf-aeed-7f231edc9e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:47.003575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:47.025702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1250/2472] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 16:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:26:47.042731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97b2c3-3396-4809-a290-4c0f15035f53 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:47.044176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0f97b2c3-3396-4809-a290-4c0f15035f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:47.047038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1223/2473] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:26:47.057413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50540847-2481-4fbf-aeed-7f231edc9e44 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:47.058903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-50540847-2481-4fbf-aeed-7f231edc9e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:47.114063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50540847-2481-4fbf-aeed-7f231edc9e44 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:47.117876 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1f252-9a6f-4def-8c73-c7f1040c2049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:47.119028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f252-9a6f-4def-8c73-c7f1040c2049 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:47.119301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f252-9a6f-4def-8c73-c7f1040c2049 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:47.119567 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f252-9a6f-4def-8c73-c7f1040c2049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:47.126073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97b2c3-3396-4809-a290-4c0f15035f53 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:47.132268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d1b2a-aed6-4656-9eed-4cd82d30dfdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:47.133901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d1b2a-aed6-4656-9eed-4cd82d30dfdd service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:47.133901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d1b2a-aed6-4656-9eed-4cd82d30dfdd service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:47.133901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d1b2a-aed6-4656-9eed-4cd82d30dfdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:47.134174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1f252-9a6f-4def-8c73-c7f1040c2049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:47.135270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1f252-9a6f-4def-8c73-c7f1040c2049 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:47.144290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d1b2a-aed6-4656-9eed-4cd82d30dfdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:47.146443 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1224/2474] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:26:47.146586 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d1b2a-aed6-4656-9eed-4cd82d30dfdd service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:47.156984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1251/2475] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:26:47.586273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1f252-9a6f-4def-8c73-c7f1040c2049 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:47.588279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-fca1f252-9a6f-4def-8c73-c7f1040c2049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:47.604254 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1f252-9a6f-4def-8c73-c7f1040c2049 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:47.609683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:47.610319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:47.610597 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:47.610900 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] PATH_INFO: `/v3/projects/5aa3ac86b258447d9318405e0b1f7a39` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:47.612246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa3ac86b258447d9318405e0b1f7a39)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:47.614525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:47.729396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa3ac86b258447d9318405e0b1f7a39', 'request_id': 'req-88794ffd-6c08-4aac-bcbc-0f41a792dae6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:47.735079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa3ac86b258447d9318405e0b1f7a39', 'request_id': 'req-88794ffd-6c08-4aac-bcbc-0f41a792dae6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:47.741286 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa3ac86b258447d9318405e0b1f7a39', 'request_id': 'req-88794ffd-6c08-4aac-bcbc-0f41a792dae6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:47.801722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] The token cache is being invalidate because project 5aa3ac86b258447d9318405e0b1f7a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:47.802012 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:47.802621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:47.804120 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1225/2476] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:47 2022] DELETE /identity/v3/projects/5aa3ac86b258447d9318405e0b1f7a39 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:47.808201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d1b2a-aed6-4656-9eed-4cd82d30dfdd service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:47.818054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d1b2a-aed6-4656-9eed-4cd82d30dfdd service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:47.873533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14d9c4-e088-45e8-95b7-97667a438aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:47.874146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14d9c4-e088-45e8-95b7-97667a438aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:47.874423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14d9c4-e088-45e8-95b7-97667a438aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:47.874713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14d9c4-e088-45e8-95b7-97667a438aa7 admin admin] PATH_INFO: `/v3/users/9cfef350cd1148a2a05265b8b669ce0b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:47.875902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14d9c4-e088-45e8-95b7-97667a438aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cfef350cd1148a2a05265b8b669ce0b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:47.877741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14d9c4-e088-45e8-95b7-97667a438aa7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:48.113293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4f14d9c4-e088-45e8-95b7-97667a438aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cfef350cd1148a2a05265b8b669ce0b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:48.113940 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4f14d9c4-e088-45e8-95b7-97667a438aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cfef350cd1148a2a05265b8b669ce0b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:48.190827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4f14d9c4-e088-45e8-95b7-97667a438aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cfef350cd1148a2a05265b8b669ce0b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:48.191443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4f14d9c4-e088-45e8-95b7-97667a438aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cfef350cd1148a2a05265b8b669ce0b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:48.199379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4f14d9c4-e088-45e8-95b7-97667a438aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cfef350cd1148a2a05265b8b669ce0b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:48.204465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:48.216737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1252/2477] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:26:47 2022] DELETE /identity/v3/users/9cfef350cd1148a2a05265b8b669ce0b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:48.598438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:48.599907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:48.628843 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88794ffd-6c08-4aac-bcbc-0f41a792dae6 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:48.636993 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:48.693418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:48.694035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:48.694313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:48.694587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] PATH_INFO: `/v3/projects/86eb45e8429246679fa23ceb2e34d3e4` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:48.695762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86eb45e8429246679fa23ceb2e34d3e4)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:48.697685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:48.843183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86eb45e8429246679fa23ceb2e34d3e4', 'request_id': 'req-e85f5b71-d47d-4895-9def-8b973399bf82'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:48.848867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86eb45e8429246679fa23ceb2e34d3e4', 'request_id': 'req-e85f5b71-d47d-4895-9def-8b973399bf82'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:48.856050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86eb45e8429246679fa23ceb2e34d3e4', 'request_id': 'req-e85f5b71-d47d-4895-9def-8b973399bf82'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:48.933374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] The token cache is being invalidate because project 86eb45e8429246679fa23ceb2e34d3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:48.933665 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:48.934275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e85f5b71-d47d-4895-9def-8b973399bf82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:48.935786 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1226/2478] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:48 2022] DELETE /identity/v3/projects/86eb45e8429246679fa23ceb2e34d3e4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:48.940557 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b3e80-c838-4223-846a-b991bec2a8d9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:48.940843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b3e80-c838-4223-846a-b991bec2a8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:48.941119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b3e80-c838-4223-846a-b991bec2a8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:48.960733 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1c2b3e80-c838-4223-846a-b991bec2a8d9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:48.962497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1c2b3e80-c838-4223-846a-b991bec2a8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:49.023826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1253/2479] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:49.032871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689dc3-7cab-4302-9cf0-f1afef665cac None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:49.033157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689dc3-7cab-4302-9cf0-f1afef665cac None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:49.033433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689dc3-7cab-4302-9cf0-f1afef665cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:49.054088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-ab689dc3-7cab-4302-9cf0-f1afef665cac None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:49.055313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ab689dc3-7cab-4302-9cf0-f1afef665cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:49.063265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1227/2480] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:49.067532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b3e80-c838-4223-846a-b991bec2a8d9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:49.077315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b3e80-c838-4223-846a-b991bec2a8d9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:49.081936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f8000-c167-4f72-9d8e-579cec339b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:49.082529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f8000-c167-4f72-9d8e-579cec339b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:49.082837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f8000-c167-4f72-9d8e-579cec339b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:49.083110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f8000-c167-4f72-9d8e-579cec339b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:49.083748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f8000-c167-4f72-9d8e-579cec339b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:26:49.084051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f8000-c167-4f72-9d8e-579cec339b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:49.085676 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f8000-c167-4f72-9d8e-579cec339b42 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:49.098634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1254/2481] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:26:49.103865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab689dc3-7cab-4302-9cf0-f1afef665cac None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:49.113163 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab689dc3-7cab-4302-9cf0-f1afef665cac None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:49.117938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e0188-6eb7-448d-904e-39b1b2572520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:49.118529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0188-6eb7-448d-904e-39b1b2572520 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:49.118841 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0188-6eb7-448d-904e-39b1b2572520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:49.119111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0188-6eb7-448d-904e-39b1b2572520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:49.119727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e0188-6eb7-448d-904e-39b1b2572520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:49.121628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e0188-6eb7-448d-904e-39b1b2572520 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:49.192763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1228/2482] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:26:49 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:49.197007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f8000-c167-4f72-9d8e-579cec339b42 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:49.207251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f8000-c167-4f72-9d8e-579cec339b42 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:49.264132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc4703-450a-4a46-a17c-a49f6c1d1828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:49.264651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc4703-450a-4a46-a17c-a49f6c1d1828 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:49.264923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc4703-450a-4a46-a17c-a49f6c1d1828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:49.265189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc4703-450a-4a46-a17c-a49f6c1d1828 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:49.265819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc4703-450a-4a46-a17c-a49f6c1d1828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:49.267764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc4703-450a-4a46-a17c-a49f6c1d1828 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:49.345378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1255/2483] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:26:49 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:49.349607 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e0188-6eb7-448d-904e-39b1b2572520 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:49.360532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e0188-6eb7-448d-904e-39b1b2572520 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:49.365161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712b0f3-ff47-49a6-b920-56075e9fbb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:49.365743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712b0f3-ff47-49a6-b920-56075e9fbb67 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:49.366016 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712b0f3-ff47-49a6-b920-56075e9fbb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:49.366283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712b0f3-ff47-49a6-b920-56075e9fbb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:49.366941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712b0f3-ff47-49a6-b920-56075e9fbb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:49.369188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712b0f3-ff47-49a6-b920-56075e9fbb67 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:49.378825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1229/2484] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:49.382649 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc4703-450a-4a46-a17c-a49f6c1d1828 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:49.392475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc4703-450a-4a46-a17c-a49f6c1d1828 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:49.397086 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f343052-7917-4601-8b8b-27d79edd6578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:49.397671 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343052-7917-4601-8b8b-27d79edd6578 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:49.397945 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343052-7917-4601-8b8b-27d79edd6578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:49.398213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343052-7917-4601-8b8b-27d79edd6578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:49.398874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f343052-7917-4601-8b8b-27d79edd6578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:49.400530 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f343052-7917-4601-8b8b-27d79edd6578 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:49.411027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1256/2485] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:49.415596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712b0f3-ff47-49a6-b920-56075e9fbb67 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:49.426232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712b0f3-ff47-49a6-b920-56075e9fbb67 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:49.431685 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d0de8-fee7-4022-b519-7ce13c5d445f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:49.432332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d0de8-fee7-4022-b519-7ce13c5d445f admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:49.432608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d0de8-fee7-4022-b519-7ce13c5d445f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:49.432880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d0de8-fee7-4022-b519-7ce13c5d445f admin admin] PATH_INFO: `/v3/projects/78214e77ea094539ae218badcb4400b6/users/1c08036c6e3c4209a0c9ef15ac3a1c20/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:49.447522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d0de8-fee7-4022-b519-7ce13c5d445f admin admin] RBAC: Authorizing `identity:create_grant(project_id=78214e77ea094539ae218badcb4400b6, user_id=1c08036c6e3c4209a0c9ef15ac3a1c20, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:49.450245 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d0de8-fee7-4022-b519-7ce13c5d445f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:49.534417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1230/2486] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:49 2022] PUT /identity/v3/projects/78214e77ea094539ae218badcb4400b6/users/1c08036c6e3c4209a0c9ef15ac3a1c20/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:49.545313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74e1e2-fb3b-47c5-9dad-4a087c2f9ac4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:49.545663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74e1e2-fb3b-47c5-9dad-4a087c2f9ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:49.546359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74e1e2-fb3b-47c5-9dad-4a087c2f9ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:49.574092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5c74e1e2-fb3b-47c5-9dad-4a087c2f9ac4 None None] MFA Rules not processed for user `1c08036c6e3c4209a0c9ef15ac3a1c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:49.575320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5c74e1e2-fb3b-47c5-9dad-4a087c2f9ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:49.614999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:49.637146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1257/2487] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:49.641963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d0de8-fee7-4022-b519-7ce13c5d445f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:49.684172 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:49.704426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d0de8-fee7-4022-b519-7ce13c5d445f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:49.709135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f2064-ada9-4a66-abf9-705a161e27ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:49.709733 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2064-ada9-4a66-abf9-705a161e27ea admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:49.710010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2064-ada9-4a66-abf9-705a161e27ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:49.710279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2064-ada9-4a66-abf9-705a161e27ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:49.711033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f2064-ada9-4a66-abf9-705a161e27ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:49.713522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f2064-ada9-4a66-abf9-705a161e27ea admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:49.803221 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1231/2488] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:26:49 2022] POST /identity/v3/projects => generated 389 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:49.807849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74e1e2-fb3b-47c5-9dad-4a087c2f9ac4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:49.818315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74e1e2-fb3b-47c5-9dad-4a087c2f9ac4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:49.873071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743bd1-5ab9-49ca-ab32-fccf6baabb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:49.873662 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743bd1-5ab9-49ca-ab32-fccf6baabb73 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:49.873937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743bd1-5ab9-49ca-ab32-fccf6baabb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:49.874202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743bd1-5ab9-49ca-ab32-fccf6baabb73 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:49.874856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd743bd1-5ab9-49ca-ab32-fccf6baabb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:49.876764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd743bd1-5ab9-49ca-ab32-fccf6baabb73 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:49.965077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1258/2489] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:26:49 2022] POST /identity/v3/users => generated 301 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:49.966271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f2064-ada9-4a66-abf9-705a161e27ea admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:49.976966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f2064-ada9-4a66-abf9-705a161e27ea admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:49.981592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bc606-1c79-4026-878b-0c4403f87442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:49.982199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bc606-1c79-4026-878b-0c4403f87442 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:49.982473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bc606-1c79-4026-878b-0c4403f87442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:49.982767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bc606-1c79-4026-878b-0c4403f87442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:49.983601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bc606-1c79-4026-878b-0c4403f87442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:49.985201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bc606-1c79-4026-878b-0c4403f87442 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:49.996150 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1232/2490] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:50.000300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743bd1-5ab9-49ca-ab32-fccf6baabb73 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:50.011113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743bd1-5ab9-49ca-ab32-fccf6baabb73 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:50.015792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4738d4-dc42-42db-99b7-43d25d8ee004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:50.016470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4738d4-dc42-42db-99b7-43d25d8ee004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:50.016744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4738d4-dc42-42db-99b7-43d25d8ee004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:50.017010 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4738d4-dc42-42db-99b7-43d25d8ee004 admin admin] PATH_INFO: `/v3/projects/4901cd49de76411dacc0c981b2c34b3b/users/6b50cd1c8fdb430abb75c705285dfcd6/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:50.032685 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4738d4-dc42-42db-99b7-43d25d8ee004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4901cd49de76411dacc0c981b2c34b3b, user_id=6b50cd1c8fdb430abb75c705285dfcd6, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:50.035457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4738d4-dc42-42db-99b7-43d25d8ee004 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:50.128223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1259/2491] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:49 2022] PUT /identity/v3/projects/4901cd49de76411dacc0c981b2c34b3b/users/6b50cd1c8fdb430abb75c705285dfcd6/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:50.132072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bc606-1c79-4026-878b-0c4403f87442 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:50.142100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bc606-1c79-4026-878b-0c4403f87442 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:50.197409 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dbf9c-f82e-4d8b-a056-be36495f0766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:50.198006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dbf9c-f82e-4d8b-a056-be36495f0766 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:50.198301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dbf9c-f82e-4d8b-a056-be36495f0766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:50.198551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dbf9c-f82e-4d8b-a056-be36495f0766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:50.199211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dbf9c-f82e-4d8b-a056-be36495f0766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:50.200801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dbf9c-f82e-4d8b-a056-be36495f0766 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:50.210170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1233/2492] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:50.214310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4738d4-dc42-42db-99b7-43d25d8ee004 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:50.224651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4738d4-dc42-42db-99b7-43d25d8ee004 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:50.229784 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c917b6-14ea-4846-a4ab-b8bc86e58cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:50.230420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c917b6-14ea-4846-a4ab-b8bc86e58cea admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:50.230715 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c917b6-14ea-4846-a4ab-b8bc86e58cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:50.230988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c917b6-14ea-4846-a4ab-b8bc86e58cea admin admin] PATH_INFO: `/v3/projects/4901cd49de76411dacc0c981b2c34b3b/users/6b50cd1c8fdb430abb75c705285dfcd6/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:50.232868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c917b6-14ea-4846-a4ab-b8bc86e58cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4901cd49de76411dacc0c981b2c34b3b, user_id=6b50cd1c8fdb430abb75c705285dfcd6, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:50.235534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c917b6-14ea-4846-a4ab-b8bc86e58cea admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:50.246005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1260/2493] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:50 2022] PUT /identity/v3/projects/4901cd49de76411dacc0c981b2c34b3b/users/6b50cd1c8fdb430abb75c705285dfcd6/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:50.255868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855d65-7894-418b-a70c-67c730c6ebc9 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:50.256152 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855d65-7894-418b-a70c-67c730c6ebc9 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:50.256426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855d65-7894-418b-a70c-67c730c6ebc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:50.283248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-26855d65-7894-418b-a70c-67c730c6ebc9 None None] MFA Rules not processed for user `6b50cd1c8fdb430abb75c705285dfcd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:50.284440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-26855d65-7894-418b-a70c-67c730c6ebc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:50.350339 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1234/2494] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:50.361487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c917b6-14ea-4846-a4ab-b8bc86e58cea admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:50.363220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-47c917b6-14ea-4846-a4ab-b8bc86e58cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:50.427484 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c917b6-14ea-4846-a4ab-b8bc86e58cea admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:50.431264 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ff069-4106-494d-8439-5bd0caa07be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:50.431871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ff069-4106-494d-8439-5bd0caa07be2 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:50.432153 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ff069-4106-494d-8439-5bd0caa07be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:50.432419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ff069-4106-494d-8439-5bd0caa07be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:50.441532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ff069-4106-494d-8439-5bd0caa07be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:50.442974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ff069-4106-494d-8439-5bd0caa07be2 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:50.452281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1261/2495] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:50.589952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26855d65-7894-418b-a70c-67c730c6ebc9 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:50.626603 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:50.653731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26855d65-7894-418b-a70c-67c730c6ebc9 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:50.658621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:50.659262 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:50.659553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:50.659808 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] PATH_INFO: `/v3/users/1c08036c6e3c4209a0c9ef15ac3a1c20` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:50.660917 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c08036c6e3c4209a0c9ef15ac3a1c20)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:50.662892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:50.872334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c08036c6e3c4209a0c9ef15ac3a1c20'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:50.872978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c08036c6e3c4209a0c9ef15ac3a1c20'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:50.927154 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c08036c6e3c4209a0c9ef15ac3a1c20'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:50.927708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c08036c6e3c4209a0c9ef15ac3a1c20'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:50.934774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c08036c6e3c4209a0c9ef15ac3a1c20'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:50.952264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1235/2496] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:26:50 2022] DELETE /identity/v3/users/1c08036c6e3c4209a0c9ef15ac3a1c20 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:50.956799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5a255-cdea-4a21-9e3c-0a4b088fda4c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:50.957163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5a255-cdea-4a21-9e3c-0a4b088fda4c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:50.957531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5a255-cdea-4a21-9e3c-0a4b088fda4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:50.976599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f6d5a255-cdea-4a21-9e3c-0a4b088fda4c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:50.977780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f6d5a255-cdea-4a21-9e3c-0a4b088fda4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:51.010553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:51.037539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1262/2497] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:51.047530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:51.048979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:51.106276 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65968600-28fd-4000-83b9-7993dd7beecf admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:51.109867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e865-48a2-4a44-bc2b-a62c859a5816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:51.110466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e865-48a2-4a44-bc2b-a62c859a5816 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:51.110775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e865-48a2-4a44-bc2b-a62c859a5816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:51.111047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e865-48a2-4a44-bc2b-a62c859a5816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:51.120620 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7e865-48a2-4a44-bc2b-a62c859a5816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:51.122047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7e865-48a2-4a44-bc2b-a62c859a5816 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:51.132085 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1236/2498] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:51.501752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5a255-cdea-4a21-9e3c-0a4b088fda4c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:51.503269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f6d5a255-cdea-4a21-9e3c-0a4b088fda4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:51.516230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5a255-cdea-4a21-9e3c-0a4b088fda4c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:51.521445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:51.522081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:51.522361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:51.522631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] PATH_INFO: `/v3/projects/78214e77ea094539ae218badcb4400b6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:51.523794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78214e77ea094539ae218badcb4400b6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:51.525714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:51.642598 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78214e77ea094539ae218badcb4400b6', 'request_id': 'req-0aa2e0e0-010d-466d-90f4-f779132dd3e3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:51.648138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78214e77ea094539ae218badcb4400b6', 'request_id': 'req-0aa2e0e0-010d-466d-90f4-f779132dd3e3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:51.654265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78214e77ea094539ae218badcb4400b6', 'request_id': 'req-0aa2e0e0-010d-466d-90f4-f779132dd3e3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:51.733882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] The token cache is being invalidate because project 78214e77ea094539ae218badcb4400b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:51.734166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:51.734811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:51.736292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1263/2499] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:51 2022] DELETE /identity/v3/projects/78214e77ea094539ae218badcb4400b6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:51.740268 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e865-48a2-4a44-bc2b-a62c859a5816 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:51.750519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e865-48a2-4a44-bc2b-a62c859a5816 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:51.799349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:51.806611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceec5b-c392-4ee5-87bf-be0e2bc972c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:51.807267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceec5b-c392-4ee5-87bf-be0e2bc972c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:51.807548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceec5b-c392-4ee5-87bf-be0e2bc972c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:51.807823 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceec5b-c392-4ee5-87bf-be0e2bc972c8 admin admin] PATH_INFO: `/v3/users/6b50cd1c8fdb430abb75c705285dfcd6` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:51.808974 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ceec5b-c392-4ee5-87bf-be0e2bc972c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b50cd1c8fdb430abb75c705285dfcd6)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:51.811088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ceec5b-c392-4ee5-87bf-be0e2bc972c8 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:51.998426 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-80ceec5b-c392-4ee5-87bf-be0e2bc972c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b50cd1c8fdb430abb75c705285dfcd6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:51.999099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-80ceec5b-c392-4ee5-87bf-be0e2bc972c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b50cd1c8fdb430abb75c705285dfcd6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:52.053814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-80ceec5b-c392-4ee5-87bf-be0e2bc972c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b50cd1c8fdb430abb75c705285dfcd6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:52.054358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-80ceec5b-c392-4ee5-87bf-be0e2bc972c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b50cd1c8fdb430abb75c705285dfcd6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:52.061491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-80ceec5b-c392-4ee5-87bf-be0e2bc972c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b50cd1c8fdb430abb75c705285dfcd6'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:52.079038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1237/2500] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:26:51 2022] DELETE /identity/v3/users/6b50cd1c8fdb430abb75c705285dfcd6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:52.495601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:52.497108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:52.512921 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2e0e0-010d-466d-90f4-f779132dd3e3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:52.569534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:52.570095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:52.570367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:52.570635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] PATH_INFO: `/v3/projects/4901cd49de76411dacc0c981b2c34b3b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:52.572278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4901cd49de76411dacc0c981b2c34b3b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:52.574161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:52.660899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4901cd49de76411dacc0c981b2c34b3b', 'request_id': 'req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:52.666540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4901cd49de76411dacc0c981b2c34b3b', 'request_id': 'req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:52.672884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4901cd49de76411dacc0c981b2c34b3b', 'request_id': 'req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:52.674533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:52.715628 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] The token cache is being invalidate because project 4901cd49de76411dacc0c981b2c34b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:52.715916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:52.716533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5d16cd9b-1770-4953-ae42-d4fd5f1a2ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:52.718057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1264/2501] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:52 2022] DELETE /identity/v3/projects/4901cd49de76411dacc0c981b2c34b3b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:52.723103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c8d19-b789-4d8e-8330-e2b1f95ced67 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:52.724369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c8d19-b789-4d8e-8330-e2b1f95ced67 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:52.724369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c8d19-b789-4d8e-8330-e2b1f95ced67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:52.744211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b24c8d19-b789-4d8e-8330-e2b1f95ced67 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:52.745433 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b24c8d19-b789-4d8e-8330-e2b1f95ced67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:52.804009 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1238/2502] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:52.812700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e3be-2365-4fe9-87df-f595babf256e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:52.812959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e3be-2365-4fe9-87df-f595babf256e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:52.813229 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e3be-2365-4fe9-87df-f595babf256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:52.837343 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ad45e3be-2365-4fe9-87df-f595babf256e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:52.838533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ad45e3be-2365-4fe9-87df-f595babf256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:52.847629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1265/2503] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:52.851924 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c8d19-b789-4d8e-8330-e2b1f95ced67 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:52.861767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c8d19-b789-4d8e-8330-e2b1f95ced67 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:52.867037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38498aca-e142-40da-9542-d56e5538e82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:52.868313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498aca-e142-40da-9542-d56e5538e82e admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:52.868654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498aca-e142-40da-9542-d56e5538e82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:52.868943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498aca-e142-40da-9542-d56e5538e82e admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:52.869601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38498aca-e142-40da-9542-d56e5538e82e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:26:52.869906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38498aca-e142-40da-9542-d56e5538e82e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:52.871561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38498aca-e142-40da-9542-d56e5538e82e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:52.884193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1239/2504] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:26:52.888397 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45e3be-2365-4fe9-87df-f595babf256e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:52.898515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45e3be-2365-4fe9-87df-f595babf256e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:52.903284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d432d-57a5-4414-81c6-7caa9dfe3081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:52.903890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d432d-57a5-4414-81c6-7caa9dfe3081 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:52.904169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d432d-57a5-4414-81c6-7caa9dfe3081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:52.904440 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d432d-57a5-4414-81c6-7caa9dfe3081 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:52.905066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d432d-57a5-4414-81c6-7caa9dfe3081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:52.907041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d432d-57a5-4414-81c6-7caa9dfe3081 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:53.032895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1266/2505] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:26:52 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:53.037193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38498aca-e142-40da-9542-d56e5538e82e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:53.048269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38498aca-e142-40da-9542-d56e5538e82e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:53.107741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf819618-ab89-4cfd-8781-e64003a07052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:53.108261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf819618-ab89-4cfd-8781-e64003a07052 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:53.108543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf819618-ab89-4cfd-8781-e64003a07052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:53.108818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf819618-ab89-4cfd-8781-e64003a07052 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:53.109461 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf819618-ab89-4cfd-8781-e64003a07052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:53.111479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf819618-ab89-4cfd-8781-e64003a07052 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:53.121251 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:53.226195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1240/2506] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:26:53 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:53.231676 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d432d-57a5-4414-81c6-7caa9dfe3081 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:53.242165 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d432d-57a5-4414-81c6-7caa9dfe3081 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:53.248499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fdb4b-3e79-4c8e-ad5b-205dac09e447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:53.249228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fdb4b-3e79-4c8e-ad5b-205dac09e447 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:53.249623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fdb4b-3e79-4c8e-ad5b-205dac09e447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:53.250288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fdb4b-3e79-4c8e-ad5b-205dac09e447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:53.251476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fdb4b-3e79-4c8e-ad5b-205dac09e447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:53.254537 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fdb4b-3e79-4c8e-ad5b-205dac09e447 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:53.266826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1267/2507] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:53.271598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf819618-ab89-4cfd-8781-e64003a07052 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:53.281737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf819618-ab89-4cfd-8781-e64003a07052 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:53.286471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b602d-1598-4ab0-85fc-c51bb8d84f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:53.287097 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b602d-1598-4ab0-85fc-c51bb8d84f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:53.287381 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b602d-1598-4ab0-85fc-c51bb8d84f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:53.287652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b602d-1598-4ab0-85fc-c51bb8d84f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:53.288288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b602d-1598-4ab0-85fc-c51bb8d84f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:53.290408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b602d-1598-4ab0-85fc-c51bb8d84f23 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:53.302505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1241/2508] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:53.307314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fdb4b-3e79-4c8e-ad5b-205dac09e447 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:53.318113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fdb4b-3e79-4c8e-ad5b-205dac09e447 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:53.322734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0fc10-33ca-4e0d-89bc-4cce9f017ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:53.323379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0fc10-33ca-4e0d-89bc-4cce9f017ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:53.323651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0fc10-33ca-4e0d-89bc-4cce9f017ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:53.323916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0fc10-33ca-4e0d-89bc-4cce9f017ec7 admin admin] PATH_INFO: `/v3/projects/002611f0eb0848c0aa1c9b4ff3bac7e7/users/4ae9498b6e3846ddb18c0bcdfcf00b8b/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:53.338406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0fc10-33ca-4e0d-89bc-4cce9f017ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=002611f0eb0848c0aa1c9b4ff3bac7e7, user_id=4ae9498b6e3846ddb18c0bcdfcf00b8b, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:53.341716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0fc10-33ca-4e0d-89bc-4cce9f017ec7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:53.418038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1268/2509] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:53 2022] PUT /identity/v3/projects/002611f0eb0848c0aa1c9b4ff3bac7e7/users/4ae9498b6e3846ddb18c0bcdfcf00b8b/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:53.429927 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a41c2b-ea21-421e-8bb7-9b09f378e7df None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:53.430477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a41c2b-ea21-421e-8bb7-9b09f378e7df None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:53.430942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a41c2b-ea21-421e-8bb7-9b09f378e7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:53.463001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-18a41c2b-ea21-421e-8bb7-9b09f378e7df None None] MFA Rules not processed for user `4ae9498b6e3846ddb18c0bcdfcf00b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:53.464242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-18a41c2b-ea21-421e-8bb7-9b09f378e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:53.532388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1242/2510] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:53.536630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0fc10-33ca-4e0d-89bc-4cce9f017ec7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:53.600915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0fc10-33ca-4e0d-89bc-4cce9f017ec7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:53.606274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aeb250-8d1e-40a8-b2d6-8b009cf58053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:53.606918 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb250-8d1e-40a8-b2d6-8b009cf58053 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:53.607202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb250-8d1e-40a8-b2d6-8b009cf58053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:53.607473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb250-8d1e-40a8-b2d6-8b009cf58053 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:53.608117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aeb250-8d1e-40a8-b2d6-8b009cf58053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:53.610029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aeb250-8d1e-40a8-b2d6-8b009cf58053 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:53.689654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1269/2511] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:26:53 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:53.693557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a41c2b-ea21-421e-8bb7-9b09f378e7df None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:53.704136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a41c2b-ea21-421e-8bb7-9b09f378e7df None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:53.760186 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8d8a6-309d-4ca2-9c9d-6cd0e714c9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:53.760852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8d8a6-309d-4ca2-9c9d-6cd0e714c9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:53.761054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8d8a6-309d-4ca2-9c9d-6cd0e714c9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:53.761330 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8d8a6-309d-4ca2-9c9d-6cd0e714c9b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:53.761950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8d8a6-309d-4ca2-9c9d-6cd0e714c9b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:53.763949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8d8a6-309d-4ca2-9c9d-6cd0e714c9b8 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:53.837436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1243/2512] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:26:53 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:53.841203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aeb250-8d1e-40a8-b2d6-8b009cf58053 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:53.851834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aeb250-8d1e-40a8-b2d6-8b009cf58053 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:53.856731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc31ed8-1026-4c13-b037-a76d53f96c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:53.857324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc31ed8-1026-4c13-b037-a76d53f96c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:53.857601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc31ed8-1026-4c13-b037-a76d53f96c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:53.857871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc31ed8-1026-4c13-b037-a76d53f96c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:53.858505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc31ed8-1026-4c13-b037-a76d53f96c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:53.860263 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc31ed8-1026-4c13-b037-a76d53f96c4f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:53.871212 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1270/2513] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:53.875161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8d8a6-309d-4ca2-9c9d-6cd0e714c9b8 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:53.885841 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8d8a6-309d-4ca2-9c9d-6cd0e714c9b8 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:53.890505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6afaaf-1858-45e1-a1d3-a1d6ea4fd2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:53.891190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6afaaf-1858-45e1-a1d3-a1d6ea4fd2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:53.891474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6afaaf-1858-45e1-a1d3-a1d6ea4fd2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:53.891745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6afaaf-1858-45e1-a1d3-a1d6ea4fd2fa admin admin] PATH_INFO: `/v3/projects/127c3334fb524baca4aa4bc2f58b99db/users/cc0fbc8bb59043b58028bba741243bca/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:53.907518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6afaaf-1858-45e1-a1d3-a1d6ea4fd2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=127c3334fb524baca4aa4bc2f58b99db, user_id=cc0fbc8bb59043b58028bba741243bca, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:53.910252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6afaaf-1858-45e1-a1d3-a1d6ea4fd2fa admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:54.007950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1244/2514] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:53 2022] PUT /identity/v3/projects/127c3334fb524baca4aa4bc2f58b99db/users/cc0fbc8bb59043b58028bba741243bca/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:54.012611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc31ed8-1026-4c13-b037-a76d53f96c4f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:54.022689 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc31ed8-1026-4c13-b037-a76d53f96c4f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:54.078216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d800372-68f2-4488-903b-d199a14a664f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:54.078849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800372-68f2-4488-903b-d199a14a664f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:54.079129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800372-68f2-4488-903b-d199a14a664f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:54.079402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800372-68f2-4488-903b-d199a14a664f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:54.080031 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d800372-68f2-4488-903b-d199a14a664f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:54.081616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d800372-68f2-4488-903b-d199a14a664f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:54.083576 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:54.091975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1271/2515] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:54.096077 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6afaaf-1858-45e1-a1d3-a1d6ea4fd2fa admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:54.106578 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6afaaf-1858-45e1-a1d3-a1d6ea4fd2fa admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:54.111341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c42d6-4317-4500-b39a-450fd9255754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:54.111987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c42d6-4317-4500-b39a-450fd9255754 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:54.112265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c42d6-4317-4500-b39a-450fd9255754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:54.112540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c42d6-4317-4500-b39a-450fd9255754 admin admin] PATH_INFO: `/v3/projects/127c3334fb524baca4aa4bc2f58b99db/users/cc0fbc8bb59043b58028bba741243bca/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:54.114462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c42d6-4317-4500-b39a-450fd9255754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127c3334fb524baca4aa4bc2f58b99db, user_id=cc0fbc8bb59043b58028bba741243bca, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:54.117209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c42d6-4317-4500-b39a-450fd9255754 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:54.127891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1245/2516] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:54 2022] PUT /identity/v3/projects/127c3334fb524baca4aa4bc2f58b99db/users/cc0fbc8bb59043b58028bba741243bca/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:54.139544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef80c-64d9-47d3-8716-6b4c1138e4cf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:54.139831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef80c-64d9-47d3-8716-6b4c1138e4cf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:54.140110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef80c-64d9-47d3-8716-6b4c1138e4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:54.168155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f7aef80c-64d9-47d3-8716-6b4c1138e4cf None None] MFA Rules not processed for user `cc0fbc8bb59043b58028bba741243bca`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:54.169356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f7aef80c-64d9-47d3-8716-6b4c1138e4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:54.235954 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1272/2517] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:54.247272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c42d6-4317-4500-b39a-450fd9255754 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:54.249084 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-8f1c42d6-4317-4500-b39a-450fd9255754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:54.275576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:54.307015 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c42d6-4317-4500-b39a-450fd9255754 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:54.310898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d3d3c-cc43-4a50-b9b9-a4406ab48051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:54.311481 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3d3c-cc43-4a50-b9b9-a4406ab48051 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:54.311754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3d3c-cc43-4a50-b9b9-a4406ab48051 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:54.312018 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3d3c-cc43-4a50-b9b9-a4406ab48051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:54.320688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d3d3c-cc43-4a50-b9b9-a4406ab48051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:54.322715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d3d3c-cc43-4a50-b9b9-a4406ab48051 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:54.332245 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1246/2518] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:55.611078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aef80c-64d9-47d3-8716-6b4c1138e4cf None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:55.673071 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aef80c-64d9-47d3-8716-6b4c1138e4cf None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:55.677578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:55.678189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:55.678461 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:55.678763 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] PATH_INFO: `/v3/users/4ae9498b6e3846ddb18c0bcdfcf00b8b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:55.679856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae9498b6e3846ddb18c0bcdfcf00b8b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:55.682277 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:55.891407 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae9498b6e3846ddb18c0bcdfcf00b8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:55.892059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae9498b6e3846ddb18c0bcdfcf00b8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:55.952209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae9498b6e3846ddb18c0bcdfcf00b8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:55.952914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae9498b6e3846ddb18c0bcdfcf00b8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:55.962160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae9498b6e3846ddb18c0bcdfcf00b8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:55.987034 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1273/2519] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:26:55 2022] DELETE /identity/v3/users/4ae9498b6e3846ddb18c0bcdfcf00b8b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:55.989667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828d3e4-5f4e-4459-bd28-b5491903e236 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:55.990571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828d3e4-5f4e-4459-bd28-b5491903e236 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:55.991108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828d3e4-5f4e-4459-bd28-b5491903e236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:56.012885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-c828d3e4-5f4e-4459-bd28-b5491903e236 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:56.014104 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c828d3e4-5f4e-4459-bd28-b5491903e236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:56.074283 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1247/2520] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:56.084042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:56.085550 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:56.091058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:56.144500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2622d2-cd2e-415d-96b1-00d34acd3a68 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:56.148203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7dc58-6fac-4a15-b287-8010fc897621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:56.153520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7dc58-6fac-4a15-b287-8010fc897621 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:56.153520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7dc58-6fac-4a15-b287-8010fc897621 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:56.153520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7dc58-6fac-4a15-b287-8010fc897621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:56.158474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7dc58-6fac-4a15-b287-8010fc897621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:56.159975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7dc58-6fac-4a15-b287-8010fc897621 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:56.170501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1274/2521] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:56.529930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828d3e4-5f4e-4459-bd28-b5491903e236 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:56.531561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-c828d3e4-5f4e-4459-bd28-b5491903e236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:56.544179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828d3e4-5f4e-4459-bd28-b5491903e236 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:56.549014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:56.549699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:56.549966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:56.550234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] PATH_INFO: `/v3/projects/002611f0eb0848c0aa1c9b4ff3bac7e7` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:56.551358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=002611f0eb0848c0aa1c9b4ff3bac7e7)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:56.553321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:56.665963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '002611f0eb0848c0aa1c9b4ff3bac7e7', 'request_id': 'req-d6c11078-ce5b-46ac-bc32-41b566e4f081'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:56.671785 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '002611f0eb0848c0aa1c9b4ff3bac7e7', 'request_id': 'req-d6c11078-ce5b-46ac-bc32-41b566e4f081'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:56.677806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '002611f0eb0848c0aa1c9b4ff3bac7e7', 'request_id': 'req-d6c11078-ce5b-46ac-bc32-41b566e4f081'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:56.744548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] The token cache is being invalidate because project 002611f0eb0848c0aa1c9b4ff3bac7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:56.744842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:56.745466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:56.746996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1248/2522] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:56 2022] DELETE /identity/v3/projects/002611f0eb0848c0aa1c9b4ff3bac7e7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:56.751183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7dc58-6fac-4a15-b287-8010fc897621 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:56.762055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7dc58-6fac-4a15-b287-8010fc897621 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:56.823070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee93743-5144-4265-909d-1e386f0f6a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:56.824444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93743-5144-4265-909d-1e386f0f6a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:56.824444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93743-5144-4265-909d-1e386f0f6a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:56.824444 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93743-5144-4265-909d-1e386f0f6a68 admin admin] PATH_INFO: `/v3/users/cc0fbc8bb59043b58028bba741243bca` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:56.825448 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee93743-5144-4265-909d-1e386f0f6a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0fbc8bb59043b58028bba741243bca)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:56.827424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee93743-5144-4265-909d-1e386f0f6a68 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:57.073912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ee93743-5144-4265-909d-1e386f0f6a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0fbc8bb59043b58028bba741243bca'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:57.074890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ee93743-5144-4265-909d-1e386f0f6a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0fbc8bb59043b58028bba741243bca'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:57.156908 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ee93743-5144-4265-909d-1e386f0f6a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0fbc8bb59043b58028bba741243bca'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:57.157673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ee93743-5144-4265-909d-1e386f0f6a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0fbc8bb59043b58028bba741243bca'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:57.167106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7ee93743-5144-4265-909d-1e386f0f6a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0fbc8bb59043b58028bba741243bca'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:57.190108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1275/2523] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:26:56 2022] DELETE /identity/v3/users/cc0fbc8bb59043b58028bba741243bca => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:57.581934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:57.583534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:57.602507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c11078-ce5b-46ac-bc32-41b566e4f081 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:57.651276 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:57.663114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:57.663831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:57.664107 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:57.664938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] PATH_INFO: `/v3/projects/127c3334fb524baca4aa4bc2f58b99db` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:57.666063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127c3334fb524baca4aa4bc2f58b99db)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:57.668012 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:57.801373 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127c3334fb524baca4aa4bc2f58b99db', 'request_id': 'req-4e9e1c7f-320b-4c25-80fc-21d6860ce064'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:57.810808 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127c3334fb524baca4aa4bc2f58b99db', 'request_id': 'req-4e9e1c7f-320b-4c25-80fc-21d6860ce064'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:57.818145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127c3334fb524baca4aa4bc2f58b99db', 'request_id': 'req-4e9e1c7f-320b-4c25-80fc-21d6860ce064'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:57.893820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] The token cache is being invalidate because project 127c3334fb524baca4aa4bc2f58b99db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:26:57.894118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:57.894811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4e9e1c7f-320b-4c25-80fc-21d6860ce064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:26:57.896748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1249/2524] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:26:57 2022] DELETE /identity/v3/projects/127c3334fb524baca4aa4bc2f58b99db => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:26:57.902769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae53ec1-6159-49e3-bb43-4592075e2450 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:57.905354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae53ec1-6159-49e3-bb43-4592075e2450 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:57.906008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae53ec1-6159-49e3-bb43-4592075e2450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:57.930333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6ae53ec1-6159-49e3-bb43-4592075e2450 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:57.931998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6ae53ec1-6159-49e3-bb43-4592075e2450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:57.953296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:58.019634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1276/2525] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:58.028275 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619492f-fd35-4ab4-8d6c-a35adb4876a9 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:58.028557 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619492f-fd35-4ab4-8d6c-a35adb4876a9 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:58.028834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619492f-fd35-4ab4-8d6c-a35adb4876a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:58.061349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-f619492f-fd35-4ab4-8d6c-a35adb4876a9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:58.062584 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f619492f-fd35-4ab4-8d6c-a35adb4876a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:58.076063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1250/2526] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:26:58.077596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae53ec1-6159-49e3-bb43-4592075e2450 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:58.089220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae53ec1-6159-49e3-bb43-4592075e2450 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:58.096269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b929aa-eaa0-4c35-bbc1-c3411f2d2ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:58.097042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b929aa-eaa0-4c35-bbc1-c3411f2d2ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:58.097319 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b929aa-eaa0-4c35-bbc1-c3411f2d2ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:58.097668 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b929aa-eaa0-4c35-bbc1-c3411f2d2ec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:58.098380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b929aa-eaa0-4c35-bbc1-c3411f2d2ec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:26:58.098813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b929aa-eaa0-4c35-bbc1-c3411f2d2ec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:58.100984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b929aa-eaa0-4c35-bbc1-c3411f2d2ec4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:58.117737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1277/2527] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:26:58.119787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619492f-fd35-4ab4-8d6c-a35adb4876a9 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:58.131966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619492f-fd35-4ab4-8d6c-a35adb4876a9 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:58.137393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e72fd-e978-4db8-a450-2c8d8605a6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:58.138318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e72fd-e978-4db8-a450-2c8d8605a6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:58.138831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e72fd-e978-4db8-a450-2c8d8605a6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:58.139298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e72fd-e978-4db8-a450-2c8d8605a6c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:58.140195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e72fd-e978-4db8-a450-2c8d8605a6c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:58.142357 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e72fd-e978-4db8-a450-2c8d8605a6c5 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:58.260401 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1251/2528] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:26:58 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:26:58.261678 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b929aa-eaa0-4c35-bbc1-c3411f2d2ec4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:58.288298 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b929aa-eaa0-4c35-bbc1-c3411f2d2ec4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:58.359499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2274a1-350d-4e8e-96ee-07ef87984750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:58.360377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2274a1-350d-4e8e-96ee-07ef87984750 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:58.367381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2274a1-350d-4e8e-96ee-07ef87984750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:58.367381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2274a1-350d-4e8e-96ee-07ef87984750 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:58.367381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2274a1-350d-4e8e-96ee-07ef87984750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:58.367381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2274a1-350d-4e8e-96ee-07ef87984750 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:58.460449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1278/2529] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:26:58 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:26:58.465389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e72fd-e978-4db8-a450-2c8d8605a6c5 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:58.476065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e72fd-e978-4db8-a450-2c8d8605a6c5 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:58.480971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55050-862b-4826-8847-08cd2bd1149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:58.481598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55050-862b-4826-8847-08cd2bd1149f admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:58.481877 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55050-862b-4826-8847-08cd2bd1149f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:58.482322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55050-862b-4826-8847-08cd2bd1149f admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:58.483008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b55050-862b-4826-8847-08cd2bd1149f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:58.484629 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b55050-862b-4826-8847-08cd2bd1149f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:58.495816 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1252/2530] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:26:58.499898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2274a1-350d-4e8e-96ee-07ef87984750 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:58.510956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2274a1-350d-4e8e-96ee-07ef87984750 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:58.515916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b29eb-e91a-443b-8cce-f3695fad0e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:58.516558 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b29eb-e91a-443b-8cce-f3695fad0e27 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:58.516813 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b29eb-e91a-443b-8cce-f3695fad0e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:58.517083 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b29eb-e91a-443b-8cce-f3695fad0e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:58.517730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b29eb-e91a-443b-8cce-f3695fad0e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:58.519376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b29eb-e91a-443b-8cce-f3695fad0e27 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:58.532794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1279/2531] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:26:58.537100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55050-862b-4826-8847-08cd2bd1149f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:58.547909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55050-862b-4826-8847-08cd2bd1149f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:58.552487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa90a0-1b3d-49e7-837a-814abdcaf456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:58.553142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa90a0-1b3d-49e7-837a-814abdcaf456 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:58.553420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa90a0-1b3d-49e7-837a-814abdcaf456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:58.553696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa90a0-1b3d-49e7-837a-814abdcaf456 admin admin] PATH_INFO: `/v3/projects/d5adb09f1e2f4926b514eb97a26ced69/users/3c825549f4824d7ba390283c80dbc9c2/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:58.568995 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa90a0-1b3d-49e7-837a-814abdcaf456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5adb09f1e2f4926b514eb97a26ced69, user_id=3c825549f4824d7ba390283c80dbc9c2, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:58.576817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa90a0-1b3d-49e7-837a-814abdcaf456 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:58.619281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b9103-49c4-4b5d-bc16-3e5071784438 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:58.619497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b9103-49c4-4b5d-bc16-3e5071784438 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:58.619790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b9103-49c4-4b5d-bc16-3e5071784438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:58.634908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1253/2532] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:26:58 2022] PUT /identity/v3/projects/d5adb09f1e2f4926b514eb97a26ced69/users/3c825549f4824d7ba390283c80dbc9c2/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:26:58.645363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2770-2ad7-4985-ba3b-baa732d86302 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:58.645977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2770-2ad7-4985-ba3b-baa732d86302 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:58.646517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed2770-2ad7-4985-ba3b-baa732d86302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:58.650993 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-df4b9103-49c4-4b5d-bc16-3e5071784438 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:58.652258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-df4b9103-49c4-4b5d-bc16-3e5071784438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:58.683450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-89ed2770-2ad7-4985-ba3b-baa732d86302 None None] MFA Rules not processed for user `3c825549f4824d7ba390283c80dbc9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:26:58.684679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-89ed2770-2ad7-4985-ba3b-baa732d86302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:58.722834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1280/2533] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:26:58.740956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b9103-49c4-4b5d-bc16-3e5071784438 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:58.743499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-df4b9103-49c4-4b5d-bc16-3e5071784438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:58.753788 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1254/2534] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:26:58.768486 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed2770-2ad7-4985-ba3b-baa732d86302 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:26:58.770407 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-89ed2770-2ad7-4985-ba3b-baa732d86302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:26:58.779412 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:58.792091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:26:58.845450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed2770-2ad7-4985-ba3b-baa732d86302 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:58.851517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14082fbe-2200-4064-9f2b-b9f9994ac4ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0892bfab3ce435b90b93b0786899f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:58.852229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14082fbe-2200-4064-9f2b-b9f9994ac4ed service glance] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:58.852512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14082fbe-2200-4064-9f2b-b9f9994ac4ed service glance] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:58.852952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14082fbe-2200-4064-9f2b-b9f9994ac4ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:58.855423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b9103-49c4-4b5d-bc16-3e5071784438 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:26:58.863098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af49c62-e9ae-488c-982d-9afbb8c5e30d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:26:58.863403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14082fbe-2200-4064-9f2b-b9f9994ac4ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:58.863748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af49c62-e9ae-488c-982d-9afbb8c5e30d service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:26:58.864024 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af49c62-e9ae-488c-982d-9afbb8c5e30d service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:26:58.864293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af49c62-e9ae-488c-982d-9afbb8c5e30d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:26:58.865064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14082fbe-2200-4064-9f2b-b9f9994ac4ed service glance] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:58.881026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af49c62-e9ae-488c-982d-9afbb8c5e30d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:26:58.881026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af49c62-e9ae-488c-982d-9afbb8c5e30d service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:26:58.889728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1255/2535] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:26:58.894183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1281/2536] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:03.144850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e424-d202-4eef-9211-fbb87e308d3f None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:03.145345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e424-d202-4eef-9211-fbb87e308d3f None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:03.145462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e424-d202-4eef-9211-fbb87e308d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:03.167550 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-ce84e424-d202-4eef-9211-fbb87e308d3f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:03.168815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ce84e424-d202-4eef-9211-fbb87e308d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:03.177076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1256/2537] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 16:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:03.191059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af49c62-e9ae-488c-982d-9afbb8c5e30d service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:03.192452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7af49c62-e9ae-488c-982d-9afbb8c5e30d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:03.206877 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af49c62-e9ae-488c-982d-9afbb8c5e30d service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:03.212913 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b81b45-2aed-49b2-ac2a-fc102884edf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:03.213510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b81b45-2aed-49b2-ac2a-fc102884edf6 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:03.213786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b81b45-2aed-49b2-ac2a-fc102884edf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:03.214056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b81b45-2aed-49b2-ac2a-fc102884edf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:03.222411 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b81b45-2aed-49b2-ac2a-fc102884edf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:03.224069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b81b45-2aed-49b2-ac2a-fc102884edf6 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:03.234789 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1282/2538] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:04.256305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84e424-d202-4eef-9211-fbb87e308d3f None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:04.257701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ce84e424-d202-4eef-9211-fbb87e308d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:04.316046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84e424-d202-4eef-9211-fbb87e308d3f None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:04.319636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9779e4-6ab5-4e6e-ad50-4aba5b1067eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:04.320351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9779e4-6ab5-4e6e-ad50-4aba5b1067eb service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:04.320631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9779e4-6ab5-4e6e-ad50-4aba5b1067eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:04.320899 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9779e4-6ab5-4e6e-ad50-4aba5b1067eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:04.323061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3a9779e4-6ab5-4e6e-ad50-4aba5b1067eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:04.336011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9779e4-6ab5-4e6e-ad50-4aba5b1067eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:04.337490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9779e4-6ab5-4e6e-ad50-4aba5b1067eb service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:04.347586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1257/2539] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:07.062471 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc426b77-2c16-4625-9e35-c18b938846f5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:07.063006 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc426b77-2c16-4625-9e35-c18b938846f5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:07.063239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc426b77-2c16-4625-9e35-c18b938846f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:07.085008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-dc426b77-2c16-4625-9e35-c18b938846f5 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:07.086257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dc426b77-2c16-4625-9e35-c18b938846f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:07.094308 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1283/2540] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 16:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:07.111601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9779e4-6ab5-4e6e-ad50-4aba5b1067eb service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:07.124749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9779e4-6ab5-4e6e-ad50-4aba5b1067eb service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:07.130551 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10865c81-4ec3-42b6-9bec-b8a26d7d4ff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:07.131196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10865c81-4ec3-42b6-9bec-b8a26d7d4ff5 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:07.131475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10865c81-4ec3-42b6-9bec-b8a26d7d4ff5 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:07.131858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10865c81-4ec3-42b6-9bec-b8a26d7d4ff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:07.141193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10865c81-4ec3-42b6-9bec-b8a26d7d4ff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:07.142887 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10865c81-4ec3-42b6-9bec-b8a26d7d4ff5 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:07.152713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1258/2541] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:07.929207 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc426b77-2c16-4625-9e35-c18b938846f5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:07.930786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dc426b77-2c16-4625-9e35-c18b938846f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:07.943398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc426b77-2c16-4625-9e35-c18b938846f5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:07.948831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dcfd4-c598-4f3c-afc6-d2eb4843108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:07.949451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dcfd4-c598-4f3c-afc6-d2eb4843108f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:07.949756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dcfd4-c598-4f3c-afc6-d2eb4843108f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:07.950004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dcfd4-c598-4f3c-afc6-d2eb4843108f admin admin] PATH_INFO: `/v3/users/d235e94611884b28b85b637ac54204f8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:07.951250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3dcfd4-c598-4f3c-afc6-d2eb4843108f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d235e94611884b28b85b637ac54204f8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:07.953194 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3dcfd4-c598-4f3c-afc6-d2eb4843108f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:08.154419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6d3dcfd4-c598-4f3c-afc6-d2eb4843108f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd235e94611884b28b85b637ac54204f8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:08.155356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6d3dcfd4-c598-4f3c-afc6-d2eb4843108f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd235e94611884b28b85b637ac54204f8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:08.219600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6d3dcfd4-c598-4f3c-afc6-d2eb4843108f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd235e94611884b28b85b637ac54204f8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:08.220234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6d3dcfd4-c598-4f3c-afc6-d2eb4843108f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd235e94611884b28b85b637ac54204f8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:08.228890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-6d3dcfd4-c598-4f3c-afc6-d2eb4843108f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd235e94611884b28b85b637ac54204f8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:08.246447 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1284/2542] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:27:07 2022] DELETE /identity/v3/users/d235e94611884b28b85b637ac54204f8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:08.489577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10865c81-4ec3-42b6-9bec-b8a26d7d4ff5 service nova] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:08.501118 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10865c81-4ec3-42b6-9bec-b8a26d7d4ff5 service nova] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:08.559316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:08.559955 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:08.560230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:08.560498 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] PATH_INFO: `/v3/projects/dd07e758e414493187ec1949d45f0828` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:08.561621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd07e758e414493187ec1949d45f0828)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:08.563570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:08.665460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:08.677313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd07e758e414493187ec1949d45f0828', 'request_id': 'req-71b36a31-a215-4f17-b520-b721a4936257'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:08.684125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd07e758e414493187ec1949d45f0828', 'request_id': 'req-71b36a31-a215-4f17-b520-b721a4936257'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:08.690393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd07e758e414493187ec1949d45f0828', 'request_id': 'req-71b36a31-a215-4f17-b520-b721a4936257'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:08.745410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] The token cache is being invalidate because project dd07e758e414493187ec1949d45f0828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:27:08.745701 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:08.746333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-71b36a31-a215-4f17-b520-b721a4936257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:08.747984 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1259/2543] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:27:08 2022] DELETE /identity/v3/projects/dd07e758e414493187ec1949d45f0828 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:08.752968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b70829-8089-41b5-ad90-39ba71271fc9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:08.753256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b70829-8089-41b5-ad90-39ba71271fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:08.753584 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b70829-8089-41b5-ad90-39ba71271fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:08.773480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-79b70829-8089-41b5-ad90-39ba71271fc9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:08.774726 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-79b70829-8089-41b5-ad90-39ba71271fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:08.843027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1285/2544] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:08.850561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed45a0-9c00-4099-9154-232cf80af424 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:08.851136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed45a0-9c00-4099-9154-232cf80af424 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:08.851424 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed45a0-9c00-4099-9154-232cf80af424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:08.873169 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-28ed45a0-9c00-4099-9154-232cf80af424 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:08.874619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-28ed45a0-9c00-4099-9154-232cf80af424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:08.882946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1260/2545] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:08.887831 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b70829-8089-41b5-ad90-39ba71271fc9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:08.901293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b70829-8089-41b5-ad90-39ba71271fc9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:08.906132 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e7f1d-f5e4-461d-8aa4-901bf5faf661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:08.906773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e7f1d-f5e4-461d-8aa4-901bf5faf661 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:08.907053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e7f1d-f5e4-461d-8aa4-901bf5faf661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:08.907347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e7f1d-f5e4-461d-8aa4-901bf5faf661 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:08.908112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e7f1d-f5e4-461d-8aa4-901bf5faf661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:27:08.908474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e7f1d-f5e4-461d-8aa4-901bf5faf661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:08.910011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e7f1d-f5e4-461d-8aa4-901bf5faf661 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:08.912756 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:08.928429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1286/2546] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:27:08.933564 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed45a0-9c00-4099-9154-232cf80af424 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:08.942913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed45a0-9c00-4099-9154-232cf80af424 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:08.947640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f3ff3-4b47-4a4b-8850-a52e82d73970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:08.948235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3ff3-4b47-4a4b-8850-a52e82d73970 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:08.948513 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3ff3-4b47-4a4b-8850-a52e82d73970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:08.948785 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3ff3-4b47-4a4b-8850-a52e82d73970 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:08.949418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f3ff3-4b47-4a4b-8850-a52e82d73970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:08.951355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f3ff3-4b47-4a4b-8850-a52e82d73970 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:09.050728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1261/2547] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:27:08 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:09.055157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e7f1d-f5e4-461d-8aa4-901bf5faf661 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:09.066026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e7f1d-f5e4-461d-8aa4-901bf5faf661 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:09.130001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6ad33-273c-4b68-96e7-b761f182c473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:09.130752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6ad33-273c-4b68-96e7-b761f182c473 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:09.131029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6ad33-273c-4b68-96e7-b761f182c473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:09.131322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6ad33-273c-4b68-96e7-b761f182c473 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:09.131946 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6ad33-273c-4b68-96e7-b761f182c473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:09.133851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6ad33-273c-4b68-96e7-b761f182c473 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:09.222757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1287/2548] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:27:09 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:27:09.224667 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f3ff3-4b47-4a4b-8850-a52e82d73970 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:09.239039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f3ff3-4b47-4a4b-8850-a52e82d73970 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:09.241326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39774945-ecf3-453a-87d0-79c239b0cc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:09.241997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39774945-ecf3-453a-87d0-79c239b0cc04 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:09.242344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39774945-ecf3-453a-87d0-79c239b0cc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:09.242711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39774945-ecf3-453a-87d0-79c239b0cc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:09.243466 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39774945-ecf3-453a-87d0-79c239b0cc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:09.245228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39774945-ecf3-453a-87d0-79c239b0cc04 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:09.255784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1262/2549] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:09.259890 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6ad33-273c-4b68-96e7-b761f182c473 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:09.272252 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6ad33-273c-4b68-96e7-b761f182c473 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:09.277630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8926ef-3227-4b8d-98e6-8a9a47220f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:09.278225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8926ef-3227-4b8d-98e6-8a9a47220f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:09.278499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8926ef-3227-4b8d-98e6-8a9a47220f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:09.278796 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8926ef-3227-4b8d-98e6-8a9a47220f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:09.279433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8926ef-3227-4b8d-98e6-8a9a47220f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:09.281015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8926ef-3227-4b8d-98e6-8a9a47220f06 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:09.293173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1288/2550] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:09.301605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39774945-ecf3-453a-87d0-79c239b0cc04 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:09.313041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39774945-ecf3-453a-87d0-79c239b0cc04 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:09.318637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761cafd-5362-49e2-aacc-9978e30bee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:09.319322 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761cafd-5362-49e2-aacc-9978e30bee5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:09.323020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761cafd-5362-49e2-aacc-9978e30bee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:09.323020 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761cafd-5362-49e2-aacc-9978e30bee5f admin admin] PATH_INFO: `/v3/projects/882c14dfd4ed487fb9164819457acd95/users/8ceac69414e244a489e1a8416d19e69b/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:09.334749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761cafd-5362-49e2-aacc-9978e30bee5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=882c14dfd4ed487fb9164819457acd95, user_id=8ceac69414e244a489e1a8416d19e69b, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:09.338458 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761cafd-5362-49e2-aacc-9978e30bee5f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:09.408662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1263/2551] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:09 2022] PUT /identity/v3/projects/882c14dfd4ed487fb9164819457acd95/users/8ceac69414e244a489e1a8416d19e69b/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:09.424427 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7de37d-eb5b-472e-98a0-b426b907310a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:09.424707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7de37d-eb5b-472e-98a0-b426b907310a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:09.425399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7de37d-eb5b-472e-98a0-b426b907310a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:09.455348 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1d7de37d-eb5b-472e-98a0-b426b907310a None None] MFA Rules not processed for user `8ceac69414e244a489e1a8416d19e69b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:09.456604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1d7de37d-eb5b-472e-98a0-b426b907310a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:09.520866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1289/2552] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:09.533172 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761cafd-5362-49e2-aacc-9978e30bee5f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:09.534889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6761cafd-5362-49e2-aacc-9978e30bee5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:09.609253 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761cafd-5362-49e2-aacc-9978e30bee5f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:09.615144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793522ea-ca1b-4a8c-8b5e-6ba1d08869f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:09.615773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793522ea-ca1b-4a8c-8b5e-6ba1d08869f2 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:09.616048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793522ea-ca1b-4a8c-8b5e-6ba1d08869f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:09.616320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793522ea-ca1b-4a8c-8b5e-6ba1d08869f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:09.624810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793522ea-ca1b-4a8c-8b5e-6ba1d08869f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:09.626383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793522ea-ca1b-4a8c-8b5e-6ba1d08869f2 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:09.635623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1264/2553] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:11.365911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefefbd-8d34-465f-9c19-2033a40986c1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:11.371879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefefbd-8d34-465f-9c19-2033a40986c1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:11.371879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefefbd-8d34-465f-9c19-2033a40986c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:11.393352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3aefefbd-8d34-465f-9c19-2033a40986c1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:11.394637 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3aefefbd-8d34-465f-9c19-2033a40986c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:11.454130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1290/2554] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 16:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:11.470331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793522ea-ca1b-4a8c-8b5e-6ba1d08869f2 service nova] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:11.472026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-793522ea-ca1b-4a8c-8b5e-6ba1d08869f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:11.488447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793522ea-ca1b-4a8c-8b5e-6ba1d08869f2 service nova] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:11.495041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cd533-0ac7-477d-be4f-e8ac4ef885e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:11.495656 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd533-0ac7-477d-be4f-e8ac4ef885e3 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:11.495935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd533-0ac7-477d-be4f-e8ac4ef885e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:11.496208 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd533-0ac7-477d-be4f-e8ac4ef885e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:11.505342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cd533-0ac7-477d-be4f-e8ac4ef885e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:11.506976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cd533-0ac7-477d-be4f-e8ac4ef885e3 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:11.517536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1265/2555] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:12.925760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefefbd-8d34-465f-9c19-2033a40986c1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:12.931260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:12.934561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefefbd-8d34-465f-9c19-2033a40986c1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:12.939529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:12.941203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:12.941203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:12.941203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] PATH_INFO: `/v3/users/8ceac69414e244a489e1a8416d19e69b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:12.941809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ceac69414e244a489e1a8416d19e69b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:12.943754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:13.061829 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ceac69414e244a489e1a8416d19e69b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:13.062368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ceac69414e244a489e1a8416d19e69b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:13.132492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ceac69414e244a489e1a8416d19e69b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:13.133099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ceac69414e244a489e1a8416d19e69b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:13.141037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ceac69414e244a489e1a8416d19e69b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:13.158163 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1291/2556] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:27:12 2022] DELETE /identity/v3/users/8ceac69414e244a489e1a8416d19e69b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:13.162912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0c90b-19cb-445b-a60a-495e666c7217 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:13.163413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0c90b-19cb-445b-a60a-495e666c7217 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:13.163527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0c90b-19cb-445b-a60a-495e666c7217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:13.183228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-00d0c90b-19cb-445b-a60a-495e666c7217 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:13.184420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-00d0c90b-19cb-445b-a60a-495e666c7217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:13.207716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:13.241577 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1266/2557] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:13.251615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:13.253074 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:13.314504 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c2926-c695-4599-be65-d32d7c178f34 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:13.318288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb660cf-2d76-4970-b9e2-f554a4fb7f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:13.318930 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb660cf-2d76-4970-b9e2-f554a4fb7f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:13.319262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb660cf-2d76-4970-b9e2-f554a4fb7f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:13.319541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb660cf-2d76-4970-b9e2-f554a4fb7f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:13.328990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb660cf-2d76-4970-b9e2-f554a4fb7f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:13.330441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb660cf-2d76-4970-b9e2-f554a4fb7f52 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:13.341127 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1292/2558] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:13.775446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0c90b-19cb-445b-a60a-495e666c7217 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:13.777444 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-00d0c90b-19cb-445b-a60a-495e666c7217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:13.789634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0c90b-19cb-445b-a60a-495e666c7217 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:13.794938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:13.795565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:13.795839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:13.796109 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] PATH_INFO: `/v3/projects/882c14dfd4ed487fb9164819457acd95` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:13.797492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882c14dfd4ed487fb9164819457acd95)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:13.799449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:13.940397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882c14dfd4ed487fb9164819457acd95', 'request_id': 'req-1be5163b-387f-4ce8-91ef-93a16ff32499'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:13.946087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882c14dfd4ed487fb9164819457acd95', 'request_id': 'req-1be5163b-387f-4ce8-91ef-93a16ff32499'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:13.953696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882c14dfd4ed487fb9164819457acd95', 'request_id': 'req-1be5163b-387f-4ce8-91ef-93a16ff32499'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:14.059260 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] The token cache is being invalidate because project 882c14dfd4ed487fb9164819457acd95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:27:14.059553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:14.060220 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-1be5163b-387f-4ce8-91ef-93a16ff32499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:14.061719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1267/2559] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:27:13 2022] DELETE /identity/v3/projects/882c14dfd4ed487fb9164819457acd95 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:14.066483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a90f-45da-44d5-b41f-e3856661fb2f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:14.067090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a90f-45da-44d5-b41f-e3856661fb2f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:14.067090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a90f-45da-44d5-b41f-e3856661fb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:14.089172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-03b8a90f-45da-44d5-b41f-e3856661fb2f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:14.090303 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-03b8a90f-45da-44d5-b41f-e3856661fb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:14.150058 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1293/2560] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:14.159790 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841081b2-f9bd-4dbd-a455-681bd9457d98 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:14.160072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841081b2-f9bd-4dbd-a455-681bd9457d98 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:14.160347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841081b2-f9bd-4dbd-a455-681bd9457d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:14.180765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-841081b2-f9bd-4dbd-a455-681bd9457d98 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:14.182046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-841081b2-f9bd-4dbd-a455-681bd9457d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:14.190013 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1268/2561] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:14.194197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8a90f-45da-44d5-b41f-e3856661fb2f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:14.204574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8a90f-45da-44d5-b41f-e3856661fb2f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:14.209182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f54a9-e338-4d29-a72c-8e0e5e6ebc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:14.209777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f54a9-e338-4d29-a72c-8e0e5e6ebc0e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:14.210047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f54a9-e338-4d29-a72c-8e0e5e6ebc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:14.210313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f54a9-e338-4d29-a72c-8e0e5e6ebc0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:14.210984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f54a9-e338-4d29-a72c-8e0e5e6ebc0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:27:14.211284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f54a9-e338-4d29-a72c-8e0e5e6ebc0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:14.212866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f54a9-e338-4d29-a72c-8e0e5e6ebc0e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:14.224860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1294/2562] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:27:14.229149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841081b2-f9bd-4dbd-a455-681bd9457d98 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:14.238877 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841081b2-f9bd-4dbd-a455-681bd9457d98 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:14.244058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbf829-9fb2-4e00-923b-bcc9d2f4368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:14.245072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbf829-9fb2-4e00-923b-bcc9d2f4368d admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:14.245568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbf829-9fb2-4e00-923b-bcc9d2f4368d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:14.246075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbf829-9fb2-4e00-923b-bcc9d2f4368d admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:14.247292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbf829-9fb2-4e00-923b-bcc9d2f4368d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:14.250512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbf829-9fb2-4e00-923b-bcc9d2f4368d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:14.358236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1269/2563] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:27:14 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:14.362429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f54a9-e338-4d29-a72c-8e0e5e6ebc0e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:14.372887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f54a9-e338-4d29-a72c-8e0e5e6ebc0e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:14.376417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:14.430889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1e58b-38c7-4a4f-a547-abbf0f015782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:14.431500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1e58b-38c7-4a4f-a547-abbf0f015782 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:14.431777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1e58b-38c7-4a4f-a547-abbf0f015782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:14.432551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1e58b-38c7-4a4f-a547-abbf0f015782 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:14.433187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1e58b-38c7-4a4f-a547-abbf0f015782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:14.435180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1e58b-38c7-4a4f-a547-abbf0f015782 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:14.511548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1295/2564] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:27:14 2022] POST /identity/v3/users => generated 303 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:14.515640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbf829-9fb2-4e00-923b-bcc9d2f4368d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:14.526141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbf829-9fb2-4e00-923b-bcc9d2f4368d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:14.531320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39091925-09b9-42cd-800b-fa574276d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:14.531926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39091925-09b9-42cd-800b-fa574276d90e admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:14.532224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39091925-09b9-42cd-800b-fa574276d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:14.532480 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39091925-09b9-42cd-800b-fa574276d90e admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:14.533151 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39091925-09b9-42cd-800b-fa574276d90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:14.534794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39091925-09b9-42cd-800b-fa574276d90e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:14.549529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1270/2565] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:27:14.550852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1e58b-38c7-4a4f-a547-abbf0f015782 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:14.561533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1e58b-38c7-4a4f-a547-abbf0f015782 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:14.567158 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea29bc-50e2-412b-9e94-5aeedf06ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:14.567158 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea29bc-50e2-412b-9e94-5aeedf06ad6c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:14.567388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea29bc-50e2-412b-9e94-5aeedf06ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:14.567543 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea29bc-50e2-412b-9e94-5aeedf06ad6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:14.568184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea29bc-50e2-412b-9e94-5aeedf06ad6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:14.569764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea29bc-50e2-412b-9e94-5aeedf06ad6c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:14.581388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1296/2566] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:14.585724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39091925-09b9-42cd-800b-fa574276d90e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:14.596354 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39091925-09b9-42cd-800b-fa574276d90e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:14.601000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881912e5-ab58-49c8-8ce1-811bee5e4353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:14.601668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881912e5-ab58-49c8-8ce1-811bee5e4353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:14.601943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881912e5-ab58-49c8-8ce1-811bee5e4353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:14.602288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881912e5-ab58-49c8-8ce1-811bee5e4353 admin admin] PATH_INFO: `/v3/projects/4afa0b5215f642b393330e73506d2010/users/c9520a4e86e24b909099f9f822e49394/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:14.739941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881912e5-ab58-49c8-8ce1-811bee5e4353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4afa0b5215f642b393330e73506d2010, user_id=c9520a4e86e24b909099f9f822e49394, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:14.742629 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881912e5-ab58-49c8-8ce1-811bee5e4353 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:14.854849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1271/2567] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:14 2022] PUT /identity/v3/projects/4afa0b5215f642b393330e73506d2010/users/c9520a4e86e24b909099f9f822e49394/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:14.860129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc6781-57ae-43d4-8b07-33a2d4b3a2c8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:14.860413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc6781-57ae-43d4-8b07-33a2d4b3a2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:14.860682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc6781-57ae-43d4-8b07-33a2d4b3a2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:14.880233 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5bfc6781-57ae-43d4-8b07-33a2d4b3a2c8 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:14.891292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5bfc6781-57ae-43d4-8b07-33a2d4b3a2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:14.940709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1297/2568] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:14.950552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881912e5-ab58-49c8-8ce1-811bee5e4353 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:14.952255 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-881912e5-ab58-49c8-8ce1-811bee5e4353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:15.008267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:15.012099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881912e5-ab58-49c8-8ce1-811bee5e4353 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:15.015774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c20c5c-7523-4b60-9b01-eb8f46c5aa26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:15.016374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20c5c-7523-4b60-9b01-eb8f46c5aa26 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:15.016653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20c5c-7523-4b60-9b01-eb8f46c5aa26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:15.016946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20c5c-7523-4b60-9b01-eb8f46c5aa26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:15.026191 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c20c5c-7523-4b60-9b01-eb8f46c5aa26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:15.027654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c20c5c-7523-4b60-9b01-eb8f46c5aa26 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:15.037258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1272/2569] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:15.591379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf550c-d2d3-4ae2-bf2c-83a262f72fc6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:15.591892 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf550c-d2d3-4ae2-bf2c-83a262f72fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:15.591994 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf550c-d2d3-4ae2-bf2c-83a262f72fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:15.621884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fcaf550c-d2d3-4ae2-bf2c-83a262f72fc6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:15.622502 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fcaf550c-d2d3-4ae2-bf2c-83a262f72fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:15.631185 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1298/2570] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 16:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:15.651565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c20c5c-7523-4b60-9b01-eb8f46c5aa26 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:15.653193 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-95c20c5c-7523-4b60-9b01-eb8f46c5aa26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:15.739437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c20c5c-7523-4b60-9b01-eb8f46c5aa26 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:15.745874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4dec5-6102-439e-80e0-b7cfbaa1ec48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:15.746524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4dec5-6102-439e-80e0-b7cfbaa1ec48 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:15.746951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4dec5-6102-439e-80e0-b7cfbaa1ec48 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:15.747291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4dec5-6102-439e-80e0-b7cfbaa1ec48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:15.756047 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4dec5-6102-439e-80e0-b7cfbaa1ec48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:15.757672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4dec5-6102-439e-80e0-b7cfbaa1ec48 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:15.768438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1273/2571] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:16.340176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3248d-629d-45d3-a1a7-eb9035001cbf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:16.340560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3248d-629d-45d3-a1a7-eb9035001cbf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:16.340878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3248d-629d-45d3-a1a7-eb9035001cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:16.369138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cef3248d-629d-45d3-a1a7-eb9035001cbf None None] MFA Rules not processed for user `c9520a4e86e24b909099f9f822e49394`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:16.371218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cef3248d-629d-45d3-a1a7-eb9035001cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:16.437800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1299/2572] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:16.445970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4dec5-6102-439e-80e0-b7cfbaa1ec48 service nova] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:16.451903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4dec5-6102-439e-80e0-b7cfbaa1ec48 service nova] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:16.456447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc20407-43eb-4f5f-a963-c03d7393eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:16.457030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc20407-43eb-4f5f-a963-c03d7393eb8a admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:16.457308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc20407-43eb-4f5f-a963-c03d7393eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:16.457581 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc20407-43eb-4f5f-a963-c03d7393eb8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:16.458237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc20407-43eb-4f5f-a963-c03d7393eb8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:16.460150 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc20407-43eb-4f5f-a963-c03d7393eb8a admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:16.558977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1274/2573] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:27:16 2022] POST /identity/v3/projects => generated 403 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:16.563235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3248d-629d-45d3-a1a7-eb9035001cbf None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:16.573995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3248d-629d-45d3-a1a7-eb9035001cbf None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:16.578620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:16.634399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67dc40-55c2-4615-9c0b-35818fbba71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:16.635078 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67dc40-55c2-4615-9c0b-35818fbba71b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:16.635361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67dc40-55c2-4615-9c0b-35818fbba71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:16.635630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67dc40-55c2-4615-9c0b-35818fbba71b admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:16.636259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67dc40-55c2-4615-9c0b-35818fbba71b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:16.638936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67dc40-55c2-4615-9c0b-35818fbba71b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:16.716926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1300/2574] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:27:16 2022] POST /identity/v3/users => generated 308 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:16.721107 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc20407-43eb-4f5f-a963-c03d7393eb8a admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:16.731813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc20407-43eb-4f5f-a963-c03d7393eb8a admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:16.736389 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c13b5-cc25-44de-9282-91b34d6871ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:16.736981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c13b5-cc25-44de-9282-91b34d6871ca admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:16.737256 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c13b5-cc25-44de-9282-91b34d6871ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:16.737525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c13b5-cc25-44de-9282-91b34d6871ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:16.738160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c13b5-cc25-44de-9282-91b34d6871ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:16.739941 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c13b5-cc25-44de-9282-91b34d6871ca admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:16.750503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1275/2575] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:16.755514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67dc40-55c2-4615-9c0b-35818fbba71b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:16.766172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67dc40-55c2-4615-9c0b-35818fbba71b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:16.771394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb63e2-3bbc-46c5-83c8-f54c2da787bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:16.772099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb63e2-3bbc-46c5-83c8-f54c2da787bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:16.772380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb63e2-3bbc-46c5-83c8-f54c2da787bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:16.772656 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb63e2-3bbc-46c5-83c8-f54c2da787bb admin admin] PATH_INFO: `/v3/projects/1d0d394f8b6a43d984a687384ad204a0/users/a2e3f0a8cf4c445bbad6220dc5fd6959/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:16.789123 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb63e2-3bbc-46c5-83c8-f54c2da787bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d0d394f8b6a43d984a687384ad204a0, user_id=a2e3f0a8cf4c445bbad6220dc5fd6959, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:16.792568 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb63e2-3bbc-46c5-83c8-f54c2da787bb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:16.860380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1301/2576] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:16 2022] PUT /identity/v3/projects/1d0d394f8b6a43d984a687384ad204a0/users/a2e3f0a8cf4c445bbad6220dc5fd6959/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:16.864359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c13b5-cc25-44de-9282-91b34d6871ca admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:16.874325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c13b5-cc25-44de-9282-91b34d6871ca admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:16.934505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937c30c-506b-4db9-b970-991e40c237de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:16.935155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937c30c-506b-4db9-b970-991e40c237de admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:16.935436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937c30c-506b-4db9-b970-991e40c237de admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:16.935705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937c30c-506b-4db9-b970-991e40c237de admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:16.936351 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937c30c-506b-4db9-b970-991e40c237de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:16.938136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937c30c-506b-4db9-b970-991e40c237de admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:16.948966 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1276/2577] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:16.953253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb63e2-3bbc-46c5-83c8-f54c2da787bb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:16.964460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb63e2-3bbc-46c5-83c8-f54c2da787bb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:16.969053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc582b5-6c1d-4866-b850-1268bb4d6a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:16.969693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc582b5-6c1d-4866-b850-1268bb4d6a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:16.969967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc582b5-6c1d-4866-b850-1268bb4d6a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:16.970236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc582b5-6c1d-4866-b850-1268bb4d6a7b admin admin] PATH_INFO: `/v3/projects/1d0d394f8b6a43d984a687384ad204a0/users/a2e3f0a8cf4c445bbad6220dc5fd6959/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:16.972189 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc582b5-6c1d-4866-b850-1268bb4d6a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d0d394f8b6a43d984a687384ad204a0, user_id=a2e3f0a8cf4c445bbad6220dc5fd6959, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:16.974859 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc582b5-6c1d-4866-b850-1268bb4d6a7b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:16.984999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1302/2578] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:16 2022] PUT /identity/v3/projects/1d0d394f8b6a43d984a687384ad204a0/users/a2e3f0a8cf4c445bbad6220dc5fd6959/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:18.535688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee992ae-3f1d-4124-93a0-421c9a9399d6 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:18.536181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee992ae-3f1d-4124-93a0-421c9a9399d6 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:18.536181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee992ae-3f1d-4124-93a0-421c9a9399d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:18.565263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-aee992ae-3f1d-4124-93a0-421c9a9399d6 None None] MFA Rules not processed for user `a2e3f0a8cf4c445bbad6220dc5fd6959`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:18.566698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-aee992ae-3f1d-4124-93a0-421c9a9399d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:18.598898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:18.645304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1277/2579] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:20.149109 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc582b5-6c1d-4866-b850-1268bb4d6a7b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:20.249706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc582b5-6c1d-4866-b850-1268bb4d6a7b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:20.254767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:20.255663 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:20.255923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:20.256195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] PATH_INFO: `/v3/users/c9520a4e86e24b909099f9f822e49394` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:20.257494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9520a4e86e24b909099f9f822e49394)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:20.259588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:20.453230 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9520a4e86e24b909099f9f822e49394'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:20.453872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9520a4e86e24b909099f9f822e49394'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:20.563085 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9520a4e86e24b909099f9f822e49394'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:20.563744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9520a4e86e24b909099f9f822e49394'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:20.571805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9520a4e86e24b909099f9f822e49394'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:20.574861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:20.593741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1303/2580] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:27:20 2022] DELETE /identity/v3/users/c9520a4e86e24b909099f9f822e49394 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:20.849808 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee992ae-3f1d-4124-93a0-421c9a9399d6 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:20.861810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee992ae-3f1d-4124-93a0-421c9a9399d6 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:20.925146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:20.925898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:20.926232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:20.926572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] PATH_INFO: `/v3/projects/4afa0b5215f642b393330e73506d2010` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:20.927831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4afa0b5215f642b393330e73506d2010)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:20.930040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:21.079117 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4afa0b5215f642b393330e73506d2010', 'request_id': 'req-44d06310-2177-4c9a-8313-7a171edf6adf'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.084884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4afa0b5215f642b393330e73506d2010', 'request_id': 'req-44d06310-2177-4c9a-8313-7a171edf6adf'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.094248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4afa0b5215f642b393330e73506d2010', 'request_id': 'req-44d06310-2177-4c9a-8313-7a171edf6adf'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.174686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] The token cache is being invalidate because project 4afa0b5215f642b393330e73506d2010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:27:21.175146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.176451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.178048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1278/2581] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:27:20 2022] DELETE /identity/v3/projects/4afa0b5215f642b393330e73506d2010 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:21.182187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:21.183600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:21.197988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e9ec1-01d4-434e-9f74-65d79201db33 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:21.262964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:21.263605 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:21.263873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:21.264147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] PATH_INFO: `/v3/users/a2e3f0a8cf4c445bbad6220dc5fd6959` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:21.265273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e3f0a8cf4c445bbad6220dc5fd6959)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:21.267281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:21.446844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e3f0a8cf4c445bbad6220dc5fd6959'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.448134 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e3f0a8cf4c445bbad6220dc5fd6959'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.511563 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e3f0a8cf4c445bbad6220dc5fd6959'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.512191 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e3f0a8cf4c445bbad6220dc5fd6959'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.521479 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e3f0a8cf4c445bbad6220dc5fd6959'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.539431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1304/2582] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:27:21 2022] DELETE /identity/v3/users/a2e3f0a8cf4c445bbad6220dc5fd6959 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:21.567856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:21.569308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:21.582484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d06310-2177-4c9a-8313-7a171edf6adf admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:21.643461 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:21.652217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78a2b3-4309-45be-abd7-39d1820918eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:21.652862 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78a2b3-4309-45be-abd7-39d1820918eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:21.653235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78a2b3-4309-45be-abd7-39d1820918eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:21.653511 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78a2b3-4309-45be-abd7-39d1820918eb admin admin] PATH_INFO: `/v3/users/3c825549f4824d7ba390283c80dbc9c2` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:21.655111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78a2b3-4309-45be-abd7-39d1820918eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c825549f4824d7ba390283c80dbc9c2)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:21.656763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78a2b3-4309-45be-abd7-39d1820918eb admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:21.776548 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:21.778027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:21.791999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78856cf5-c529-4cbe-b133-c3125b6f82a7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:21.797646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:21.798473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:21.798800 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:21.799077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] PATH_INFO: `/v3/projects/1d0d394f8b6a43d984a687384ad204a0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:21.800501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d0d394f8b6a43d984a687384ad204a0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:21.802464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:21.831705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bc78a2b3-4309-45be-abd7-39d1820918eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c825549f4824d7ba390283c80dbc9c2'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.832471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bc78a2b3-4309-45be-abd7-39d1820918eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c825549f4824d7ba390283c80dbc9c2'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.905978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bc78a2b3-4309-45be-abd7-39d1820918eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c825549f4824d7ba390283c80dbc9c2'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.906623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d0d394f8b6a43d984a687384ad204a0', 'request_id': 'req-1acb22eb-f556-4f62-8110-23f6b6ab9e46'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.907644 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bc78a2b3-4309-45be-abd7-39d1820918eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c825549f4824d7ba390283c80dbc9c2'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.910267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:21.912902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d0d394f8b6a43d984a687384ad204a0', 'request_id': 'req-1acb22eb-f556-4f62-8110-23f6b6ab9e46'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.917822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bc78a2b3-4309-45be-abd7-39d1820918eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c825549f4824d7ba390283c80dbc9c2'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.920155 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d0d394f8b6a43d984a687384ad204a0', 'request_id': 'req-1acb22eb-f556-4f62-8110-23f6b6ab9e46'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:21.939187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1279/2583] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:27:21 2022] DELETE /identity/v3/users/3c825549f4824d7ba390283c80dbc9c2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:21.943727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5d20-c348-420b-ba8e-54b013fa42de None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:21.944024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5d20-c348-420b-ba8e-54b013fa42de None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:21.944293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5d20-c348-420b-ba8e-54b013fa42de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:21.964188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-6cfd5d20-c348-420b-ba8e-54b013fa42de None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:21.965304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6cfd5d20-c348-420b-ba8e-54b013fa42de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:22.007738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] The token cache is being invalidate because project 1d0d394f8b6a43d984a687384ad204a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:27:22.008027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:22.008650 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1acb22eb-f556-4f62-8110-23f6b6ab9e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:22.010818 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1305/2584] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:27:21 2022] DELETE /identity/v3/projects/1d0d394f8b6a43d984a687384ad204a0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:27:22.015410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af5cff-557c-4a22-9a6c-10cee5f05afa None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.015699 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af5cff-557c-4a22-9a6c-10cee5f05afa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.015972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af5cff-557c-4a22-9a6c-10cee5f05afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.028008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1280/2585] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:22.038418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd5d20-c348-420b-ba8e-54b013fa42de None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:22.038689 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f3af5cff-557c-4a22-9a6c-10cee5f05afa None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:22.039915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f3af5cff-557c-4a22-9a6c-10cee5f05afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:22.043250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6cfd5d20-c348-420b-ba8e-54b013fa42de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:22.049147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1306/2586] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:27:22.064860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d2587-e3b0-4871-9864-a5892f8d5bfc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.065350 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d2587-e3b0-4871-9864-a5892f8d5bfc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.065774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d2587-e3b0-4871-9864-a5892f8d5bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.086222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-de6d2587-e3b0-4871-9864-a5892f8d5bfc None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:22.087498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-de6d2587-e3b0-4871-9864-a5892f8d5bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:22.095674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1307/2587] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:27:22.100510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d2587-e3b0-4871-9864-a5892f8d5bfc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:22.109961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d2587-e3b0-4871-9864-a5892f8d5bfc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:22.114899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96a3e1-cb77-4715-b749-5f4b1f202176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:22.115523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a3e1-cb77-4715-b749-5f4b1f202176 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.115803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a3e1-cb77-4715-b749-5f4b1f202176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.115926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd5d20-c348-420b-ba8e-54b013fa42de None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:22.116074 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a3e1-cb77-4715-b749-5f4b1f202176 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.116719 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96a3e1-cb77-4715-b749-5f4b1f202176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:27:22.117025 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96a3e1-cb77-4715-b749-5f4b1f202176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:22.118619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96a3e1-cb77-4715-b749-5f4b1f202176 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:22.120901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe7fe-4a87-4d5c-a65e-250abb6095ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:22.121524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe7fe-4a87-4d5c-a65e-250abb6095ea service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.121799 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe7fe-4a87-4d5c-a65e-250abb6095ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.122065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfe7fe-4a87-4d5c-a65e-250abb6095ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.134711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1308/2588] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:27:22.135494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfe7fe-4a87-4d5c-a65e-250abb6095ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:22.135494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfe7fe-4a87-4d5c-a65e-250abb6095ea service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:22.136462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96a3e1-cb77-4715-b749-5f4b1f202176 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:22.143348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1281/2589] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:22.147006 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96a3e1-cb77-4715-b749-5f4b1f202176 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:22.151817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a428e-0ad4-45d5-9674-af6dbdd8249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:22.152438 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a428e-0ad4-45d5-9674-af6dbdd8249c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.152770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a428e-0ad4-45d5-9674-af6dbdd8249c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.153099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a428e-0ad4-45d5-9674-af6dbdd8249c admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.157214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a428e-0ad4-45d5-9674-af6dbdd8249c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:22.157214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a428e-0ad4-45d5-9674-af6dbdd8249c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:22.234561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1309/2590] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:27:22 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:22.235865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe7fe-4a87-4d5c-a65e-250abb6095ea service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:22.247552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfe7fe-4a87-4d5c-a65e-250abb6095ea service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:22.260162 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:22.307852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91080373-e4ad-4f50-a08a-823a11934810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:22.308461 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91080373-e4ad-4f50-a08a-823a11934810 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.308737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91080373-e4ad-4f50-a08a-823a11934810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.309033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91080373-e4ad-4f50-a08a-823a11934810 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.309662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91080373-e4ad-4f50-a08a-823a11934810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:22.311645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91080373-e4ad-4f50-a08a-823a11934810 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:22.379690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1282/2591] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:27:22 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:22.384005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a428e-0ad4-45d5-9674-af6dbdd8249c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:22.395565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a428e-0ad4-45d5-9674-af6dbdd8249c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:22.400510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfd701-4f7f-4fbb-8838-6375d54933c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:22.401258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd701-4f7f-4fbb-8838-6375d54933c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.401542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd701-4f7f-4fbb-8838-6375d54933c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.402100 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfd701-4f7f-4fbb-8838-6375d54933c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.402449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfd701-4f7f-4fbb-8838-6375d54933c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:22.404118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfd701-4f7f-4fbb-8838-6375d54933c8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:22.415896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1310/2592] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:22.423648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91080373-e4ad-4f50-a08a-823a11934810 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:22.434757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91080373-e4ad-4f50-a08a-823a11934810 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:22.439660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc99b1-b432-45ef-a964-e56a0a4d9e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:22.440252 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc99b1-b432-45ef-a964-e56a0a4d9e7a admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.440521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc99b1-b432-45ef-a964-e56a0a4d9e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.440795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc99b1-b432-45ef-a964-e56a0a4d9e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.441434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc99b1-b432-45ef-a964-e56a0a4d9e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:22.443697 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc99b1-b432-45ef-a964-e56a0a4d9e7a admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:22.460627 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1283/2593] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:22.462113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfd701-4f7f-4fbb-8838-6375d54933c8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:22.476610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfd701-4f7f-4fbb-8838-6375d54933c8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:22.481770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3179a-65b3-449a-88bc-542ca1e95916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:22.482421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3179a-65b3-449a-88bc-542ca1e95916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.482770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3179a-65b3-449a-88bc-542ca1e95916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.483033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3179a-65b3-449a-88bc-542ca1e95916 admin admin] PATH_INFO: `/v3/projects/02a4afd5a47640519c6c35453363099f/users/d1e053462d174daab4c1e86b40055dd3/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.498221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3179a-65b3-449a-88bc-542ca1e95916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a4afd5a47640519c6c35453363099f, user_id=d1e053462d174daab4c1e86b40055dd3, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:22.501003 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3179a-65b3-449a-88bc-542ca1e95916 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:22.565327 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc99b1-b432-45ef-a964-e56a0a4d9e7a admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:22.567212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-fdcc99b1-b432-45ef-a964-e56a0a4d9e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:22.591470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc99b1-b432-45ef-a964-e56a0a4d9e7a admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:22.607361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1311/2594] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:22 2022] PUT /identity/v3/projects/02a4afd5a47640519c6c35453363099f/users/d1e053462d174daab4c1e86b40055dd3/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:22.609330 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359811a0-d83c-4f18-a430-3dfdaa9309fc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.609613 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359811a0-d83c-4f18-a430-3dfdaa9309fc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.609884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359811a0-d83c-4f18-a430-3dfdaa9309fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.638210 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-359811a0-d83c-4f18-a430-3dfdaa9309fc None None] MFA Rules not processed for user `d1e053462d174daab4c1e86b40055dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:22.639552 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-359811a0-d83c-4f18-a430-3dfdaa9309fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:22.667227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:22.668405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.668782 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.669151 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] PATH_INFO: `/v3/projects/d5adb09f1e2f4926b514eb97a26ced69` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.670431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5adb09f1e2f4926b514eb97a26ced69)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:22.673183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:22.717415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1312/2595] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:22.718250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359811a0-d83c-4f18-a430-3dfdaa9309fc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:22.729846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359811a0-d83c-4f18-a430-3dfdaa9309fc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:22.734714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10201db0-95d9-4c74-9eb1-1ace895087eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:22.738611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10201db0-95d9-4c74-9eb1-1ace895087eb admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.738611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10201db0-95d9-4c74-9eb1-1ace895087eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.738611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10201db0-95d9-4c74-9eb1-1ace895087eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.738611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10201db0-95d9-4c74-9eb1-1ace895087eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:22.738611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10201db0-95d9-4c74-9eb1-1ace895087eb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:22.777386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5adb09f1e2f4926b514eb97a26ced69', 'request_id': 'req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:22.783830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5adb09f1e2f4926b514eb97a26ced69', 'request_id': 'req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:22.792414 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5adb09f1e2f4926b514eb97a26ced69', 'request_id': 'req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:22.813594 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1313/2596] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:27:22 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:22.814516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10201db0-95d9-4c74-9eb1-1ace895087eb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:22.854344 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:22.860090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] The token cache is being invalidate because project d5adb09f1e2f4926b514eb97a26ced69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:27:22.860518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:22.862061 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b7df7243-bdfa-4f6a-b536-b51b5a35d71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:22.864019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1284/2597] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:27:22 2022] DELETE /identity/v3/projects/d5adb09f1e2f4926b514eb97a26ced69 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:22.868468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626eae-036a-496d-a62d-1b52214604b7 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.868756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626eae-036a-496d-a62d-1b52214604b7 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.869034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f626eae-036a-496d-a62d-1b52214604b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.888466 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10201db0-95d9-4c74-9eb1-1ace895087eb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:22.890490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3f626eae-036a-496d-a62d-1b52214604b7 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:22.891740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3f626eae-036a-496d-a62d-1b52214604b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:22.893792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9144d6d-2856-4c46-9fea-ba8ace00fd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:22.894438 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144d6d-2856-4c46-9fea-ba8ace00fd4b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.894956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144d6d-2856-4c46-9fea-ba8ace00fd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.895209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144d6d-2856-4c46-9fea-ba8ace00fd4b admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.895970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9144d6d-2856-4c46-9fea-ba8ace00fd4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:22.897901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9144d6d-2856-4c46-9fea-ba8ace00fd4b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:22.901698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1285/2598] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:27:22.909130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e51d9-b2c5-4399-aebf-1f8106cb85bb None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.909743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e51d9-b2c5-4399-aebf-1f8106cb85bb None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.909743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e51d9-b2c5-4399-aebf-1f8106cb85bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.930059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-150e51d9-b2c5-4399-aebf-1f8106cb85bb None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:22.931302 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-150e51d9-b2c5-4399-aebf-1f8106cb85bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:22.943517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1286/2599] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:27:22.944482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e51d9-b2c5-4399-aebf-1f8106cb85bb None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:22.955249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e51d9-b2c5-4399-aebf-1f8106cb85bb None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:22.960398 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d141ef7-8342-422a-88df-c8996f3e898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:22.961091 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d141ef7-8342-422a-88df-c8996f3e898d admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:22.961369 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d141ef7-8342-422a-88df-c8996f3e898d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:22.961638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d141ef7-8342-422a-88df-c8996f3e898d admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:22.962288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d141ef7-8342-422a-88df-c8996f3e898d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:27:22.962589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d141ef7-8342-422a-88df-c8996f3e898d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:22.964964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d141ef7-8342-422a-88df-c8996f3e898d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:22.974938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:22.980159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1287/2600] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:27:22.993353 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d141ef7-8342-422a-88df-c8996f3e898d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.007111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d141ef7-8342-422a-88df-c8996f3e898d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.015075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1a664-1275-43f6-9ddc-96d8d5f3529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.015915 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1a664-1275-43f6-9ddc-96d8d5f3529f admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.016291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1a664-1275-43f6-9ddc-96d8d5f3529f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.016688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1a664-1275-43f6-9ddc-96d8d5f3529f admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.017541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1a664-1275-43f6-9ddc-96d8d5f3529f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.019171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1314/2601] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:27:22 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:27:23.020122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1a664-1275-43f6-9ddc-96d8d5f3529f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.023480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9144d6d-2856-4c46-9fea-ba8ace00fd4b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.025246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c9144d6d-2856-4c46-9fea-ba8ace00fd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:23.042306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9144d6d-2856-4c46-9fea-ba8ace00fd4b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.050893 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b333f4e-48f1-44ae-a0a1-effb0612c451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.051508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b333f4e-48f1-44ae-a0a1-effb0612c451 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.051788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b333f4e-48f1-44ae-a0a1-effb0612c451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.052060 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b333f4e-48f1-44ae-a0a1-effb0612c451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.052827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b333f4e-48f1-44ae-a0a1-effb0612c451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.054349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b333f4e-48f1-44ae-a0a1-effb0612c451 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.064717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1315/2602] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:23.069472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b333f4e-48f1-44ae-a0a1-effb0612c451 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.082176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b333f4e-48f1-44ae-a0a1-effb0612c451 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.087321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e73a01-0a33-40c3-81ef-cb8b9b09a8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.088536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e73a01-0a33-40c3-81ef-cb8b9b09a8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.088814 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e73a01-0a33-40c3-81ef-cb8b9b09a8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.089087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e73a01-0a33-40c3-81ef-cb8b9b09a8b2 admin admin] PATH_INFO: `/v3/projects/86395bec2b1e46e1a1207c6579d90b1a/users/88c2b1554f7b43bebfa783343a3a4623/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.105562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e73a01-0a33-40c3-81ef-cb8b9b09a8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86395bec2b1e46e1a1207c6579d90b1a, user_id=88c2b1554f7b43bebfa783343a3a4623, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.108514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e73a01-0a33-40c3-81ef-cb8b9b09a8b2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.141448 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1288/2603] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:27:22 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:23.145503 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1a664-1275-43f6-9ddc-96d8d5f3529f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.205053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1a664-1275-43f6-9ddc-96d8d5f3529f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.209692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2945556-9e95-4e2b-a033-7f5e9f404f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.210372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2945556-9e95-4e2b-a033-7f5e9f404f19 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.210686 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2945556-9e95-4e2b-a033-7f5e9f404f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.210958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2945556-9e95-4e2b-a033-7f5e9f404f19 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.211571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2945556-9e95-4e2b-a033-7f5e9f404f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.214068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2945556-9e95-4e2b-a033-7f5e9f404f19 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.224902 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1316/2604] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:23 2022] PUT /identity/v3/projects/86395bec2b1e46e1a1207c6579d90b1a/users/88c2b1554f7b43bebfa783343a3a4623/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:27:23.228959 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e73a01-0a33-40c3-81ef-cb8b9b09a8b2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.290193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e73a01-0a33-40c3-81ef-cb8b9b09a8b2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.294892 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593c51d-f739-4b38-a468-6e5f56840690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.295488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593c51d-f739-4b38-a468-6e5f56840690 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.295766 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593c51d-f739-4b38-a468-6e5f56840690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.296040 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593c51d-f739-4b38-a468-6e5f56840690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.296924 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593c51d-f739-4b38-a468-6e5f56840690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.298536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593c51d-f739-4b38-a468-6e5f56840690 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.308636 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1317/2605] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:27:23.312648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593c51d-f739-4b38-a468-6e5f56840690 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.316906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1289/2606] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:27:23 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:27:23.323280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2945556-9e95-4e2b-a033-7f5e9f404f19 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.323488 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593c51d-f739-4b38-a468-6e5f56840690 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.328151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c400be-a0c7-42da-b4fa-2c14e34ac9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.328967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c400be-a0c7-42da-b4fa-2c14e34ac9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.329244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c400be-a0c7-42da-b4fa-2c14e34ac9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.330092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c400be-a0c7-42da-b4fa-2c14e34ac9a4 admin admin] PATH_INFO: `/v3/projects/86395bec2b1e46e1a1207c6579d90b1a/users/88c2b1554f7b43bebfa783343a3a4623/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.332081 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c400be-a0c7-42da-b4fa-2c14e34ac9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86395bec2b1e46e1a1207c6579d90b1a, user_id=88c2b1554f7b43bebfa783343a3a4623, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.333185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2945556-9e95-4e2b-a033-7f5e9f404f19 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.334720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c400be-a0c7-42da-b4fa-2c14e34ac9a4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.338053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a22148-6f25-4977-98f4-fd2aa48b77d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.338696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a22148-6f25-4977-98f4-fd2aa48b77d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.339083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a22148-6f25-4977-98f4-fd2aa48b77d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.339610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a22148-6f25-4977-98f4-fd2aa48b77d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.340379 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a22148-6f25-4977-98f4-fd2aa48b77d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.342606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a22148-6f25-4977-98f4-fd2aa48b77d7 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.345931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1318/2607] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:23 2022] PUT /identity/v3/projects/86395bec2b1e46e1a1207c6579d90b1a/users/88c2b1554f7b43bebfa783343a3a4623/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:27:23.353635 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1290/2608] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:23.357335 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f014-dc77-495e-bb2d-63f092ceab63 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.357474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a22148-6f25-4977-98f4-fd2aa48b77d7 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.357620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f014-dc77-495e-bb2d-63f092ceab63 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.357897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f014-dc77-495e-bb2d-63f092ceab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.367679 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a22148-6f25-4977-98f4-fd2aa48b77d7 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.387239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f532f014-dc77-495e-bb2d-63f092ceab63 None None] MFA Rules not processed for user `88c2b1554f7b43bebfa783343a3a4623`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:23.388458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f532f014-dc77-495e-bb2d-63f092ceab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:23.437269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e84dd-038c-47d2-b262-b54ce764209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.437911 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e84dd-038c-47d2-b262-b54ce764209e admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.438257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e84dd-038c-47d2-b262-b54ce764209e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.438462 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e84dd-038c-47d2-b262-b54ce764209e admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.439145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e84dd-038c-47d2-b262-b54ce764209e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.441258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e84dd-038c-47d2-b262-b54ce764209e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.446170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:23.456226 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1291/2609] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:23.457827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e84dd-038c-47d2-b262-b54ce764209e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.467925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1319/2610] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:23.468598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e84dd-038c-47d2-b262-b54ce764209e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.473418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8d941-9a22-4ead-a932-d543363896fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.474102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d941-9a22-4ead-a932-d543363896fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.474348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d941-9a22-4ead-a932-d543363896fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.474622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8d941-9a22-4ead-a932-d543363896fe admin admin] PATH_INFO: `/v3/projects/fba2a5090a204b9a9f9ef4d43033697a/users/179b2da98a8c42adaecff774150cc6b9/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.479292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532f014-dc77-495e-bb2d-63f092ceab63 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.480675 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f532f014-dc77-495e-bb2d-63f092ceab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:23.491522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8d941-9a22-4ead-a932-d543363896fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba2a5090a204b9a9f9ef4d43033697a, user_id=179b2da98a8c42adaecff774150cc6b9, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.494756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8d941-9a22-4ead-a932-d543363896fe admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.537651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532f014-dc77-495e-bb2d-63f092ceab63 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.541404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee8d58-314e-42f7-a8fd-c7fa8a6f3304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.541951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8d58-314e-42f7-a8fd-c7fa8a6f3304 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.542224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8d58-314e-42f7-a8fd-c7fa8a6f3304 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.542495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee8d58-314e-42f7-a8fd-c7fa8a6f3304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.552312 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee8d58-314e-42f7-a8fd-c7fa8a6f3304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.553731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee8d58-314e-42f7-a8fd-c7fa8a6f3304 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.563815 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1320/2611] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:27:23.580356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1292/2612] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:23 2022] PUT /identity/v3/projects/fba2a5090a204b9a9f9ef4d43033697a/users/179b2da98a8c42adaecff774150cc6b9/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:27:23.590752 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f337037-85b4-4303-b236-72bbd0ebec89 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.591036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f337037-85b4-4303-b236-72bbd0ebec89 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.591306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f337037-85b4-4303-b236-72bbd0ebec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.618878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8f337037-85b4-4303-b236-72bbd0ebec89 None None] MFA Rules not processed for user `179b2da98a8c42adaecff774150cc6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:23.620630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8f337037-85b4-4303-b236-72bbd0ebec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:23.685478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1321/2613] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:23.697248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8d941-9a22-4ead-a932-d543363896fe admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.727827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:23.752834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8d941-9a22-4ead-a932-d543363896fe admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.756582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba68d96-7a36-4a0c-ac89-c7d48f9e9ccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.757232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba68d96-7a36-4a0c-ac89-c7d48f9e9ccf service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.757508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba68d96-7a36-4a0c-ac89-c7d48f9e9ccf service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.757805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba68d96-7a36-4a0c-ac89-c7d48f9e9ccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.777175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba68d96-7a36-4a0c-ac89-c7d48f9e9ccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.777175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba68d96-7a36-4a0c-ac89-c7d48f9e9ccf service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.783046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1293/2614] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:23.786930 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f337037-85b4-4303-b236-72bbd0ebec89 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:23.788743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8f337037-85b4-4303-b236-72bbd0ebec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:23.802640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f337037-85b4-4303-b236-72bbd0ebec89 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:23.806292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cfd82-15ab-419c-bc2b-3f50a5311faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:23.807694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cfd82-15ab-419c-bc2b-3f50a5311faf service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:23.807975 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cfd82-15ab-419c-bc2b-3f50a5311faf service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:23.808243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cfd82-15ab-419c-bc2b-3f50a5311faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:23.810006 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a55cfd82-15ab-419c-bc2b-3f50a5311faf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:23.884604 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cfd82-15ab-419c-bc2b-3f50a5311faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:23.886068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cfd82-15ab-419c-bc2b-3f50a5311faf service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:23.895979 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1322/2615] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:24.426203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba68d96-7a36-4a0c-ac89-c7d48f9e9ccf service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:24.427648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-bba68d96-7a36-4a0c-ac89-c7d48f9e9ccf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:24.484149 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba68d96-7a36-4a0c-ac89-c7d48f9e9ccf service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:24.487997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92ae62-2a49-4d72-9168-6b13decca0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:24.488599 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92ae62-2a49-4d72-9168-6b13decca0aa service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:24.488873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92ae62-2a49-4d72-9168-6b13decca0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:24.489142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92ae62-2a49-4d72-9168-6b13decca0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:24.490994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5a92ae62-2a49-4d72-9168-6b13decca0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:24.560219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92ae62-2a49-4d72-9168-6b13decca0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:24.561764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92ae62-2a49-4d72-9168-6b13decca0aa service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:24.571698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1294/2616] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:28.672701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cfd82-15ab-419c-bc2b-3f50a5311faf service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:28.674142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a55cfd82-15ab-419c-bc2b-3f50a5311faf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:28.690980 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cfd82-15ab-419c-bc2b-3f50a5311faf service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:28.697076 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b1bff-3b21-4250-aa8b-55c7ef5c6d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:28.698079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b1bff-3b21-4250-aa8b-55c7ef5c6d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:28.698358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b1bff-3b21-4250-aa8b-55c7ef5c6d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:28.698690 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b1bff-3b21-4250-aa8b-55c7ef5c6d5e admin admin] PATH_INFO: `/v3/users/ce39c87aac4e4df79efc1f80a07b3273` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:28.700704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b1bff-3b21-4250-aa8b-55c7ef5c6d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce39c87aac4e4df79efc1f80a07b3273)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:28.703262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b1bff-3b21-4250-aa8b-55c7ef5c6d5e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:28.721736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:28.875599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-226b1bff-3b21-4250-aa8b-55c7ef5c6d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce39c87aac4e4df79efc1f80a07b3273'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:28.876359 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-226b1bff-3b21-4250-aa8b-55c7ef5c6d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce39c87aac4e4df79efc1f80a07b3273'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:28.934525 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-226b1bff-3b21-4250-aa8b-55c7ef5c6d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce39c87aac4e4df79efc1f80a07b3273'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:28.935410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-226b1bff-3b21-4250-aa8b-55c7ef5c6d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce39c87aac4e4df79efc1f80a07b3273'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:28.943546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-226b1bff-3b21-4250-aa8b-55c7ef5c6d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce39c87aac4e4df79efc1f80a07b3273'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:28.965480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1323/2617] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:27:28 2022] DELETE /identity/v3/users/ce39c87aac4e4df79efc1f80a07b3273 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:29.256199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92ae62-2a49-4d72-9168-6b13decca0aa service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:29.269713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92ae62-2a49-4d72-9168-6b13decca0aa service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:29.335269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:29.335802 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:29.336082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:29.336362 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] PATH_INFO: `/v3/projects/d9321ea0106f4853a2c4f8f587062feb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:29.337492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9321ea0106f4853a2c4f8f587062feb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:29.339469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:29.364019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:29.460773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9321ea0106f4853a2c4f8f587062feb', 'request_id': 'req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:29.466501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9321ea0106f4853a2c4f8f587062feb', 'request_id': 'req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:29.473099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9321ea0106f4853a2c4f8f587062feb', 'request_id': 'req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:29.567355 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] The token cache is being invalidate because project d9321ea0106f4853a2c4f8f587062feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:27:29.567728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:29.568459 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-ab97d8d0-e0f2-4c1c-890d-fba93f3bba3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:29.570124 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1295/2618] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:27:29 2022] DELETE /identity/v3/projects/d9321ea0106f4853a2c4f8f587062feb => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:29.575737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bf675-602f-4560-986c-d44d710333ca None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:29.576047 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bf675-602f-4560-986c-d44d710333ca None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:29.576328 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bf675-602f-4560-986c-d44d710333ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:29.608732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-195bf675-602f-4560-986c-d44d710333ca None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:29.609397 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-195bf675-602f-4560-986c-d44d710333ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:29.679202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1324/2619] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:27:29.688298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f76ab4-e4d3-4226-852b-f325da1566a0 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:29.688711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f76ab4-e4d3-4226-852b-f325da1566a0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:29.689164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f76ab4-e4d3-4226-852b-f325da1566a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:29.710499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a9f76ab4-e4d3-4226-852b-f325da1566a0 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:29.711758 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a9f76ab4-e4d3-4226-852b-f325da1566a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:29.719804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1296/2620] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:27:29.724282 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bf675-602f-4560-986c-d44d710333ca None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:29.734749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bf675-602f-4560-986c-d44d710333ca None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:29.739504 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecdaf7-ef92-4a7c-ab15-38ff29c147f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:29.740103 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecdaf7-ef92-4a7c-ab15-38ff29c147f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:29.740381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecdaf7-ef92-4a7c-ab15-38ff29c147f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:29.740655 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecdaf7-ef92-4a7c-ab15-38ff29c147f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:29.741327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecdaf7-ef92-4a7c-ab15-38ff29c147f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:27:29.741629 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecdaf7-ef92-4a7c-ab15-38ff29c147f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:29.743538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecdaf7-ef92-4a7c-ab15-38ff29c147f1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:29.755861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1325/2621] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:27:29.761033 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f76ab4-e4d3-4226-852b-f325da1566a0 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:29.770001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f76ab4-e4d3-4226-852b-f325da1566a0 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:29.774696 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af81209-a429-4977-9238-95d3a5b57d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:29.775291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af81209-a429-4977-9238-95d3a5b57d98 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:29.775568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af81209-a429-4977-9238-95d3a5b57d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:29.775834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af81209-a429-4977-9238-95d3a5b57d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:29.776491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af81209-a429-4977-9238-95d3a5b57d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:29.778409 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af81209-a429-4977-9238-95d3a5b57d98 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:29.860173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1297/2622] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:27:29 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:27:29.864411 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecdaf7-ef92-4a7c-ab15-38ff29c147f1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:29.874778 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecdaf7-ef92-4a7c-ab15-38ff29c147f1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:29.931917 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400da9a-8bfb-48f3-9257-bc6be843f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:29.932559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400da9a-8bfb-48f3-9257-bc6be843f463 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:29.932840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400da9a-8bfb-48f3-9257-bc6be843f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:29.933232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400da9a-8bfb-48f3-9257-bc6be843f463 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:29.933724 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400da9a-8bfb-48f3-9257-bc6be843f463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:29.935723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400da9a-8bfb-48f3-9257-bc6be843f463 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:30.051642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1326/2623] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:27:29 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:27:30.052874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af81209-a429-4977-9238-95d3a5b57d98 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:30.068764 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af81209-a429-4977-9238-95d3a5b57d98 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:30.074063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef95d46-304d-47ff-8787-9b9f8e8608d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:30.074690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef95d46-304d-47ff-8787-9b9f8e8608d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:30.074972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef95d46-304d-47ff-8787-9b9f8e8608d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:30.075244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef95d46-304d-47ff-8787-9b9f8e8608d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:30.075879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef95d46-304d-47ff-8787-9b9f8e8608d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:30.077573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef95d46-304d-47ff-8787-9b9f8e8608d4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:30.087534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1298/2624] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:30.091704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400da9a-8bfb-48f3-9257-bc6be843f463 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:30.102352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400da9a-8bfb-48f3-9257-bc6be843f463 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:30.107650 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca01d67-36a6-4f5f-9a2c-2fb4ab1771fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:30.108334 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01d67-36a6-4f5f-9a2c-2fb4ab1771fe admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:30.108703 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01d67-36a6-4f5f-9a2c-2fb4ab1771fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:30.109042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01d67-36a6-4f5f-9a2c-2fb4ab1771fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:30.109760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca01d67-36a6-4f5f-9a2c-2fb4ab1771fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:30.111560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca01d67-36a6-4f5f-9a2c-2fb4ab1771fe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:30.113953 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:30.127556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1327/2625] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:30.128777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef95d46-304d-47ff-8787-9b9f8e8608d4 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:30.139923 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef95d46-304d-47ff-8787-9b9f8e8608d4 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:30.146341 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a59e9-0aa2-41d7-a1d7-0d076282cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:30.147039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a59e9-0aa2-41d7-a1d7-0d076282cf81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:30.147302 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a59e9-0aa2-41d7-a1d7-0d076282cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:30.147572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a59e9-0aa2-41d7-a1d7-0d076282cf81 admin admin] PATH_INFO: `/v3/projects/54069756053240018c9d9fa1cf417c20/users/2fbc9ec429ca4958b021b29b4d662940/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:30.166300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a59e9-0aa2-41d7-a1d7-0d076282cf81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54069756053240018c9d9fa1cf417c20, user_id=2fbc9ec429ca4958b021b29b4d662940, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:30.166300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a59e9-0aa2-41d7-a1d7-0d076282cf81 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:30.317179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1299/2626] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:30 2022] PUT /identity/v3/projects/54069756053240018c9d9fa1cf417c20/users/2fbc9ec429ca4958b021b29b4d662940/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:30.327873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256dd1-26c2-4597-8618-0dbb2729fca0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:30.328157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256dd1-26c2-4597-8618-0dbb2729fca0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:30.328431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256dd1-26c2-4597-8618-0dbb2729fca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:30.356900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0b256dd1-26c2-4597-8618-0dbb2729fca0 None None] MFA Rules not processed for user `2fbc9ec429ca4958b021b29b4d662940`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:30.358351 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0b256dd1-26c2-4597-8618-0dbb2729fca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:30.433119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1328/2627] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:27:30.444399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a59e9-0aa2-41d7-a1d7-0d076282cf81 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:30.446168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ca5a59e9-0aa2-41d7-a1d7-0d076282cf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:30.522602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a59e9-0aa2-41d7-a1d7-0d076282cf81 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:30.528196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7abc7-9e6a-40dc-a0bf-8bf4dcfb6dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:30.528791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7abc7-9e6a-40dc-a0bf-8bf4dcfb6dc4 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:30.529065 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7abc7-9e6a-40dc-a0bf-8bf4dcfb6dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:30.529336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7abc7-9e6a-40dc-a0bf-8bf4dcfb6dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:30.537954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7abc7-9e6a-40dc-a0bf-8bf4dcfb6dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:30.539661 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7abc7-9e6a-40dc-a0bf-8bf4dcfb6dc4 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:30.549404 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1300/2628] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:30.776795 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b256dd1-26c2-4597-8618-0dbb2729fca0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:30.845638 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b256dd1-26c2-4597-8618-0dbb2729fca0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:30.850369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:30.851067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:30.851345 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:30.851759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] PATH_INFO: `/v3/users/2fbc9ec429ca4958b021b29b4d662940` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:30.852827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fbc9ec429ca4958b021b29b4d662940)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:30.855390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:31.056860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fbc9ec429ca4958b021b29b4d662940'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:31.057508 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fbc9ec429ca4958b021b29b4d662940'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:31.116501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fbc9ec429ca4958b021b29b4d662940'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:31.117115 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fbc9ec429ca4958b021b29b4d662940'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:31.124385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fbc9ec429ca4958b021b29b4d662940'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:31.141268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1329/2629] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:27:30 2022] DELETE /identity/v3/users/2fbc9ec429ca4958b021b29b4d662940 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:31.145805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5489f5-a78e-432b-912b-bd9a9cbaa936 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:31.146093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5489f5-a78e-432b-912b-bd9a9cbaa936 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:31.146397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5489f5-a78e-432b-912b-bd9a9cbaa936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:31.166580 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-2c5489f5-a78e-432b-912b-bd9a9cbaa936 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:31.167848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2c5489f5-a78e-432b-912b-bd9a9cbaa936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:31.198884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:31.232888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1301/2630] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:31.240572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:31.242079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:31.252515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:31.302435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef11a88-8cc9-41ff-8814-909b7c593ce3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:31.306867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974bc3a-1c07-42eb-bfdf-4b6b0bc849a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:31.307469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974bc3a-1c07-42eb-bfdf-4b6b0bc849a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:31.307741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974bc3a-1c07-42eb-bfdf-4b6b0bc849a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:31.308008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974bc3a-1c07-42eb-bfdf-4b6b0bc849a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:31.317124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974bc3a-1c07-42eb-bfdf-4b6b0bc849a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:31.318538 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974bc3a-1c07-42eb-bfdf-4b6b0bc849a0 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:31.329379 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1330/2631] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:31.736633 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5489f5-a78e-432b-912b-bd9a9cbaa936 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:31.737103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2c5489f5-a78e-432b-912b-bd9a9cbaa936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:31.752370 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5489f5-a78e-432b-912b-bd9a9cbaa936 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:31.764160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:31.764160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:31.764160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:31.764160 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] PATH_INFO: `/v3/projects/54069756053240018c9d9fa1cf417c20` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:31.764931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54069756053240018c9d9fa1cf417c20)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:31.765312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:31.901931 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54069756053240018c9d9fa1cf417c20', 'request_id': 'req-722b8094-533a-4c9e-8350-a00880785650'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:31.907740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54069756053240018c9d9fa1cf417c20', 'request_id': 'req-722b8094-533a-4c9e-8350-a00880785650'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:31.913916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54069756053240018c9d9fa1cf417c20', 'request_id': 'req-722b8094-533a-4c9e-8350-a00880785650'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:31.968813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] The token cache is being invalidate because project 54069756053240018c9d9fa1cf417c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:27:31.969126 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:31.969756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-722b8094-533a-4c9e-8350-a00880785650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:31.971659 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1302/2632] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:27:31 2022] DELETE /identity/v3/projects/54069756053240018c9d9fa1cf417c20 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:31.976515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2adde-8727-4ca5-8bef-405a155b16e6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:31.977011 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2adde-8727-4ca5-8bef-405a155b16e6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:31.977276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2adde-8727-4ca5-8bef-405a155b16e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:31.998336 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-55c2adde-8727-4ca5-8bef-405a155b16e6 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:31.999487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-55c2adde-8727-4ca5-8bef-405a155b16e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:32.080072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1331/2633] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:32.089049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53c2eb-2851-48a8-885e-5579057f88b1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:32.089411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53c2eb-2851-48a8-885e-5579057f88b1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:32.089748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53c2eb-2851-48a8-885e-5579057f88b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:32.110880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-4e53c2eb-2851-48a8-885e-5579057f88b1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:32.112145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4e53c2eb-2851-48a8-885e-5579057f88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:32.121030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1303/2634] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:27:32.127731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2adde-8727-4ca5-8bef-405a155b16e6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:32.134998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2adde-8727-4ca5-8bef-405a155b16e6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:32.139611 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83723326-896d-4f25-bc9b-4c55c8de1348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:32.140200 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83723326-896d-4f25-bc9b-4c55c8de1348 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:32.140475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83723326-896d-4f25-bc9b-4c55c8de1348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:32.140749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83723326-896d-4f25-bc9b-4c55c8de1348 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:32.141385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83723326-896d-4f25-bc9b-4c55c8de1348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:27:32.141683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83723326-896d-4f25-bc9b-4c55c8de1348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:32.143432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83723326-896d-4f25-bc9b-4c55c8de1348 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:32.156367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1332/2635] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:27:32.160795 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53c2eb-2851-48a8-885e-5579057f88b1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:32.170366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53c2eb-2851-48a8-885e-5579057f88b1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:32.175323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca33373-aead-4cdc-91ad-e77029598578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:32.175907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33373-aead-4cdc-91ad-e77029598578 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:32.176177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33373-aead-4cdc-91ad-e77029598578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:32.176440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33373-aead-4cdc-91ad-e77029598578 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:32.177054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca33373-aead-4cdc-91ad-e77029598578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:32.179037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca33373-aead-4cdc-91ad-e77029598578 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:32.289536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1304/2636] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:27:32 2022] POST /identity/v3/projects => generated 355 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:27:32.294248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83723326-896d-4f25-bc9b-4c55c8de1348 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:32.305435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83723326-896d-4f25-bc9b-4c55c8de1348 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:32.365057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc790c-2a68-4f17-8f0a-cdbfe86e177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:32.365664 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc790c-2a68-4f17-8f0a-cdbfe86e177e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:32.365999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc790c-2a68-4f17-8f0a-cdbfe86e177e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:32.366269 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc790c-2a68-4f17-8f0a-cdbfe86e177e admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:32.367234 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc790c-2a68-4f17-8f0a-cdbfe86e177e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:32.369958 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc790c-2a68-4f17-8f0a-cdbfe86e177e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:32.451674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1333/2637] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:27:32 2022] POST /identity/v3/users => generated 278 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:32.455731 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca33373-aead-4cdc-91ad-e77029598578 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:32.471427 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca33373-aead-4cdc-91ad-e77029598578 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:32.476794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a465f7-ead8-4ad1-911e-d1d7590fa71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:32.477672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a465f7-ead8-4ad1-911e-d1d7590fa71d admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:32.477920 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a465f7-ead8-4ad1-911e-d1d7590fa71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:32.479007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a465f7-ead8-4ad1-911e-d1d7590fa71d admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:32.479743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a465f7-ead8-4ad1-911e-d1d7590fa71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:32.481614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a465f7-ead8-4ad1-911e-d1d7590fa71d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:32.492476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1305/2638] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:27:32.496597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc790c-2a68-4f17-8f0a-cdbfe86e177e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:32.507192 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc790c-2a68-4f17-8f0a-cdbfe86e177e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:32.511783 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8428b-d10b-465c-8ba5-3b07a9c5124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:32.512380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8428b-d10b-465c-8ba5-3b07a9c5124f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:32.512655 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8428b-d10b-465c-8ba5-3b07a9c5124f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:32.512934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8428b-d10b-465c-8ba5-3b07a9c5124f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:32.513555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8428b-d10b-465c-8ba5-3b07a9c5124f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:32.515248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8428b-d10b-465c-8ba5-3b07a9c5124f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:32.526482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1334/2639] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:32.530758 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a465f7-ead8-4ad1-911e-d1d7590fa71d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:32.540530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a465f7-ead8-4ad1-911e-d1d7590fa71d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:32.545832 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a607f-10fe-45c4-ab85-cae80f1b20b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:32.546747 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a607f-10fe-45c4-ab85-cae80f1b20b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:32.547034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a607f-10fe-45c4-ab85-cae80f1b20b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:32.547307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a607f-10fe-45c4-ab85-cae80f1b20b1 admin admin] PATH_INFO: `/v3/projects/ea063198d7904cc9a724e563274f4bf7/users/e913f4cdfaab430a883b168c515ee1c3/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:32.561512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a607f-10fe-45c4-ab85-cae80f1b20b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea063198d7904cc9a724e563274f4bf7, user_id=e913f4cdfaab430a883b168c515ee1c3, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:32.564215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a607f-10fe-45c4-ab85-cae80f1b20b1 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:32.641891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1306/2640] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:32 2022] PUT /identity/v3/projects/ea063198d7904cc9a724e563274f4bf7/users/e913f4cdfaab430a883b168c515ee1c3/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:32.653403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83745c-fca8-4c0a-9c05-cdf8b8391405 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:32.653691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83745c-fca8-4c0a-9c05-cdf8b8391405 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:32.653963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83745c-fca8-4c0a-9c05-cdf8b8391405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:32.683675 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7d83745c-fca8-4c0a-9c05-cdf8b8391405 None None] MFA Rules not processed for user `e913f4cdfaab430a883b168c515ee1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:32.684901 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7d83745c-fca8-4c0a-9c05-cdf8b8391405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:32.689221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:32.755015 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1335/2641] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:32.760121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a607f-10fe-45c4-ab85-cae80f1b20b1 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:32.811281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:32.821206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a607f-10fe-45c4-ab85-cae80f1b20b1 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:32.826707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba6054-0a92-4d7f-9df3-9a1c8f6da038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:32.827330 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6054-0a92-4d7f-9df3-9a1c8f6da038 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:32.827660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6054-0a92-4d7f-9df3-9a1c8f6da038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:32.827929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6054-0a92-4d7f-9df3-9a1c8f6da038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:32.828569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba6054-0a92-4d7f-9df3-9a1c8f6da038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:32.830530 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba6054-0a92-4d7f-9df3-9a1c8f6da038 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:32.913418 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1307/2642] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:27:32 2022] POST /identity/v3/projects => generated 355 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:32.917623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83745c-fca8-4c0a-9c05-cdf8b8391405 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:32.930553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83745c-fca8-4c0a-9c05-cdf8b8391405 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:32.996990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8971d-6476-4b5a-9911-c278aa8f0274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:32.997654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8971d-6476-4b5a-9911-c278aa8f0274 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:32.997916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8971d-6476-4b5a-9911-c278aa8f0274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:32.998188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8971d-6476-4b5a-9911-c278aa8f0274 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:32.998863 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8971d-6476-4b5a-9911-c278aa8f0274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:33.000811 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8971d-6476-4b5a-9911-c278aa8f0274 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:33.122431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1336/2643] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:27:32 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:27:33.127800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba6054-0a92-4d7f-9df3-9a1c8f6da038 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:33.138871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba6054-0a92-4d7f-9df3-9a1c8f6da038 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:33.143632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e818a8f-e0a0-4c6c-b49e-2434fc256369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:33.144306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e818a8f-e0a0-4c6c-b49e-2434fc256369 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:33.144646 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e818a8f-e0a0-4c6c-b49e-2434fc256369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:33.145030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e818a8f-e0a0-4c6c-b49e-2434fc256369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:33.145726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e818a8f-e0a0-4c6c-b49e-2434fc256369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:33.147413 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e818a8f-e0a0-4c6c-b49e-2434fc256369 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:33.157938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1308/2644] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:33.162567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8971d-6476-4b5a-9911-c278aa8f0274 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:33.173064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8971d-6476-4b5a-9911-c278aa8f0274 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:33.177770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfead6b-0a01-48c1-ac8d-8e57ce0ec71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:33.178415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfead6b-0a01-48c1-ac8d-8e57ce0ec71c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:33.178722 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfead6b-0a01-48c1-ac8d-8e57ce0ec71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:33.179013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfead6b-0a01-48c1-ac8d-8e57ce0ec71c admin admin] PATH_INFO: `/v3/projects/ef4baf0156414637bebc807b88257216/users/45b23d039ff24b179e29ae0f50318a5e/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:33.195087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfead6b-0a01-48c1-ac8d-8e57ce0ec71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4baf0156414637bebc807b88257216, user_id=45b23d039ff24b179e29ae0f50318a5e, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:33.198540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfead6b-0a01-48c1-ac8d-8e57ce0ec71c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:33.293912 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1337/2645] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:33 2022] PUT /identity/v3/projects/ef4baf0156414637bebc807b88257216/users/45b23d039ff24b179e29ae0f50318a5e/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:27:33.298314 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e818a8f-e0a0-4c6c-b49e-2434fc256369 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:33.308647 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e818a8f-e0a0-4c6c-b49e-2434fc256369 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:33.362631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea116948-59c6-4961-b077-768e562922ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:33.363264 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea116948-59c6-4961-b077-768e562922ee admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:33.363545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea116948-59c6-4961-b077-768e562922ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:33.363809 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea116948-59c6-4961-b077-768e562922ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:33.364437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea116948-59c6-4961-b077-768e562922ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:33.366714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea116948-59c6-4961-b077-768e562922ee admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:33.377112 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1309/2646] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:33.381500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfead6b-0a01-48c1-ac8d-8e57ce0ec71c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:33.393435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfead6b-0a01-48c1-ac8d-8e57ce0ec71c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:33.398562 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa39ada-2bde-4cfd-8760-f36073b5cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:33.399243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39ada-2bde-4cfd-8760-f36073b5cb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:33.399519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39ada-2bde-4cfd-8760-f36073b5cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:33.399791 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39ada-2bde-4cfd-8760-f36073b5cb49 admin admin] PATH_INFO: `/v3/projects/ef4baf0156414637bebc807b88257216/users/45b23d039ff24b179e29ae0f50318a5e/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:33.401933 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa39ada-2bde-4cfd-8760-f36073b5cb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4baf0156414637bebc807b88257216, user_id=45b23d039ff24b179e29ae0f50318a5e, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:33.404600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa39ada-2bde-4cfd-8760-f36073b5cb49 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:33.415251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1338/2647] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:33 2022] PUT /identity/v3/projects/ef4baf0156414637bebc807b88257216/users/45b23d039ff24b179e29ae0f50318a5e/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:33.426382 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa8f42-b829-471a-b749-c28f6d3b4aa4 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:33.426660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa8f42-b829-471a-b749-c28f6d3b4aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:33.426974 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa8f42-b829-471a-b749-c28f6d3b4aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:33.455933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-09aa8f42-b829-471a-b749-c28f6d3b4aa4 None None] MFA Rules not processed for user `45b23d039ff24b179e29ae0f50318a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:33.457145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-09aa8f42-b829-471a-b749-c28f6d3b4aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:33.524881 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ac6f8-f8b5-4cb0-b27b-b82fc29da291 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:33.525203 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ac6f8-f8b5-4cb0-b27b-b82fc29da291 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:33.525475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ac6f8-f8b5-4cb0-b27b-b82fc29da291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:33.531891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1310/2648] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:33.545383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa8f42-b829-471a-b749-c28f6d3b4aa4 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:33.546836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-307ac6f8-f8b5-4cb0-b27b-b82fc29da291 None None] MFA Rules not processed for user `73143a267c38445eabd106950531c1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:33.547518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-09aa8f42-b829-471a-b749-c28f6d3b4aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:33.548028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-307ac6f8-f8b5-4cb0-b27b-b82fc29da291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:33.603080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:33.605539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1339/2649] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:27:33.608632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa8f42-b829-471a-b749-c28f6d3b4aa4 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:33.612366 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77dbf3-eb10-4e68-a8bf-d33267aef912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:33.612973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77dbf3-eb10-4e68-a8bf-d33267aef912 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:33.613249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77dbf3-eb10-4e68-a8bf-d33267aef912 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:33.613515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77dbf3-eb10-4e68-a8bf-d33267aef912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:33.623907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77dbf3-eb10-4e68-a8bf-d33267aef912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:33.625347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77dbf3-eb10-4e68-a8bf-d33267aef912 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:33.635303 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1311/2650] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:27:33.891436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ac6f8-f8b5-4cb0-b27b-b82fc29da291 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:33.892983 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-307ac6f8-f8b5-4cb0-b27b-b82fc29da291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:33.901079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:33.907443 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ac6f8-f8b5-4cb0-b27b-b82fc29da291 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:33.911162 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ea2b5-3168-4062-a786-19075bceb951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:33.911792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ea2b5-3168-4062-a786-19075bceb951 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:33.921941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ea2b5-3168-4062-a786-19075bceb951 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:33.921941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ea2b5-3168-4062-a786-19075bceb951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:33.971167 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ea2b5-3168-4062-a786-19075bceb951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:33.972727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ea2b5-3168-4062-a786-19075bceb951 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:33.984635 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1340/2651] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:42.458912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77dbf3-eb10-4e68-a8bf-d33267aef912 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:42.460417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0f77dbf3-eb10-4e68-a8bf-d33267aef912 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:42.527737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77dbf3-eb10-4e68-a8bf-d33267aef912 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:42.533040 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e17241-c9a4-4a9c-aeff-62240a344246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:42.533695 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e17241-c9a4-4a9c-aeff-62240a344246 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:42.533971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e17241-c9a4-4a9c-aeff-62240a344246 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:42.534244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e17241-c9a4-4a9c-aeff-62240a344246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:42.536153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-85e17241-c9a4-4a9c-aeff-62240a344246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:42.613073 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e17241-c9a4-4a9c-aeff-62240a344246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:42.614626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e17241-c9a4-4a9c-aeff-62240a344246 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:42.626912 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1312/2652] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:43.986108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=27 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:45.002378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ea2b5-3168-4062-a786-19075bceb951 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:45.003958 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-020ea2b5-3168-4062-a786-19075bceb951 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:45.016257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ea2b5-3168-4062-a786-19075bceb951 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:45.020146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857e29f-a706-4077-8293-1acd864f03b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:45.020779 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857e29f-a706-4077-8293-1acd864f03b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:45.021053 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857e29f-a706-4077-8293-1acd864f03b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:45.021320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857e29f-a706-4077-8293-1acd864f03b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:45.023077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c857e29f-a706-4077-8293-1acd864f03b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:45.038709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857e29f-a706-4077-8293-1acd864f03b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:45.044377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857e29f-a706-4077-8293-1acd864f03b2 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:45.053484 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1341/2653] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:27:51.881908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe89be8-9e13-450a-bdb1-99925670e563 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:51.882356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe89be8-9e13-450a-bdb1-99925670e563 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:51.882842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe89be8-9e13-450a-bdb1-99925670e563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:51.906854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-abe89be8-9e13-450a-bdb1-99925670e563 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:51.906854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-abe89be8-9e13-450a-bdb1-99925670e563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:51.968223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1313/2654] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 16:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:52.021742 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857e29f-a706-4077-8293-1acd864f03b2 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:52.023188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c857e29f-a706-4077-8293-1acd864f03b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:52.037936 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857e29f-a706-4077-8293-1acd864f03b2 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:52.044264 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ffe93-7ead-4752-8e29-3bd239bf422d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:52.045172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ffe93-7ead-4752-8e29-3bd239bf422d service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:52.045451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ffe93-7ead-4752-8e29-3bd239bf422d service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:52.045732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ffe93-7ead-4752-8e29-3bd239bf422d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:52.056516 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ffe93-7ead-4752-8e29-3bd239bf422d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:52.057261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ffe93-7ead-4752-8e29-3bd239bf422d service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:52.068432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1342/2655] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:52.788828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe89be8-9e13-450a-bdb1-99925670e563 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:52.798895 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe89be8-9e13-450a-bdb1-99925670e563 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:52.803539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:52.806493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:52.806493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:52.806493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] PATH_INFO: `/v3/users/e913f4cdfaab430a883b168c515ee1c3` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:52.806493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e913f4cdfaab430a883b168c515ee1c3)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:52.807773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:52.923361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:53.073229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e913f4cdfaab430a883b168c515ee1c3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:53.073884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e913f4cdfaab430a883b168c515ee1c3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:53.156834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e913f4cdfaab430a883b168c515ee1c3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:53.157527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e913f4cdfaab430a883b168c515ee1c3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:53.165190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e913f4cdfaab430a883b168c515ee1c3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:53.182827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1314/2656] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:27:52 2022] DELETE /identity/v3/users/e913f4cdfaab430a883b168c515ee1c3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:53.187939 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23159a-2674-4ec6-9dc8-a8dc90d2a5bd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:53.188424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23159a-2674-4ec6-9dc8-a8dc90d2a5bd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:53.188616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23159a-2674-4ec6-9dc8-a8dc90d2a5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:53.209586 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-de23159a-2674-4ec6-9dc8-a8dc90d2a5bd None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:53.210842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-de23159a-2674-4ec6-9dc8-a8dc90d2a5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:53.271638 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1343/2657] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:53.281274 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:53.282722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:53.339540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed0bee-2dc3-489b-9e19-b518ec1fcf82 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:53.343279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a509-1940-48b2-9c93-6e8f5f7ab1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:53.343901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a509-1940-48b2-9c93-6e8f5f7ab1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:53.344178 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a509-1940-48b2-9c93-6e8f5f7ab1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:53.344446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a509-1940-48b2-9c93-6e8f5f7ab1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:53.353449 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a509-1940-48b2-9c93-6e8f5f7ab1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:53.354918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a509-1940-48b2-9c93-6e8f5f7ab1a7 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:53.364806 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1315/2658] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:53.789239 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23159a-2674-4ec6-9dc8-a8dc90d2a5bd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:53.789603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-de23159a-2674-4ec6-9dc8-a8dc90d2a5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:53.805133 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23159a-2674-4ec6-9dc8-a8dc90d2a5bd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:53.810898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:53.811650 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:53.812231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:53.812533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] PATH_INFO: `/v3/projects/ea063198d7904cc9a724e563274f4bf7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:53.814514 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea063198d7904cc9a724e563274f4bf7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:53.818290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:53.907453 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea063198d7904cc9a724e563274f4bf7', 'request_id': 'req-f943cadd-b23d-4b55-8cef-1c1ae3952987'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:53.912935 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea063198d7904cc9a724e563274f4bf7', 'request_id': 'req-f943cadd-b23d-4b55-8cef-1c1ae3952987'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:53.920545 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea063198d7904cc9a724e563274f4bf7', 'request_id': 'req-f943cadd-b23d-4b55-8cef-1c1ae3952987'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:54.019523 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] The token cache is being invalidate because project ea063198d7904cc9a724e563274f4bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:27:54.019817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:54.020449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:54.021964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1344/2659] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:27:53 2022] DELETE /identity/v3/projects/ea063198d7904cc9a724e563274f4bf7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:27:54.026053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a509-1940-48b2-9c93-6e8f5f7ab1a7 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:54.038066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a509-1940-48b2-9c93-6e8f5f7ab1a7 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:54.108757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef157d-da52-478d-b1ef-d2dd829de571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:54.109631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef157d-da52-478d-b1ef-d2dd829de571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:54.109903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef157d-da52-478d-b1ef-d2dd829de571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:54.110174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef157d-da52-478d-b1ef-d2dd829de571 admin admin] PATH_INFO: `/v3/users/45b23d039ff24b179e29ae0f50318a5e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:54.111359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef157d-da52-478d-b1ef-d2dd829de571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b23d039ff24b179e29ae0f50318a5e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:54.113508 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef157d-da52-478d-b1ef-d2dd829de571 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:54.313596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-33ef157d-da52-478d-b1ef-d2dd829de571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b23d039ff24b179e29ae0f50318a5e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:54.314237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-33ef157d-da52-478d-b1ef-d2dd829de571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b23d039ff24b179e29ae0f50318a5e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:54.317234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:54.399280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-33ef157d-da52-478d-b1ef-d2dd829de571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b23d039ff24b179e29ae0f50318a5e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:54.400019 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-33ef157d-da52-478d-b1ef-d2dd829de571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b23d039ff24b179e29ae0f50318a5e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:54.413871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-33ef157d-da52-478d-b1ef-d2dd829de571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b23d039ff24b179e29ae0f50318a5e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:54.433730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1316/2660] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:27:54 2022] DELETE /identity/v3/users/45b23d039ff24b179e29ae0f50318a5e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:54.866295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:54.868138 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:54.881941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943cadd-b23d-4b55-8cef-1c1ae3952987 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:54.935928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:54.941869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:54.942502 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:54.942817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:54.943120 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] PATH_INFO: `/v3/projects/ef4baf0156414637bebc807b88257216` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:54.944210 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4baf0156414637bebc807b88257216)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:54.946186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:55.042931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4baf0156414637bebc807b88257216', 'request_id': 'req-9c530230-b0f7-42d8-bd22-f2b9103be8ed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:55.048542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4baf0156414637bebc807b88257216', 'request_id': 'req-9c530230-b0f7-42d8-bd22-f2b9103be8ed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:55.054536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4baf0156414637bebc807b88257216', 'request_id': 'req-9c530230-b0f7-42d8-bd22-f2b9103be8ed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:55.126976 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] The token cache is being invalidate because project ef4baf0156414637bebc807b88257216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:27:55.127275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:55.127964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9c530230-b0f7-42d8-bd22-f2b9103be8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:27:55.133536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1345/2661] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:27:54 2022] DELETE /identity/v3/projects/ef4baf0156414637bebc807b88257216 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:55.134368 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6080-5359-4093-b1a7-cf0781f41bd1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:55.134842 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6080-5359-4093-b1a7-cf0781f41bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:55.134963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6080-5359-4093-b1a7-cf0781f41bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:55.155483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a0dc6080-5359-4093-b1a7-cf0781f41bd1 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:55.159970 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a0dc6080-5359-4093-b1a7-cf0781f41bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:55.213652 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1317/2662] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:55.221654 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675abd1-4cd3-4212-a290-826d7ce43b3e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:55.222325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675abd1-4cd3-4212-a290-826d7ce43b3e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:55.222325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675abd1-4cd3-4212-a290-826d7ce43b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:55.243433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c675abd1-4cd3-4212-a290-826d7ce43b3e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:55.244644 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c675abd1-4cd3-4212-a290-826d7ce43b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:55.253515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1346/2663] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:55.257977 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6080-5359-4093-b1a7-cf0781f41bd1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:55.271721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6080-5359-4093-b1a7-cf0781f41bd1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:55.276727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeda104-b9b9-4508-b003-0c9105af531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:55.277329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeda104-b9b9-4508-b003-0c9105af531b admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:55.277608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeda104-b9b9-4508-b003-0c9105af531b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:55.277883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeda104-b9b9-4508-b003-0c9105af531b admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:55.278580 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeda104-b9b9-4508-b003-0c9105af531b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:27:55.278926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeda104-b9b9-4508-b003-0c9105af531b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:55.280605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeda104-b9b9-4508-b003-0c9105af531b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:55.292139 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1318/2664] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:27:55.300645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675abd1-4cd3-4212-a290-826d7ce43b3e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:55.310584 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675abd1-4cd3-4212-a290-826d7ce43b3e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:55.315342 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097cff0-224e-4b71-8acf-2a8393d7da21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:55.315932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097cff0-224e-4b71-8acf-2a8393d7da21 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:55.316210 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097cff0-224e-4b71-8acf-2a8393d7da21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:55.316481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097cff0-224e-4b71-8acf-2a8393d7da21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:55.317126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097cff0-224e-4b71-8acf-2a8393d7da21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:55.319181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097cff0-224e-4b71-8acf-2a8393d7da21 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:55.432090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1347/2665] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:27:55 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:55.436698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeda104-b9b9-4508-b003-0c9105af531b admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:55.446650 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeda104-b9b9-4508-b003-0c9105af531b admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:55.503050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753711-2e9d-4e89-a263-6531284f97c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:55.503671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753711-2e9d-4e89-a263-6531284f97c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:55.503949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753711-2e9d-4e89-a263-6531284f97c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:55.504219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753711-2e9d-4e89-a263-6531284f97c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:55.504936 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96753711-2e9d-4e89-a263-6531284f97c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:55.506906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96753711-2e9d-4e89-a263-6531284f97c9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:55.573189 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1319/2666] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:27:55 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:55.577183 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097cff0-224e-4b71-8acf-2a8393d7da21 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:55.587540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097cff0-224e-4b71-8acf-2a8393d7da21 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:55.592511 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df784a-3ac9-40f8-aeca-c6db112d0aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:55.593097 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df784a-3ac9-40f8-aeca-c6db112d0aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:55.593369 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df784a-3ac9-40f8-aeca-c6db112d0aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:55.593659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df784a-3ac9-40f8-aeca-c6db112d0aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:55.594288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df784a-3ac9-40f8-aeca-c6db112d0aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:55.595894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df784a-3ac9-40f8-aeca-c6db112d0aa3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:55.607740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1348/2667] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:55.611968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753711-2e9d-4e89-a263-6531284f97c9 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:55.622402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753711-2e9d-4e89-a263-6531284f97c9 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:55.627005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0079554-2997-4088-af09-c5e8d7298598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:55.627587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0079554-2997-4088-af09-c5e8d7298598 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:55.627860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0079554-2997-4088-af09-c5e8d7298598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:55.628129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0079554-2997-4088-af09-c5e8d7298598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:55.628754 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0079554-2997-4088-af09-c5e8d7298598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:55.630335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0079554-2997-4088-af09-c5e8d7298598 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:55.640497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1320/2668] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:27:55.644333 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df784a-3ac9-40f8-aeca-c6db112d0aa3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:55.654171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df784a-3ac9-40f8-aeca-c6db112d0aa3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:55.658771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5aaca-80e0-49da-8ff4-936903b9146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:55.659403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5aaca-80e0-49da-8ff4-936903b9146e admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:55.659674 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5aaca-80e0-49da-8ff4-936903b9146e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:55.659941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5aaca-80e0-49da-8ff4-936903b9146e admin admin] PATH_INFO: `/v3/projects/3f1b87ca27f649d3a1c1a47ed7524cbd/users/5a7758dfef504d3dbb9d7acc69be53ba/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:55.674843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5aaca-80e0-49da-8ff4-936903b9146e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1b87ca27f649d3a1c1a47ed7524cbd, user_id=5a7758dfef504d3dbb9d7acc69be53ba, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:55.677467 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5aaca-80e0-49da-8ff4-936903b9146e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:55.751103 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1349/2669] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:55 2022] PUT /identity/v3/projects/3f1b87ca27f649d3a1c1a47ed7524cbd/users/5a7758dfef504d3dbb9d7acc69be53ba/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:55.761286 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb481eb-e0aa-404a-a990-fe696fbcb0f0 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:55.761566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb481eb-e0aa-404a-a990-fe696fbcb0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:55.761836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb481eb-e0aa-404a-a990-fe696fbcb0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:55.788306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0bb481eb-e0aa-404a-a990-fe696fbcb0f0 None None] MFA Rules not processed for user `5a7758dfef504d3dbb9d7acc69be53ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:55.789502 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0bb481eb-e0aa-404a-a990-fe696fbcb0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:55.809136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:55.852676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1321/2670] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:55.866837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5aaca-80e0-49da-8ff4-936903b9146e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:55.931004 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5aaca-80e0-49da-8ff4-936903b9146e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:55.938323 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363f8e7-1039-4d22-a941-0029e8d853d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:55.939027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f8e7-1039-4d22-a941-0029e8d853d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:55.939435 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f8e7-1039-4d22-a941-0029e8d853d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:55.939779 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363f8e7-1039-4d22-a941-0029e8d853d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:55.941148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363f8e7-1039-4d22-a941-0029e8d853d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:55.944380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363f8e7-1039-4d22-a941-0029e8d853d5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:56.214765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:56.221782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1350/2671] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:27:55 2022] POST /identity/v3/projects => generated 379 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:56.229682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb481eb-e0aa-404a-a990-fe696fbcb0f0 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:56.241079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb481eb-e0aa-404a-a990-fe696fbcb0f0 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:56.299114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bf2b0-c45d-42d0-a242-c413972b49e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:56.299715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bf2b0-c45d-42d0-a242-c413972b49e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:56.299991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bf2b0-c45d-42d0-a242-c413972b49e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:56.300262 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bf2b0-c45d-42d0-a242-c413972b49e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:56.300882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bf2b0-c45d-42d0-a242-c413972b49e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:56.302822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bf2b0-c45d-42d0-a242-c413972b49e7 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:56.391611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1322/2672] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:27:56 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:27:56.395723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363f8e7-1039-4d22-a941-0029e8d853d5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:56.408117 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363f8e7-1039-4d22-a941-0029e8d853d5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:56.416441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e728cb-427e-4aea-b3c6-88deaf135528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:56.417168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e728cb-427e-4aea-b3c6-88deaf135528 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:56.417451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e728cb-427e-4aea-b3c6-88deaf135528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:56.417775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e728cb-427e-4aea-b3c6-88deaf135528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:56.423741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e728cb-427e-4aea-b3c6-88deaf135528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:56.423741 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e728cb-427e-4aea-b3c6-88deaf135528 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:56.436597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1351/2673] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:56.437883 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bf2b0-c45d-42d0-a242-c413972b49e7 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:56.448177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bf2b0-c45d-42d0-a242-c413972b49e7 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:56.453624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56105242-9be3-45ca-8548-3d48842f2818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:56.454261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56105242-9be3-45ca-8548-3d48842f2818 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:56.454534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56105242-9be3-45ca-8548-3d48842f2818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:56.454835 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56105242-9be3-45ca-8548-3d48842f2818 admin admin] PATH_INFO: `/v3/projects/17925078ee3e40bdaf8ad141184b3844/users/30636c134f63483f9476360bc440ffde/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:56.470454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56105242-9be3-45ca-8548-3d48842f2818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17925078ee3e40bdaf8ad141184b3844, user_id=30636c134f63483f9476360bc440ffde, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:56.473177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56105242-9be3-45ca-8548-3d48842f2818 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:56.567809 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1323/2674] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:56 2022] PUT /identity/v3/projects/17925078ee3e40bdaf8ad141184b3844/users/30636c134f63483f9476360bc440ffde/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:56.572037 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e728cb-427e-4aea-b3c6-88deaf135528 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:56.583051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e728cb-427e-4aea-b3c6-88deaf135528 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:56.677600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8b066-cc44-4ea8-b05d-3144d32f700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:56.678228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b066-cc44-4ea8-b05d-3144d32f700a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:56.678506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b066-cc44-4ea8-b05d-3144d32f700a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:56.678798 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b066-cc44-4ea8-b05d-3144d32f700a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:56.679445 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b066-cc44-4ea8-b05d-3144d32f700a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:56.681026 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b066-cc44-4ea8-b05d-3144d32f700a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:56.693724 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1352/2675] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:27:56.697182 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56105242-9be3-45ca-8548-3d48842f2818 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:56.708574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56105242-9be3-45ca-8548-3d48842f2818 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:56.714523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74008b90-bd53-40b1-9754-cb3ae6f27e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:56.715470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74008b90-bd53-40b1-9754-cb3ae6f27e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:56.721817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74008b90-bd53-40b1-9754-cb3ae6f27e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:56.721817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74008b90-bd53-40b1-9754-cb3ae6f27e67 admin admin] PATH_INFO: `/v3/projects/17925078ee3e40bdaf8ad141184b3844/users/30636c134f63483f9476360bc440ffde/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:56.721817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74008b90-bd53-40b1-9754-cb3ae6f27e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17925078ee3e40bdaf8ad141184b3844, user_id=30636c134f63483f9476360bc440ffde, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:56.722544 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74008b90-bd53-40b1-9754-cb3ae6f27e67 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:56.737058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1324/2676] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:27:56 2022] PUT /identity/v3/projects/17925078ee3e40bdaf8ad141184b3844/users/30636c134f63483f9476360bc440ffde/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:27:56.748201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90533b2-c7fc-4c4d-b5e1-7224faa4d361 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:56.748481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90533b2-c7fc-4c4d-b5e1-7224faa4d361 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:56.748745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90533b2-c7fc-4c4d-b5e1-7224faa4d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:56.792636 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b90533b2-c7fc-4c4d-b5e1-7224faa4d361 None None] MFA Rules not processed for user `30636c134f63483f9476360bc440ffde`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:56.795068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b90533b2-c7fc-4c4d-b5e1-7224faa4d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:56.866424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1353/2677] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:27:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:27:56.878445 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74008b90-bd53-40b1-9754-cb3ae6f27e67 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:56.880183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-74008b90-bd53-40b1-9754-cb3ae6f27e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:56.938825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74008b90-bd53-40b1-9754-cb3ae6f27e67 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:56.942496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbd1c9-cd40-4819-bca8-403e4248086e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:56.943156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbd1c9-cd40-4819-bca8-403e4248086e service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:56.943436 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbd1c9-cd40-4819-bca8-403e4248086e service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:56.943707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbd1c9-cd40-4819-bca8-403e4248086e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:56.972332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:56.999501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbd1c9-cd40-4819-bca8-403e4248086e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:57.000937 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbd1c9-cd40-4819-bca8-403e4248086e service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:57.010032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1325/2678] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:57.010211 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e485a-218f-4dfe-b40e-f9b8ef6e0e44 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:57.010657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e485a-218f-4dfe-b40e-f9b8ef6e0e44 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:57.010657 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e485a-218f-4dfe-b40e-f9b8ef6e0e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:57.032307 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7d0e485a-218f-4dfe-b40e-f9b8ef6e0e44 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:27:57.033577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7d0e485a-218f-4dfe-b40e-f9b8ef6e0e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:57.095104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1354/2679] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 16:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:27:57.162475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbd1c9-cd40-4819-bca8-403e4248086e service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:57.163994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e5bbd1c9-cd40-4819-bca8-403e4248086e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:27:57.237662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbd1c9-cd40-4819-bca8-403e4248086e service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:57.243280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29528c2-c744-4fa5-829e-f9192281289d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:57.243893 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29528c2-c744-4fa5-829e-f9192281289d service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:57.244174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29528c2-c744-4fa5-829e-f9192281289d service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:57.244448 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29528c2-c744-4fa5-829e-f9192281289d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:57.253237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29528c2-c744-4fa5-829e-f9192281289d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:57.254873 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29528c2-c744-4fa5-829e-f9192281289d service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:57.264345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1326/2680] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:27:58.769236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e485a-218f-4dfe-b40e-f9b8ef6e0e44 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:27:58.788271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e485a-218f-4dfe-b40e-f9b8ef6e0e44 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:27:58.788271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc078539-b34b-4c54-bbe3-dcda59ddf755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:27:58.788271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc078539-b34b-4c54-bbe3-dcda59ddf755 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:27:58.788271 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc078539-b34b-4c54-bbe3-dcda59ddf755 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:27:58.788620 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc078539-b34b-4c54-bbe3-dcda59ddf755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:27:58.804952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc078539-b34b-4c54-bbe3-dcda59ddf755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:27:58.810911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc078539-b34b-4c54-bbe3-dcda59ddf755 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:27:58.811626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:27:58.819592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1355/2681] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:27:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:01.040852 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bb49-60c3-4152-a31a-5bad54829323 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:01.044183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bb49-60c3-4152-a31a-5bad54829323 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:01.044183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bb49-60c3-4152-a31a-5bad54829323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:01.063225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-6e10bb49-60c3-4152-a31a-5bad54829323 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:01.064469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6e10bb49-60c3-4152-a31a-5bad54829323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:01.075928 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1327/2682] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 16:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:01.092455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc078539-b34b-4c54-bbe3-dcda59ddf755 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:01.095830 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dc078539-b34b-4c54-bbe3-dcda59ddf755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:01.111794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc078539-b34b-4c54-bbe3-dcda59ddf755 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:01.117371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e1bb3-4b2c-4efe-b281-d268b335414c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:01.117972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e1bb3-4b2c-4efe-b281-d268b335414c service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:01.118248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e1bb3-4b2c-4efe-b281-d268b335414c service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:01.118520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e1bb3-4b2c-4efe-b281-d268b335414c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:01.127682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e1bb3-4b2c-4efe-b281-d268b335414c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:01.129294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e1bb3-4b2c-4efe-b281-d268b335414c service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:01.140213 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1356/2683] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:03.166260 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10bb49-60c3-4152-a31a-5bad54829323 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:03.167705 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6e10bb49-60c3-4152-a31a-5bad54829323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:03.180027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10bb49-60c3-4152-a31a-5bad54829323 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:03.184583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06b2d2-ccda-4a3c-b019-0870ef89d949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:03.185207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06b2d2-ccda-4a3c-b019-0870ef89d949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:03.185469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06b2d2-ccda-4a3c-b019-0870ef89d949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:03.185737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06b2d2-ccda-4a3c-b019-0870ef89d949 admin admin] PATH_INFO: `/v3/users/d1e053462d174daab4c1e86b40055dd3` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:03.186884 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06b2d2-ccda-4a3c-b019-0870ef89d949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e053462d174daab4c1e86b40055dd3)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:03.188794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06b2d2-ccda-4a3c-b019-0870ef89d949 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:03.261380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e1bb3-4b2c-4efe-b281-d268b335414c service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:03.265173 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e1bb3-4b2c-4efe-b281-d268b335414c service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:03.269898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56059444-f3ef-43b1-be93-a5bcaa3c74ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:03.270533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56059444-f3ef-43b1-be93-a5bcaa3c74ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:03.270854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56059444-f3ef-43b1-be93-a5bcaa3c74ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:03.271128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56059444-f3ef-43b1-be93-a5bcaa3c74ef admin admin] PATH_INFO: `/v3/users/5a7758dfef504d3dbb9d7acc69be53ba` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:03.272235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56059444-f3ef-43b1-be93-a5bcaa3c74ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7758dfef504d3dbb9d7acc69be53ba)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:03.274126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56059444-f3ef-43b1-be93-a5bcaa3c74ef admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:03.444805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-eb06b2d2-ccda-4a3c-b019-0870ef89d949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e053462d174daab4c1e86b40055dd3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:03.445470 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-eb06b2d2-ccda-4a3c-b019-0870ef89d949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e053462d174daab4c1e86b40055dd3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:03.496609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-56059444-f3ef-43b1-be93-a5bcaa3c74ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7758dfef504d3dbb9d7acc69be53ba'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:03.497184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-56059444-f3ef-43b1-be93-a5bcaa3c74ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7758dfef504d3dbb9d7acc69be53ba'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:03.516432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-eb06b2d2-ccda-4a3c-b019-0870ef89d949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e053462d174daab4c1e86b40055dd3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:03.517034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-eb06b2d2-ccda-4a3c-b019-0870ef89d949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e053462d174daab4c1e86b40055dd3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:03.524306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-eb06b2d2-ccda-4a3c-b019-0870ef89d949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e053462d174daab4c1e86b40055dd3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:03.542171 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1328/2684] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:03 2022] DELETE /identity/v3/users/d1e053462d174daab4c1e86b40055dd3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:03.547506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b38828-c90f-4f0e-b122-db5c92d6af10 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:03.547789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b38828-c90f-4f0e-b122-db5c92d6af10 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:03.548063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b38828-c90f-4f0e-b122-db5c92d6af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:03.566467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-63b38828-c90f-4f0e-b122-db5c92d6af10 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:03.567702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-63b38828-c90f-4f0e-b122-db5c92d6af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:03.580622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:03.584802 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-56059444-f3ef-43b1-be93-a5bcaa3c74ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7758dfef504d3dbb9d7acc69be53ba'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:03.585426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-56059444-f3ef-43b1-be93-a5bcaa3c74ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7758dfef504d3dbb9d7acc69be53ba'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:03.594185 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-56059444-f3ef-43b1-be93-a5bcaa3c74ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7758dfef504d3dbb9d7acc69be53ba'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:03.614647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1357/2685] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:03 2022] DELETE /identity/v3/users/5a7758dfef504d3dbb9d7acc69be53ba => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:03.619128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac32bde-1714-49e9-bc5b-ff84630b078d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:03.619673 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac32bde-1714-49e9-bc5b-ff84630b078d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:03.619999 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac32bde-1714-49e9-bc5b-ff84630b078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:03.635999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1329/2686] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:03.641073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3ac32bde-1714-49e9-bc5b-ff84630b078d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:03.642281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3ac32bde-1714-49e9-bc5b-ff84630b078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:03.646114 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b38828-c90f-4f0e-b122-db5c92d6af10 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:03.650309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-63b38828-c90f-4f0e-b122-db5c92d6af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:03.718054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b38828-c90f-4f0e-b122-db5c92d6af10 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:03.722420 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1358/2687] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:03.732249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac32bde-1714-49e9-bc5b-ff84630b078d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:03.768270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df969a15-adbb-40b8-81b6-43c3a325b33a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:03.768809 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969a15-adbb-40b8-81b6-43c3a325b33a service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:03.769088 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969a15-adbb-40b8-81b6-43c3a325b33a service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:03.769361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969a15-adbb-40b8-81b6-43c3a325b33a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:03.778475 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df969a15-adbb-40b8-81b6-43c3a325b33a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:03.779993 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df969a15-adbb-40b8-81b6-43c3a325b33a service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:03.789076 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac32bde-1714-49e9-bc5b-ff84630b078d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:03.789776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1330/2688] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:28:03.792788 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387317d-3cec-4318-b05a-f6a0cdce9b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:03.793395 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387317d-3cec-4318-b05a-f6a0cdce9b1f service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:03.793732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387317d-3cec-4318-b05a-f6a0cdce9b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:03.794006 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387317d-3cec-4318-b05a-f6a0cdce9b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:03.812145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387317d-3cec-4318-b05a-f6a0cdce9b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:03.812145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387317d-3cec-4318-b05a-f6a0cdce9b1f service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:03.813945 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:03.819086 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1359/2689] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:28:04.465871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df969a15-adbb-40b8-81b6-43c3a325b33a service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:04.468014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-df969a15-adbb-40b8-81b6-43c3a325b33a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:04.486490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df969a15-adbb-40b8-81b6-43c3a325b33a service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:04.493054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:04.494095 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:04.494373 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:04.494711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] PATH_INFO: `/v3/projects/02a4afd5a47640519c6c35453363099f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:04.496133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a4afd5a47640519c6c35453363099f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:04.498240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:04.500193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387317d-3cec-4318-b05a-f6a0cdce9b1f service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:04.501774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b387317d-3cec-4318-b05a-f6a0cdce9b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:04.522872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387317d-3cec-4318-b05a-f6a0cdce9b1f service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:04.527781 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:04.528418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:04.528699 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:04.528964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] PATH_INFO: `/v3/projects/3f1b87ca27f649d3a1c1a47ed7524cbd` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:04.530188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1b87ca27f649d3a1c1a47ed7524cbd)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:04.533306 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:04.614308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a4afd5a47640519c6c35453363099f', 'request_id': 'req-7cedb683-caee-4a04-ad20-e7fa1631e8f7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:04.620668 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a4afd5a47640519c6c35453363099f', 'request_id': 'req-7cedb683-caee-4a04-ad20-e7fa1631e8f7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:04.627525 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a4afd5a47640519c6c35453363099f', 'request_id': 'req-7cedb683-caee-4a04-ad20-e7fa1631e8f7'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:04.727504 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] The token cache is being invalidate because project 02a4afd5a47640519c6c35453363099f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:04.727814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:04.728454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:04.729943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1331/2690] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:04 2022] DELETE /identity/v3/projects/02a4afd5a47640519c6c35453363099f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:04.734286 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:04.735618 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:04.740425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:04.768554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1b87ca27f649d3a1c1a47ed7524cbd', 'request_id': 'req-7026d032-5574-45b4-a341-f5a102df91d5'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:04.774070 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1b87ca27f649d3a1c1a47ed7524cbd', 'request_id': 'req-7026d032-5574-45b4-a341-f5a102df91d5'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:04.780486 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1b87ca27f649d3a1c1a47ed7524cbd', 'request_id': 'req-7026d032-5574-45b4-a341-f5a102df91d5'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:04.799464 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedb683-caee-4a04-ad20-e7fa1631e8f7 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:04.852429 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] The token cache is being invalidate because project 3f1b87ca27f649d3a1c1a47ed7524cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:04.852751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:04.853347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:04.854636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:04.854889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1360/2691] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:04 2022] DELETE /identity/v3/projects/3f1b87ca27f649d3a1c1a47ed7524cbd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:04.855299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:04.855653 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:04.855933 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] PATH_INFO: `/v3/users/88c2b1554f7b43bebfa783343a3a4623` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:04.857069 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c2b1554f7b43bebfa783343a3a4623)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:04.859398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:04.859775 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:04.860777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:04.873337 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026d032-5574-45b4-a341-f5a102df91d5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:04.877825 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ae997-eeb7-45b8-a154-ce41f58c1887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:04.878437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae997-eeb7-45b8-a154-ce41f58c1887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:04.878742 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae997-eeb7-45b8-a154-ce41f58c1887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:04.879016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae997-eeb7-45b8-a154-ce41f58c1887 admin admin] PATH_INFO: `/v3/users/30636c134f63483f9476360bc440ffde` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:04.880419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ae997-eeb7-45b8-a154-ce41f58c1887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30636c134f63483f9476360bc440ffde)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:04.882259 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ae997-eeb7-45b8-a154-ce41f58c1887 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:05.078549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c2b1554f7b43bebfa783343a3a4623'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.079277 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c2b1554f7b43bebfa783343a3a4623'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.089888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-036ae997-eeb7-45b8-a154-ce41f58c1887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30636c134f63483f9476360bc440ffde'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.091008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-036ae997-eeb7-45b8-a154-ce41f58c1887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30636c134f63483f9476360bc440ffde'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.190601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c2b1554f7b43bebfa783343a3a4623'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.191267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c2b1554f7b43bebfa783343a3a4623'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.199039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c2b1554f7b43bebfa783343a3a4623'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.216699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1332/2692] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:04 2022] DELETE /identity/v3/users/88c2b1554f7b43bebfa783343a3a4623 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:05.219992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:05.219992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:05.280965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-036ae997-eeb7-45b8-a154-ce41f58c1887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30636c134f63483f9476360bc440ffde'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.282009 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-036ae997-eeb7-45b8-a154-ce41f58c1887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30636c134f63483f9476360bc440ffde'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.287463 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c45a92-8214-4fa9-8e11-8c99672d9ed1 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:05.292250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:05.292805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-036ae997-eeb7-45b8-a154-ce41f58c1887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30636c134f63483f9476360bc440ffde'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.292943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:05.293172 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:05.293649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] PATH_INFO: `/v3/users/179b2da98a8c42adaecff774150cc6b9` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:05.294572 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=179b2da98a8c42adaecff774150cc6b9)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:05.297310 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:05.317313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1361/2693] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:04 2022] DELETE /identity/v3/users/30636c134f63483f9476360bc440ffde => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:05.318515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7f1e4-015d-44c5-9571-03678f323114 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:05.318834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7f1e4-015d-44c5-9571-03678f323114 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:05.319106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7f1e4-015d-44c5-9571-03678f323114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:05.346388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-08a7f1e4-015d-44c5-9571-03678f323114 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:05.346388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-08a7f1e4-015d-44c5-9571-03678f323114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:05.380187 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:05.394256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:05.415986 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1362/2694] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:05.434905 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7f1e4-015d-44c5-9571-03678f323114 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:05.437396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-08a7f1e4-015d-44c5-9571-03678f323114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:05.499359 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '179b2da98a8c42adaecff774150cc6b9'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.500205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '179b2da98a8c42adaecff774150cc6b9'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.519487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7f1e4-015d-44c5-9571-03678f323114 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:05.525139 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ee6d1-47a0-42da-8960-280bdb35d774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:05.525754 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ee6d1-47a0-42da-8960-280bdb35d774 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:05.526029 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ee6d1-47a0-42da-8960-280bdb35d774 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:05.526299 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ee6d1-47a0-42da-8960-280bdb35d774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:05.535325 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ee6d1-47a0-42da-8960-280bdb35d774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:05.536892 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ee6d1-47a0-42da-8960-280bdb35d774 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:05.547701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1363/2695] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:05.585361 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '179b2da98a8c42adaecff774150cc6b9'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.586146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '179b2da98a8c42adaecff774150cc6b9'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.595637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '179b2da98a8c42adaecff774150cc6b9'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.617760 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1333/2696] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:05 2022] DELETE /identity/v3/users/179b2da98a8c42adaecff774150cc6b9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:05.622614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232a610-66f1-4403-a232-e1e0e5f4addc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:05.623226 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232a610-66f1-4403-a232-e1e0e5f4addc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:05.623510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232a610-66f1-4403-a232-e1e0e5f4addc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:05.644909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5232a610-66f1-4403-a232-e1e0e5f4addc None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:05.646082 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5232a610-66f1-4403-a232-e1e0e5f4addc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:05.679801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:05.681542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:05.752644 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1364/2697] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:05.762405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abacba8-ae94-44cf-a1a2-eb6311486539 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:05.762597 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232a610-66f1-4403-a232-e1e0e5f4addc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:05.763995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5232a610-66f1-4403-a232-e1e0e5f4addc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:05.767245 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:05.767872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:05.768153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:05.768423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] PATH_INFO: `/v3/projects/86395bec2b1e46e1a1207c6579d90b1a` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:05.769554 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86395bec2b1e46e1a1207c6579d90b1a)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:05.771519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:05.823845 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232a610-66f1-4403-a232-e1e0e5f4addc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:05.828852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5136c-77c4-416c-99e2-bdf8eeeb7007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:05.829465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5136c-77c4-416c-99e2-bdf8eeeb7007 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:05.829736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5136c-77c4-416c-99e2-bdf8eeeb7007 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:05.830020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5136c-77c4-416c-99e2-bdf8eeeb7007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:05.839150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5136c-77c4-416c-99e2-bdf8eeeb7007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:05.840555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5136c-77c4-416c-99e2-bdf8eeeb7007 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:05.849869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1365/2698] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:28:05.850775 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5136c-77c4-416c-99e2-bdf8eeeb7007 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:05.852006 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3ab5136c-77c4-416c-99e2-bdf8eeeb7007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:05.864276 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5136c-77c4-416c-99e2-bdf8eeeb7007 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:05.869110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:05.869717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:05.869987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:05.870254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] PATH_INFO: `/v3/projects/17925078ee3e40bdaf8ad141184b3844` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:05.871381 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17925078ee3e40bdaf8ad141184b3844)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:05.873249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:05.906045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:05.912134 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86395bec2b1e46e1a1207c6579d90b1a', 'request_id': 'req-b668af6b-2bd4-4470-89c3-ae7507057433'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.913417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:05.918507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86395bec2b1e46e1a1207c6579d90b1a', 'request_id': 'req-b668af6b-2bd4-4470-89c3-ae7507057433'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.925011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86395bec2b1e46e1a1207c6579d90b1a', 'request_id': 'req-b668af6b-2bd4-4470-89c3-ae7507057433'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:05.996178 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17925078ee3e40bdaf8ad141184b3844', 'request_id': 'req-b368c909-63eb-4c5d-9855-d0edc263b5f8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.002149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17925078ee3e40bdaf8ad141184b3844', 'request_id': 'req-b368c909-63eb-4c5d-9855-d0edc263b5f8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.012171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17925078ee3e40bdaf8ad141184b3844', 'request_id': 'req-b368c909-63eb-4c5d-9855-d0edc263b5f8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.014528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] The token cache is being invalidate because project 86395bec2b1e46e1a1207c6579d90b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:06.015072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.015833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b668af6b-2bd4-4470-89c3-ae7507057433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.017385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1334/2699] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:05 2022] DELETE /identity/v3/projects/86395bec2b1e46e1a1207c6579d90b1a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:06.021857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586285f-d660-4dd6-9f30-5f2e1ecc51c3 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.022144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586285f-d660-4dd6-9f30-5f2e1ecc51c3 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.022541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586285f-d660-4dd6-9f30-5f2e1ecc51c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.041848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b586285f-d660-4dd6-9f30-5f2e1ecc51c3 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:06.043235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b586285f-d660-4dd6-9f30-5f2e1ecc51c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:06.106157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1335/2700] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:06.111949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] The token cache is being invalidate because project 17925078ee3e40bdaf8ad141184b3844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:06.112246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.113274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b368c909-63eb-4c5d-9855-d0edc263b5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.114998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1366/2701] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:05 2022] DELETE /identity/v3/projects/17925078ee3e40bdaf8ad141184b3844 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:06.115125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ca4c-d622-44c0-8579-a3bb8296f234 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.115240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ca4c-d622-44c0-8579-a3bb8296f234 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.115488 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82ca4c-d622-44c0-8579-a3bb8296f234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.120419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ddac-12d5-45e2-8d21-a2ed16133d8f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.122829 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ddac-12d5-45e2-8d21-a2ed16133d8f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.122829 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ddac-12d5-45e2-8d21-a2ed16133d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.138348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-db82ca4c-d622-44c0-8579-a3bb8296f234 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:06.139677 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-db82ca4c-d622-44c0-8579-a3bb8296f234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:06.144204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6757ddac-12d5-45e2-8d21-a2ed16133d8f None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:06.145396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6757ddac-12d5-45e2-8d21-a2ed16133d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:06.148082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1336/2702] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:06.152199 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82ca4c-d622-44c0-8579-a3bb8296f234 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.153976 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1367/2703] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:06.161519 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82ca4c-d622-44c0-8579-a3bb8296f234 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.161956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f0a2b-111f-4875-83ac-b45e8747da0e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.162248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f0a2b-111f-4875-83ac-b45e8747da0e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.163652 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f0a2b-111f-4875-83ac-b45e8747da0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.166965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73f1e0-6690-47f5-b88c-f945bca664f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.167629 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f1e0-6690-47f5-b88c-f945bca664f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.169956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f1e0-6690-47f5-b88c-f945bca664f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.169956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f1e0-6690-47f5-b88c-f945bca664f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.169956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73f1e0-6690-47f5-b88c-f945bca664f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:06.169956 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73f1e0-6690-47f5-b88c-f945bca664f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.171371 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73f1e0-6690-47f5-b88c-f945bca664f6 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.184482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1337/2704] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:28:06.188470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1d0f0a2b-111f-4875-83ac-b45e8747da0e None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:06.189543 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73f1e0-6690-47f5-b88c-f945bca664f6 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.189864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1d0f0a2b-111f-4875-83ac-b45e8747da0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:06.197937 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1368/2705] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:06.200209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73f1e0-6690-47f5-b88c-f945bca664f6 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.202602 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f0a2b-111f-4875-83ac-b45e8747da0e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.205570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929513a-6ec2-4b0a-b5dd-e53036ef2d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.206150 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929513a-6ec2-4b0a-b5dd-e53036ef2d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.206430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929513a-6ec2-4b0a-b5dd-e53036ef2d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.206736 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929513a-6ec2-4b0a-b5dd-e53036ef2d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.207639 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929513a-6ec2-4b0a-b5dd-e53036ef2d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.209687 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929513a-6ec2-4b0a-b5dd-e53036ef2d4c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.211888 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f0a2b-111f-4875-83ac-b45e8747da0e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.216393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e1fbb-d1e6-4add-80b1-192a828a4fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.216981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e1fbb-d1e6-4add-80b1-192a828a4fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.217248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e1fbb-d1e6-4add-80b1-192a828a4fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.218076 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e1fbb-d1e6-4add-80b1-192a828a4fb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.218737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e1fbb-d1e6-4add-80b1-192a828a4fb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:06.219041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e1fbb-d1e6-4add-80b1-192a828a4fb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.220599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e1fbb-d1e6-4add-80b1-192a828a4fb5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.232363 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1369/2706] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:28:06.236712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e1fbb-d1e6-4add-80b1-192a828a4fb5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.246231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e1fbb-d1e6-4add-80b1-192a828a4fb5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.251565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905201f0-7ffe-4fbb-aa61-49290663acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.251565 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905201f0-7ffe-4fbb-aa61-49290663acc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.251801 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905201f0-7ffe-4fbb-aa61-49290663acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.251982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905201f0-7ffe-4fbb-aa61-49290663acc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.252462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905201f0-7ffe-4fbb-aa61-49290663acc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.254315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905201f0-7ffe-4fbb-aa61-49290663acc1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.310213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1338/2707] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:06.310213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929513a-6ec2-4b0a-b5dd-e53036ef2d4c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.310213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-6929513a-6ec2-4b0a-b5dd-e53036ef2d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:06.330382 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1370/2708] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:06.331301 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905201f0-7ffe-4fbb-aa61-49290663acc1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.375429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929513a-6ec2-4b0a-b5dd-e53036ef2d4c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.394759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905201f0-7ffe-4fbb-aa61-49290663acc1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.399757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de984f7-7c40-407b-9f43-6529f6638bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.400362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de984f7-7c40-407b-9f43-6529f6638bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.400634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de984f7-7c40-407b-9f43-6529f6638bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.400898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de984f7-7c40-407b-9f43-6529f6638bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.401519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de984f7-7c40-407b-9f43-6529f6638bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.403439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de984f7-7c40-407b-9f43-6529f6638bb6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.434405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.435071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.435343 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.435610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] PATH_INFO: `/v3/projects/fba2a5090a204b9a9f9ef4d43033697a` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.437441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba2a5090a204b9a9f9ef4d43033697a)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.439422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.509560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1371/2709] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:06.510376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de984f7-7c40-407b-9f43-6529f6638bb6 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.522166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de984f7-7c40-407b-9f43-6529f6638bb6 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.526834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b98889-007a-4d83-a9d3-d934f9ffc5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.527410 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b98889-007a-4d83-a9d3-d934f9ffc5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.527686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b98889-007a-4d83-a9d3-d934f9ffc5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.527955 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b98889-007a-4d83-a9d3-d934f9ffc5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.528591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b98889-007a-4d83-a9d3-d934f9ffc5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.531027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b98889-007a-4d83-a9d3-d934f9ffc5b8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.550520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba2a5090a204b9a9f9ef4d43033697a', 'request_id': 'req-329bf1af-a937-4524-b6d3-1f25c861e1c3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.555923 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba2a5090a204b9a9f9ef4d43033697a', 'request_id': 'req-329bf1af-a937-4524-b6d3-1f25c861e1c3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.562185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba2a5090a204b9a9f9ef4d43033697a', 'request_id': 'req-329bf1af-a937-4524-b6d3-1f25c861e1c3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.624658 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1372/2710] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:06.625491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b98889-007a-4d83-a9d3-d934f9ffc5b8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.634856 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b98889-007a-4d83-a9d3-d934f9ffc5b8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.654003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:06.660601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] The token cache is being invalidate because project fba2a5090a204b9a9f9ef4d43033697a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:06.660978 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.661601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:06.663131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1339/2711] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:06 2022] DELETE /identity/v3/projects/fba2a5090a204b9a9f9ef4d43033697a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:06.663613 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=8 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:06.664100 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.665254 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:06.695123 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecfece-d8bb-449b-960a-fb06092d97df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.697898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecfece-d8bb-449b-960a-fb06092d97df admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.697898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecfece-d8bb-449b-960a-fb06092d97df admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.697898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecfece-d8bb-449b-960a-fb06092d97df admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.697898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecfece-d8bb-449b-960a-fb06092d97df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.698571 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecfece-d8bb-449b-960a-fb06092d97df admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.709135 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1373/2712] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:06.710220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac84c8-6c33-4a24-aff7-b9be1b800d87 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.710504 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac84c8-6c33-4a24-aff7-b9be1b800d87 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.710860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac84c8-6c33-4a24-aff7-b9be1b800d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.730181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e0ac84c8-6c33-4a24-aff7-b9be1b800d87 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:06.731513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e0ac84c8-6c33-4a24-aff7-b9be1b800d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:06.734260 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bf1af-a937-4524-b6d3-1f25c861e1c3 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.739270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc8838-ca57-471d-9350-1a17043334b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.739473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1374/2713] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:06.740236 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac84c8-6c33-4a24-aff7-b9be1b800d87 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.741441 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e0ac84c8-6c33-4a24-aff7-b9be1b800d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:06.743882 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc8838-ca57-471d-9350-1a17043334b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.744488 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc8838-ca57-471d-9350-1a17043334b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.745169 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc8838-ca57-471d-9350-1a17043334b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.746266 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc8838-ca57-471d-9350-1a17043334b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.748228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc8838-ca57-471d-9350-1a17043334b3 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.754248 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac84c8-6c33-4a24-aff7-b9be1b800d87 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.760376 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733b475-834a-4751-bb48-c17eaf752aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.760626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1340/2714] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:06.760903 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733b475-834a-4751-bb48-c17eaf752aee admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.761016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733b475-834a-4751-bb48-c17eaf752aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.761290 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733b475-834a-4751-bb48-c17eaf752aee admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.761949 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733b475-834a-4751-bb48-c17eaf752aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.763711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733b475-834a-4751-bb48-c17eaf752aee admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.764951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc8838-ca57-471d-9350-1a17043334b3 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.776811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc8838-ca57-471d-9350-1a17043334b3 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.777262 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1375/2715] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:06.782294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733b475-834a-4751-bb48-c17eaf752aee admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.782455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1f142-6c58-4868-8c0f-6dc107792873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.782999 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f142-6c58-4868-8c0f-6dc107792873 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.783269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f142-6c58-4868-8c0f-6dc107792873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.783542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f142-6c58-4868-8c0f-6dc107792873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.784188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1f142-6c58-4868-8c0f-6dc107792873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.785807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1f142-6c58-4868-8c0f-6dc107792873 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.792956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733b475-834a-4751-bb48-c17eaf752aee admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.799413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ea13-2c98-4f63-a237-3ba80458e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.800088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ea13-2c98-4f63-a237-3ba80458e177 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.800362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ea13-2c98-4f63-a237-3ba80458e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.800632 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ea13-2c98-4f63-a237-3ba80458e177 admin admin] PATH_INFO: `/v3/projects/da236c14d77b450aa86062a366b62ae4/users/c5cd8d21d26a4505816bfdf6af415283/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.802309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1341/2716] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:06.802591 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1f142-6c58-4868-8c0f-6dc107792873 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:06.813930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1f142-6c58-4868-8c0f-6dc107792873 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:06.817864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ea13-2c98-4f63-a237-3ba80458e177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da236c14d77b450aa86062a366b62ae4, user_id=c5cd8d21d26a4505816bfdf6af415283, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.818833 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84191ce3-a771-4bd6-b286-ca26718e4e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:06.819496 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191ce3-a771-4bd6-b286-ca26718e4e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.819771 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191ce3-a771-4bd6-b286-ca26718e4e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.820044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191ce3-a771-4bd6-b286-ca26718e4e86 admin admin] PATH_INFO: `/v3/projects/61d5712c20b14c3e9ba88382ee3ddfdb/users/f69285624a164daba0f4fb921f683561/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.820847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ea13-2c98-4f63-a237-3ba80458e177 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.835012 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84191ce3-a771-4bd6-b286-ca26718e4e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d5712c20b14c3e9ba88382ee3ddfdb, user_id=f69285624a164daba0f4fb921f683561, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:06.837740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84191ce3-a771-4bd6-b286-ca26718e4e86 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:06.887041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1376/2717] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:06 2022] PUT /identity/v3/projects/da236c14d77b450aa86062a366b62ae4/users/c5cd8d21d26a4505816bfdf6af415283/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:06.888099 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d97a-009d-4a39-a794-b0ef57e8cbec None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.888377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d97a-009d-4a39-a794-b0ef57e8cbec None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.888643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d97a-009d-4a39-a794-b0ef57e8cbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.908091 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5360d97a-009d-4a39-a794-b0ef57e8cbec None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:06.909302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5360d97a-009d-4a39-a794-b0ef57e8cbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:06.911150 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1342/2718] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:06 2022] PUT /identity/v3/projects/61d5712c20b14c3e9ba88382ee3ddfdb/users/f69285624a164daba0f4fb921f683561/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:06.912396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092a4a6-d58a-42d7-9688-bc360fbdf020 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.912682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092a4a6-d58a-42d7-9688-bc360fbdf020 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.912949 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092a4a6-d58a-42d7-9688-bc360fbdf020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:06.942347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-5092a4a6-d58a-42d7-9688-bc360fbdf020 None None] MFA Rules not processed for user `c5cd8d21d26a4505816bfdf6af415283`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:06.943636 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5092a4a6-d58a-42d7-9688-bc360fbdf020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:06.967643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:06.974215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1377/2719] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:06.975513 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763217f4-98d5-4f51-8d0e-69471aadfe6e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:06.979955 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763217f4-98d5-4f51-8d0e-69471aadfe6e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:06.979955 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763217f4-98d5-4f51-8d0e-69471aadfe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.004506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-763217f4-98d5-4f51-8d0e-69471aadfe6e None None] MFA Rules not processed for user `f69285624a164daba0f4fb921f683561`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:07.005749 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-763217f4-98d5-4f51-8d0e-69471aadfe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:07.009158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1343/2720] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:07.010006 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092a4a6-d58a-42d7-9688-bc360fbdf020 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.020613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092a4a6-d58a-42d7-9688-bc360fbdf020 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.025752 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450adee-8618-4853-83b6-0da66159a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.026872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450adee-8618-4853-83b6-0da66159a41a admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.027208 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450adee-8618-4853-83b6-0da66159a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.027476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450adee-8618-4853-83b6-0da66159a41a admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.028111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450adee-8618-4853-83b6-0da66159a41a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:07.028409 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450adee-8618-4853-83b6-0da66159a41a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.030250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450adee-8618-4853-83b6-0da66159a41a admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.041451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1344/2721] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:28:07.042223 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450adee-8618-4853-83b6-0da66159a41a admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.052512 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450adee-8618-4853-83b6-0da66159a41a admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.057921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a519b72-97b1-4e41-9dd1-70912f05c6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.058509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a519b72-97b1-4e41-9dd1-70912f05c6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.058829 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a519b72-97b1-4e41-9dd1-70912f05c6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.059105 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a519b72-97b1-4e41-9dd1-70912f05c6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.059726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a519b72-97b1-4e41-9dd1-70912f05c6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.062259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a519b72-97b1-4e41-9dd1-70912f05c6f1 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.071577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1378/2722] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:07.072450 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763217f4-98d5-4f51-8d0e-69471aadfe6e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.082367 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763217f4-98d5-4f51-8d0e-69471aadfe6e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.086993 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310ac6e-6888-4f0f-91ec-8780d7fb2662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.088952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ac6e-6888-4f0f-91ec-8780d7fb2662 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.088952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ac6e-6888-4f0f-91ec-8780d7fb2662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.088952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ac6e-6888-4f0f-91ec-8780d7fb2662 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.088952 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310ac6e-6888-4f0f-91ec-8780d7fb2662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.090740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310ac6e-6888-4f0f-91ec-8780d7fb2662 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.110843 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:07.130231 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1345/2723] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:07 2022] POST /identity/v3/projects => generated 369 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:07.131173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a519b72-97b1-4e41-9dd1-70912f05c6f1 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.192594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a519b72-97b1-4e41-9dd1-70912f05c6f1 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.197352 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1ebcb-8d78-4b2e-8b2b-b7b103ac3d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.197971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1ebcb-8d78-4b2e-8b2b-b7b103ac3d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.198265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1ebcb-8d78-4b2e-8b2b-b7b103ac3d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.198536 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1ebcb-8d78-4b2e-8b2b-b7b103ac3d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.199198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1ebcb-8d78-4b2e-8b2b-b7b103ac3d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.201215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1ebcb-8d78-4b2e-8b2b-b7b103ac3d92 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.242868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1379/2724] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:07 2022] POST /identity/v3/projects => generated 397 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:07.242868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310ac6e-6888-4f0f-91ec-8780d7fb2662 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.284570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1346/2725] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:07 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:07.285388 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1ebcb-8d78-4b2e-8b2b-b7b103ac3d92 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.314493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310ac6e-6888-4f0f-91ec-8780d7fb2662 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.354507 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1ebcb-8d78-4b2e-8b2b-b7b103ac3d92 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.359307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cf2aa-9b73-455c-a100-6e801c136311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.359932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cf2aa-9b73-455c-a100-6e801c136311 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.360210 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cf2aa-9b73-455c-a100-6e801c136311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.360476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cf2aa-9b73-455c-a100-6e801c136311 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.361130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cf2aa-9b73-455c-a100-6e801c136311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.363082 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cf2aa-9b73-455c-a100-6e801c136311 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.369876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71e4f-2af9-489a-b4b0-7aed1b92e4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.370485 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71e4f-2af9-489a-b4b0-7aed1b92e4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.370871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71e4f-2af9-489a-b4b0-7aed1b92e4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.371050 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71e4f-2af9-489a-b4b0-7aed1b92e4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.371659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be71e4f-2af9-489a-b4b0-7aed1b92e4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.374121 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be71e4f-2af9-489a-b4b0-7aed1b92e4c1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.453963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1347/2726] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:07 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:07.454918 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cf2aa-9b73-455c-a100-6e801c136311 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.460915 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:07.467087 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1380/2727] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:07 2022] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:07.467272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cf2aa-9b73-455c-a100-6e801c136311 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.467470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71e4f-2af9-489a-b4b0-7aed1b92e4c1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.470334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bf36e-c50b-4047-a2da-9bbe898ee6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.470967 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bf36e-c50b-4047-a2da-9bbe898ee6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.471246 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bf36e-c50b-4047-a2da-9bbe898ee6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.471516 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bf36e-c50b-4047-a2da-9bbe898ee6d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.472141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bf36e-c50b-4047-a2da-9bbe898ee6d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.474070 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bf36e-c50b-4047-a2da-9bbe898ee6d9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.475669 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71e4f-2af9-489a-b4b0-7aed1b92e4c1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.480704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a8429-7be3-4945-a4be-30634e2e58c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.481295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a8429-7be3-4945-a4be-30634e2e58c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.481569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a8429-7be3-4945-a4be-30634e2e58c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.481842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a8429-7be3-4945-a4be-30634e2e58c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.482470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a8429-7be3-4945-a4be-30634e2e58c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.484708 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a8429-7be3-4945-a4be-30634e2e58c1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.494973 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1381/2728] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:07.495688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a8429-7be3-4945-a4be-30634e2e58c1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.506740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a8429-7be3-4945-a4be-30634e2e58c1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.511408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7f4c1-96e9-4aab-b0db-eeb54d585a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.511967 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7f4c1-96e9-4aab-b0db-eeb54d585a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.512240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7f4c1-96e9-4aab-b0db-eeb54d585a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.512534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7f4c1-96e9-4aab-b0db-eeb54d585a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.513140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7f4c1-96e9-4aab-b0db-eeb54d585a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.515267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7f4c1-96e9-4aab-b0db-eeb54d585a39 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.525384 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1382/2729] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:07.526197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7f4c1-96e9-4aab-b0db-eeb54d585a39 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.536002 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7f4c1-96e9-4aab-b0db-eeb54d585a39 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.540736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b56985-74b9-4ea9-9e2c-e76046d2d088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.541281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56985-74b9-4ea9-9e2c-e76046d2d088 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.541553 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56985-74b9-4ea9-9e2c-e76046d2d088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.541819 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b56985-74b9-4ea9-9e2c-e76046d2d088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.542418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b56985-74b9-4ea9-9e2c-e76046d2d088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.543968 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b56985-74b9-4ea9-9e2c-e76046d2d088 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.553737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1383/2730] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:07.554506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b56985-74b9-4ea9-9e2c-e76046d2d088 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.565068 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b56985-74b9-4ea9-9e2c-e76046d2d088 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.572739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535f5b1-3478-4a45-b3da-d5ca5415ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.573667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535f5b1-3478-4a45-b3da-d5ca5415ec9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.574172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535f5b1-3478-4a45-b3da-d5ca5415ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.574449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535f5b1-3478-4a45-b3da-d5ca5415ec9d admin admin] PATH_INFO: `/v3/projects/d980a95ccc24429995a6fe58508b7d48/users/a79c23d447214a3d85bea0f29cb439f0/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.584881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1348/2731] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:07 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:07.586399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bf36e-c50b-4047-a2da-9bbe898ee6d9 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.593492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535f5b1-3478-4a45-b3da-d5ca5415ec9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d980a95ccc24429995a6fe58508b7d48, user_id=a79c23d447214a3d85bea0f29cb439f0, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.597030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535f5b1-3478-4a45-b3da-d5ca5415ec9d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.597790 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bf36e-c50b-4047-a2da-9bbe898ee6d9 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.603200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6f94-bbb7-48f3-aa90-9004b1b8c49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.606824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6f94-bbb7-48f3-aa90-9004b1b8c49f admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.606824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6f94-bbb7-48f3-aa90-9004b1b8c49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.606824 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6f94-bbb7-48f3-aa90-9004b1b8c49f admin admin] PATH_INFO: `/v3/projects/8cc79392e9c94a82bd614e06fe948bb8/users/5403ca9aa07c440b922eaf135cd3d44c/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.619301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e6f94-bbb7-48f3-aa90-9004b1b8c49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc79392e9c94a82bd614e06fe948bb8, user_id=5403ca9aa07c440b922eaf135cd3d44c, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.621944 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e6f94-bbb7-48f3-aa90-9004b1b8c49f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.723135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1349/2732] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:07 2022] PUT /identity/v3/projects/8cc79392e9c94a82bd614e06fe948bb8/users/5403ca9aa07c440b922eaf135cd3d44c/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:07.727185 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1384/2733] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:07 2022] PUT /identity/v3/projects/d980a95ccc24429995a6fe58508b7d48/users/a79c23d447214a3d85bea0f29cb439f0/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:07.727185 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535f5b1-3478-4a45-b3da-d5ca5415ec9d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.727378 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6f94-bbb7-48f3-aa90-9004b1b8c49f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.772278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:07.787707 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535f5b1-3478-4a45-b3da-d5ca5415ec9d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.790814 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6f94-bbb7-48f3-aa90-9004b1b8c49f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.792736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460f45b-6cce-4de5-8d1e-98d40a5f0482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.793543 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460f45b-6cce-4de5-8d1e-98d40a5f0482 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.793891 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460f45b-6cce-4de5-8d1e-98d40a5f0482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.794240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460f45b-6cce-4de5-8d1e-98d40a5f0482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.795051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460f45b-6cce-4de5-8d1e-98d40a5f0482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.797462 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460f45b-6cce-4de5-8d1e-98d40a5f0482 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.797926 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd6534-6505-4b86-a9cd-4f9efb4ac9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.801492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd6534-6505-4b86-a9cd-4f9efb4ac9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.801492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd6534-6505-4b86-a9cd-4f9efb4ac9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.801492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd6534-6505-4b86-a9cd-4f9efb4ac9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.801492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd6534-6505-4b86-a9cd-4f9efb4ac9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.801492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd6534-6505-4b86-a9cd-4f9efb4ac9cf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.807607 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1385/2734] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:07.809046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ebf5e-21f5-4301-91dc-1c07343d1fc6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.809338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ebf5e-21f5-4301-91dc-1c07343d1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.809612 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ebf5e-21f5-4301-91dc-1c07343d1fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.815563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1350/2735] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:07.815563 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd6534-6505-4b86-a9cd-4f9efb4ac9cf admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.823405 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd6534-6505-4b86-a9cd-4f9efb4ac9cf admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.828119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c3cfa-e323-4eee-967e-31556f55e294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.828825 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c3cfa-e323-4eee-967e-31556f55e294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.829079 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c3cfa-e323-4eee-967e-31556f55e294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.829336 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c3cfa-e323-4eee-967e-31556f55e294 admin admin] PATH_INFO: `/v3/projects/27854390b5cd46b6a060b98ab3ef8dbd/users/f39f1d508b6c4ab99d6ac30d1b1fe6eb/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.841172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-944ebf5e-21f5-4301-91dc-1c07343d1fc6 None None] MFA Rules not processed for user `5403ca9aa07c440b922eaf135cd3d44c`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:07.843380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-944ebf5e-21f5-4301-91dc-1c07343d1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:07.845017 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c3cfa-e323-4eee-967e-31556f55e294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27854390b5cd46b6a060b98ab3ef8dbd, user_id=f39f1d508b6c4ab99d6ac30d1b1fe6eb, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.847719 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c3cfa-e323-4eee-967e-31556f55e294 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.898780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1351/2736] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:07 2022] PUT /identity/v3/projects/27854390b5cd46b6a060b98ab3ef8dbd/users/f39f1d508b6c4ab99d6ac30d1b1fe6eb/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:07.901688 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c3cfa-e323-4eee-967e-31556f55e294 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.907630 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1386/2737] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:07.908480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ebf5e-21f5-4301-91dc-1c07343d1fc6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.922425 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ebf5e-21f5-4301-91dc-1c07343d1fc6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.962257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c3cfa-e323-4eee-967e-31556f55e294 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:07.966935 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb98ef2-85b2-4af8-82fd-a4662f6d3f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.968164 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb98ef2-85b2-4af8-82fd-a4662f6d3f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.968434 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb98ef2-85b2-4af8-82fd-a4662f6d3f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.968702 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb98ef2-85b2-4af8-82fd-a4662f6d3f96 admin admin] PATH_INFO: `/v3/projects/d980a95ccc24429995a6fe58508b7d48/users/a79c23d447214a3d85bea0f29cb439f0/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.970594 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb98ef2-85b2-4af8-82fd-a4662f6d3f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d980a95ccc24429995a6fe58508b7d48, user_id=a79c23d447214a3d85bea0f29cb439f0, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.973258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb98ef2-85b2-4af8-82fd-a4662f6d3f96 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.978887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e475c6c-a53c-4226-b23e-c0df8ff2d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:07.979492 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e475c6c-a53c-4226-b23e-c0df8ff2d154 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:07.979767 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e475c6c-a53c-4226-b23e-c0df8ff2d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:07.980036 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e475c6c-a53c-4226-b23e-c0df8ff2d154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:07.980675 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e475c6c-a53c-4226-b23e-c0df8ff2d154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:07.982244 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e475c6c-a53c-4226-b23e-c0df8ff2d154 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:07.984001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1352/2738] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:07 2022] PUT /identity/v3/projects/d980a95ccc24429995a6fe58508b7d48/users/a79c23d447214a3d85bea0f29cb439f0/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:07.984792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb98ef2-85b2-4af8-82fd-a4662f6d3f96 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:07.986354 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ddb98ef2-85b2-4af8-82fd-a4662f6d3f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:08.004018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1387/2739] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:08.004018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d9d2-6156-4942-991d-7a12e026ba0a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:08.009476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d9d2-6156-4942-991d-7a12e026ba0a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:08.009476 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4d9d2-6156-4942-991d-7a12e026ba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:08.017583 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:08.032294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-aec4d9d2-6156-4942-991d-7a12e026ba0a None None] MFA Rules not processed for user `a79c23d447214a3d85bea0f29cb439f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:08.033415 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-aec4d9d2-6156-4942-991d-7a12e026ba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:08.044691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb98ef2-85b2-4af8-82fd-a4662f6d3f96 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:08.049416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44186c68-1b7e-4add-81d7-0a29c205d9ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:08.050291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186c68-1b7e-4add-81d7-0a29c205d9ce service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:08.050447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186c68-1b7e-4add-81d7-0a29c205d9ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:08.050598 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44186c68-1b7e-4add-81d7-0a29c205d9ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:08.081387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:08.105304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1388/2740] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:08.105818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44186c68-1b7e-4add-81d7-0a29c205d9ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:08.106090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4d9d2-6156-4942-991d-7a12e026ba0a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:08.107312 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44186c68-1b7e-4add-81d7-0a29c205d9ce service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:08.122027 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1353/2741] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:08.130919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44186c68-1b7e-4add-81d7-0a29c205d9ce service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:08.130919 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-44186c68-1b7e-4add-81d7-0a29c205d9ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:08.135779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44186c68-1b7e-4add-81d7-0a29c205d9ce service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:08.143637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0879cfe-4414-420f-81c5-1dfc0b0452bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:08.143637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0879cfe-4414-420f-81c5-1dfc0b0452bf service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:08.143637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0879cfe-4414-420f-81c5-1dfc0b0452bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:08.143637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0879cfe-4414-420f-81c5-1dfc0b0452bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:08.156854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0879cfe-4414-420f-81c5-1dfc0b0452bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:08.158300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0879cfe-4414-420f-81c5-1dfc0b0452bf service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:08.168235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1354/2742] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:08.176991 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4d9d2-6156-4942-991d-7a12e026ba0a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:08.182780 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8d498-c66f-46e1-81eb-c7241dd9ea36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:08.183372 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8d498-c66f-46e1-81eb-c7241dd9ea36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:08.184216 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8d498-c66f-46e1-81eb-c7241dd9ea36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:08.184487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8d498-c66f-46e1-81eb-c7241dd9ea36 admin admin] PATH_INFO: `/v3/projects/27854390b5cd46b6a060b98ab3ef8dbd/users/f39f1d508b6c4ab99d6ac30d1b1fe6eb/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:08.187119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8d498-c66f-46e1-81eb-c7241dd9ea36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27854390b5cd46b6a060b98ab3ef8dbd, user_id=f39f1d508b6c4ab99d6ac30d1b1fe6eb, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:08.189887 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8d498-c66f-46e1-81eb-c7241dd9ea36 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:08.201605 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1389/2743] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:08 2022] PUT /identity/v3/projects/27854390b5cd46b6a060b98ab3ef8dbd/users/f39f1d508b6c4ab99d6ac30d1b1fe6eb/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:08.216243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6d05d-18d4-4299-9cae-4f3e45243fa8 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:08.216243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6d05d-18d4-4299-9cae-4f3e45243fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:08.216243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6d05d-18d4-4299-9cae-4f3e45243fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:08.244670 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-3ea6d05d-18d4-4299-9cae-4f3e45243fa8 None None] MFA Rules not processed for user `f39f1d508b6c4ab99d6ac30d1b1fe6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:08.255796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3ea6d05d-18d4-4299-9cae-4f3e45243fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:08.327744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1355/2744] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:08.433200 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8d498-c66f-46e1-81eb-c7241dd9ea36 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:08.488595 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8d498-c66f-46e1-81eb-c7241dd9ea36 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:08.492223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f22d3d-5cd7-4a93-a13a-1a385e70cdeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:08.492809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f22d3d-5cd7-4a93-a13a-1a385e70cdeb service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:08.493082 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f22d3d-5cd7-4a93-a13a-1a385e70cdeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:08.493349 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f22d3d-5cd7-4a93-a13a-1a385e70cdeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:08.502362 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f22d3d-5cd7-4a93-a13a-1a385e70cdeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:08.503808 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f22d3d-5cd7-4a93-a13a-1a385e70cdeb service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:08.513219 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1390/2745] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:09.561535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5444-b1cd-4a35-80c3-792e02d638bc None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:09.562092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5444-b1cd-4a35-80c3-792e02d638bc None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:09.562092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5444-b1cd-4a35-80c3-792e02d638bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:09.582158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0b5a5444-b1cd-4a35-80c3-792e02d638bc None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:09.586987 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0b5a5444-b1cd-4a35-80c3-792e02d638bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:09.644743 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:09.659085 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1356/2746] 10.222.0.43 () {58 vars in 1016 bytes} [Thu Sep 8 16:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:09.673947 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f22d3d-5cd7-4a93-a13a-1a385e70cdeb service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:09.675478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-71f22d3d-5cd7-4a93-a13a-1a385e70cdeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:09.751764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f22d3d-5cd7-4a93-a13a-1a385e70cdeb service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:09.757482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9645f4d-209b-484b-923b-b810b1ba9610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:09.758088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9645f4d-209b-484b-923b-b810b1ba9610 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:09.758364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9645f4d-209b-484b-923b-b810b1ba9610 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:09.758633 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9645f4d-209b-484b-923b-b810b1ba9610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:09.767224 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9645f4d-209b-484b-923b-b810b1ba9610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:09.768787 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9645f4d-209b-484b-923b-b810b1ba9610 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:09.778820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1391/2747] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:09.796176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a5444-b1cd-4a35-80c3-792e02d638bc None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:09.807452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a5444-b1cd-4a35-80c3-792e02d638bc None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:09.813817 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc638-daa9-47bb-9970-df8d5b4113d3 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39f1d508b6c4ab99d6ac30d1b1fe6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27854390b5cd46b6a060b98ab3ef8dbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:09.814422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc638-daa9-47bb-9970-df8d5b4113d3 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:09.814728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc638-daa9-47bb-9970-df8d5b4113d3 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:09.815003 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc638-daa9-47bb-9970-df8d5b4113d3 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:09.816008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fc638-daa9-47bb-9970-df8d5b4113d3 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:09.816328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fc638-daa9-47bb-9970-df8d5b4113d3 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:09.817909 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fc638-daa9-47bb-9970-df8d5b4113d3 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:09.831011 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1357/2748] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:28:09.835556 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9645f4d-209b-484b-923b-b810b1ba9610 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:09.841731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:09.848385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9645f4d-209b-484b-923b-b810b1ba9610 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:09.853195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3578a0f-0883-4faf-b1f5-16ac3edb275c tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39f1d508b6c4ab99d6ac30d1b1fe6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27854390b5cd46b6a060b98ab3ef8dbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:09.853792 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3578a0f-0883-4faf-b1f5-16ac3edb275c tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:09.854235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3578a0f-0883-4faf-b1f5-16ac3edb275c tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:09.854511 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3578a0f-0883-4faf-b1f5-16ac3edb275c tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:09.855170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3578a0f-0883-4faf-b1f5-16ac3edb275c tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:09.857457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3578a0f-0883-4faf-b1f5-16ac3edb275c tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:09.953491 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1392/2749] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:09 2022] POST /identity/v3/projects => generated 353 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:09.957518 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc638-daa9-47bb-9970-df8d5b4113d3 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:09.968807 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc638-daa9-47bb-9970-df8d5b4113d3 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:10.033787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b520a7-bccc-4b9f-a1e5-b3796c594b9b tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39f1d508b6c4ab99d6ac30d1b1fe6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27854390b5cd46b6a060b98ab3ef8dbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:10.034410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b520a7-bccc-4b9f-a1e5-b3796c594b9b tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:10.034749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b520a7-bccc-4b9f-a1e5-b3796c594b9b tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:10.034994 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b520a7-bccc-4b9f-a1e5-b3796c594b9b tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:10.035648 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b520a7-bccc-4b9f-a1e5-b3796c594b9b tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:10.035950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b520a7-bccc-4b9f-a1e5-b3796c594b9b tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:10.037711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b520a7-bccc-4b9f-a1e5-b3796c594b9b tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:10.050982 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1358/2750] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:28:10.146923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3578a0f-0883-4faf-b1f5-16ac3edb275c tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:10.160352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3578a0f-0883-4faf-b1f5-16ac3edb275c tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:10.165215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39f1d508b6c4ab99d6ac30d1b1fe6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27854390b5cd46b6a060b98ab3ef8dbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:10.165868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:10.166254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:10.166694 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] PATH_INFO: `/v3/projects/92c1a798cae4410b9e9fcdfe78c5ff39` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:10.167850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: Authorizing `identity:delete_project(project_id=92c1a798cae4410b9e9fcdfe78c5ff39)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:10.169848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:10.294797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c1a798cae4410b9e9fcdfe78c5ff39', 'request_id': 'req-60a7dd3f-c344-4e01-822f-f0ea5b24a789'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:10.300950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c1a798cae4410b9e9fcdfe78c5ff39', 'request_id': 'req-60a7dd3f-c344-4e01-822f-f0ea5b24a789'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:10.307469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c1a798cae4410b9e9fcdfe78c5ff39', 'request_id': 'req-60a7dd3f-c344-4e01-822f-f0ea5b24a789'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:10.379671 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] The token cache is being invalidate because project 92c1a798cae4410b9e9fcdfe78c5ff39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:10.380084 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:10.380744 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-60a7dd3f-c344-4e01-822f-f0ea5b24a789 tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:10.382247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1393/2751] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:10 2022] DELETE /identity/v3/projects/92c1a798cae4410b9e9fcdfe78c5ff39 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:11.102758 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b520a7-bccc-4b9f-a1e5-b3796c594b9b tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:11.104607 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-75b520a7-bccc-4b9f-a1e5-b3796c594b9b tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:11.178954 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b520a7-bccc-4b9f-a1e5-b3796c594b9b tempest-VolumeQuotaClassesTest-1490385440 tempest-VolumeQuotaClassesTest-1490385440-project-admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:11.237332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:11.237885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:11.238165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:11.238441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] PATH_INFO: `/v3/users/f69285624a164daba0f4fb921f683561` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:11.239622 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69285624a164daba0f4fb921f683561)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:11.241566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:11.312014 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:11.411136 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69285624a164daba0f4fb921f683561'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:11.411910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69285624a164daba0f4fb921f683561'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:11.459383 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69285624a164daba0f4fb921f683561'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:11.460024 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69285624a164daba0f4fb921f683561'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:11.468090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69285624a164daba0f4fb921f683561'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:11.486811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1359/2752] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:11 2022] DELETE /identity/v3/users/f69285624a164daba0f4fb921f683561 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:11.491423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216028d-49ea-4417-8780-dfea45b5d042 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:11.492067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216028d-49ea-4417-8780-dfea45b5d042 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:11.492067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216028d-49ea-4417-8780-dfea45b5d042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:11.511884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b216028d-49ea-4417-8780-dfea45b5d042 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:11.513119 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b216028d-49ea-4417-8780-dfea45b5d042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:11.562425 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:11.564032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:11.581716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1394/2753] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:11.594182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216028d-49ea-4417-8780-dfea45b5d042 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:11.595981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b216028d-49ea-4417-8780-dfea45b5d042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:11.638576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6edc27-0b47-48d3-8ae7-0084fd3a6d07 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:11.643896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:11.644632 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:11.645037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:11.645460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] PATH_INFO: `/v3/users/c5cd8d21d26a4505816bfdf6af415283` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:11.646865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5cd8d21d26a4505816bfdf6af415283)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:11.648906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:11.658470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216028d-49ea-4417-8780-dfea45b5d042 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:11.662251 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f358ee7-e8c1-47b0-ae93-d3f18684b3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:11.662896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358ee7-e8c1-47b0-ae93-d3f18684b3cd service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:11.663174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358ee7-e8c1-47b0-ae93-d3f18684b3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:11.663437 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358ee7-e8c1-47b0-ae93-d3f18684b3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:11.675206 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f358ee7-e8c1-47b0-ae93-d3f18684b3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:11.676693 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f358ee7-e8c1-47b0-ae93-d3f18684b3cd service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:11.687739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1395/2754] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:28:11.868597 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5cd8d21d26a4505816bfdf6af415283'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:11.869257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5cd8d21d26a4505816bfdf6af415283'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:11.922813 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5cd8d21d26a4505816bfdf6af415283'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:11.923523 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5cd8d21d26a4505816bfdf6af415283'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:11.931233 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5cd8d21d26a4505816bfdf6af415283'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:11.949142 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1360/2755] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:11 2022] DELETE /identity/v3/users/c5cd8d21d26a4505816bfdf6af415283 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:11.954115 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035b96-17cb-4e57-90f8-ebbb9fb7c4d0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:11.954423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035b96-17cb-4e57-90f8-ebbb9fb7c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:11.954758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035b96-17cb-4e57-90f8-ebbb9fb7c4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:11.969208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:11.975750 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-43035b96-17cb-4e57-90f8-ebbb9fb7c4d0 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:11.977059 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-43035b96-17cb-4e57-90f8-ebbb9fb7c4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:12.038852 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1396/2756] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:12.048669 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:12.050101 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:12.075682 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:12.105943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43035b96-17cb-4e57-90f8-ebbb9fb7c4d0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:12.106834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a9919-023a-468d-89e0-8d59223a88b9 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:12.107371 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-43035b96-17cb-4e57-90f8-ebbb9fb7c4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:12.111946 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dea53-7a92-41d1-90fc-42f62e98644d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:12.113185 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dea53-7a92-41d1-90fc-42f62e98644d service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:12.113451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dea53-7a92-41d1-90fc-42f62e98644d service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:12.113922 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dea53-7a92-41d1-90fc-42f62e98644d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:12.126451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43035b96-17cb-4e57-90f8-ebbb9fb7c4d0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:12.131677 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:12.137061 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:12.137061 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:12.137061 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] PATH_INFO: `/v3/projects/61d5712c20b14c3e9ba88382ee3ddfdb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:12.137868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dea53-7a92-41d1-90fc-42f62e98644d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:12.137868 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dea53-7a92-41d1-90fc-42f62e98644d service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:12.138449 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d5712c20b14c3e9ba88382ee3ddfdb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:12.139895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:12.149083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1361/2757] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:12.293567 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d5712c20b14c3e9ba88382ee3ddfdb', 'request_id': 'req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.299720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d5712c20b14c3e9ba88382ee3ddfdb', 'request_id': 'req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.305854 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d5712c20b14c3e9ba88382ee3ddfdb', 'request_id': 'req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.420057 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] The token cache is being invalidate because project 61d5712c20b14c3e9ba88382ee3ddfdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:12.421268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.423112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.426292 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1397/2758] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:12 2022] DELETE /identity/v3/projects/61d5712c20b14c3e9ba88382ee3ddfdb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:12.429051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dea53-7a92-41d1-90fc-42f62e98644d service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:12.439308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dea53-7a92-41d1-90fc-42f62e98644d service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:12.500770 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:12.501397 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:12.501676 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:12.501948 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] PATH_INFO: `/v3/users/f39f1d508b6c4ab99d6ac30d1b1fe6eb` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:12.503103 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39f1d508b6c4ab99d6ac30d1b1fe6eb)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:12.505071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:12.557861 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:12.559335 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:12.575509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280eabb-1e20-4dbc-99c8-92f94a0f1b28 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:12.582095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:12.582769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:12.583055 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:12.583354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] PATH_INFO: `/v3/projects/da236c14d77b450aa86062a366b62ae4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:12.584483 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da236c14d77b450aa86062a366b62ae4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:12.586400 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:12.684798 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39f1d508b6c4ab99d6ac30d1b1fe6eb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.686393 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39f1d508b6c4ab99d6ac30d1b1fe6eb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.700267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da236c14d77b450aa86062a366b62ae4', 'request_id': 'req-3e41e892-8509-42c7-b304-feda8eef7193'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.706317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da236c14d77b450aa86062a366b62ae4', 'request_id': 'req-3e41e892-8509-42c7-b304-feda8eef7193'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.712469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da236c14d77b450aa86062a366b62ae4', 'request_id': 'req-3e41e892-8509-42c7-b304-feda8eef7193'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.750552 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39f1d508b6c4ab99d6ac30d1b1fe6eb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.751367 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39f1d508b6c4ab99d6ac30d1b1fe6eb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.759021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39f1d508b6c4ab99d6ac30d1b1fe6eb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.777708 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1362/2759] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:12 2022] DELETE /identity/v3/users/f39f1d508b6c4ab99d6ac30d1b1fe6eb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:12.802122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] The token cache is being invalidate because project da236c14d77b450aa86062a366b62ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:12.802351 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.803020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:12.804712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1398/2760] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:12 2022] DELETE /identity/v3/projects/da236c14d77b450aa86062a366b62ae4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:12.808733 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:12.810235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:12.867335 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:12.886328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242fdc-f685-4027-affe-4159581a029e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:12.891890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a2f0d-7c3b-47af-8116-956a72d79d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:12.892509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a2f0d-7c3b-47af-8116-956a72d79d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:12.892781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a2f0d-7c3b-47af-8116-956a72d79d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:12.893046 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a2f0d-7c3b-47af-8116-956a72d79d59 admin admin] PATH_INFO: `/v3/users/a79c23d447214a3d85bea0f29cb439f0` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:12.894175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a2f0d-7c3b-47af-8116-956a72d79d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79c23d447214a3d85bea0f29cb439f0)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:12.896175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a2f0d-7c3b-47af-8116-956a72d79d59 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:13.083929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-903a2f0d-7c3b-47af-8116-956a72d79d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79c23d447214a3d85bea0f29cb439f0'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.084624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-903a2f0d-7c3b-47af-8116-956a72d79d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79c23d447214a3d85bea0f29cb439f0'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.184851 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-903a2f0d-7c3b-47af-8116-956a72d79d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79c23d447214a3d85bea0f29cb439f0'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.185529 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-903a2f0d-7c3b-47af-8116-956a72d79d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79c23d447214a3d85bea0f29cb439f0'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.196515 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-903a2f0d-7c3b-47af-8116-956a72d79d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79c23d447214a3d85bea0f29cb439f0'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.217864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1363/2761] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:12 2022] DELETE /identity/v3/users/a79c23d447214a3d85bea0f29cb439f0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:13.221659 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:13.223313 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:13.243133 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:13.299874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41e892-8509-42c7-b304-feda8eef7193 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:13.358717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:13.359431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:13.359757 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:13.360096 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] PATH_INFO: `/v3/projects/27854390b5cd46b6a060b98ab3ef8dbd` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:13.361265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27854390b5cd46b6a060b98ab3ef8dbd)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:13.363386 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:13.480223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27854390b5cd46b6a060b98ab3ef8dbd', 'request_id': 'req-879572a5-2a8b-4712-82a0-3edaa5a523e0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.490778 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27854390b5cd46b6a060b98ab3ef8dbd', 'request_id': 'req-879572a5-2a8b-4712-82a0-3edaa5a523e0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.497442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27854390b5cd46b6a060b98ab3ef8dbd', 'request_id': 'req-879572a5-2a8b-4712-82a0-3edaa5a523e0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.557454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] The token cache is being invalidate because project 27854390b5cd46b6a060b98ab3ef8dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:13.557755 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.558451 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-879572a5-2a8b-4712-82a0-3edaa5a523e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.559996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1399/2762] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:13 2022] DELETE /identity/v3/projects/27854390b5cd46b6a060b98ab3ef8dbd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:13.565828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f72dea-d5eb-47b3-a4eb-3aee068a83e4 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:13.566344 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f72dea-d5eb-47b3-a4eb-3aee068a83e4 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:13.566718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f72dea-d5eb-47b3-a4eb-3aee068a83e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:13.587313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-00f72dea-d5eb-47b3-a4eb-3aee068a83e4 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:13.588514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-00f72dea-d5eb-47b3-a4eb-3aee068a83e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:13.648643 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1364/2763] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:13.657272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf928-6292-418c-9fd1-e6a4be22bc49 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:13.657554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf928-6292-418c-9fd1-e6a4be22bc49 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:13.657827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf928-6292-418c-9fd1-e6a4be22bc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:13.677925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f32cf928-6292-418c-9fd1-e6a4be22bc49 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:13.679235 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f32cf928-6292-418c-9fd1-e6a4be22bc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:13.689992 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f72dea-d5eb-47b3-a4eb-3aee068a83e4 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:13.691589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-00f72dea-d5eb-47b3-a4eb-3aee068a83e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:13.693651 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1400/2764] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:13.700223 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cf928-6292-418c-9fd1-e6a4be22bc49 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:13.704603 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f72dea-d5eb-47b3-a4eb-3aee068a83e4 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:13.711328 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:13.711854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:13.712198 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:13.712394 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] PATH_INFO: `/v3/projects/d980a95ccc24429995a6fe58508b7d48` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:13.712501 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cf928-6292-418c-9fd1-e6a4be22bc49 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:13.713532 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d980a95ccc24429995a6fe58508b7d48)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:13.715870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:13.717848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508abfa-dcbd-4160-bfda-ee3c8bf4d66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:13.718876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508abfa-dcbd-4160-bfda-ee3c8bf4d66c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:13.719152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508abfa-dcbd-4160-bfda-ee3c8bf4d66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:13.719421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508abfa-dcbd-4160-bfda-ee3c8bf4d66c admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:13.720067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508abfa-dcbd-4160-bfda-ee3c8bf4d66c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:13.720499 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508abfa-dcbd-4160-bfda-ee3c8bf4d66c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:13.721934 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508abfa-dcbd-4160-bfda-ee3c8bf4d66c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:13.735957 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1401/2765] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:28:13.740522 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508abfa-dcbd-4160-bfda-ee3c8bf4d66c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:13.750848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508abfa-dcbd-4160-bfda-ee3c8bf4d66c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:13.755412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e7255-8c5b-4975-ad1d-b4c6d32185bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:13.756168 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e7255-8c5b-4975-ad1d-b4c6d32185bb admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:13.756284 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e7255-8c5b-4975-ad1d-b4c6d32185bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:13.756506 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e7255-8c5b-4975-ad1d-b4c6d32185bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:13.757118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e7255-8c5b-4975-ad1d-b4c6d32185bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:13.759033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e7255-8c5b-4975-ad1d-b4c6d32185bb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:13.814834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd980a95ccc24429995a6fe58508b7d48', 'request_id': 'req-7e925993-e243-4a70-83ce-bcc5fbe6866b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.822334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd980a95ccc24429995a6fe58508b7d48', 'request_id': 'req-7e925993-e243-4a70-83ce-bcc5fbe6866b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.823556 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:13.830075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd980a95ccc24429995a6fe58508b7d48', 'request_id': 'req-7e925993-e243-4a70-83ce-bcc5fbe6866b'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.847197 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1402/2766] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:13 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:13.848579 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e7255-8c5b-4975-ad1d-b4c6d32185bb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:13.859609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:13.914388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e7255-8c5b-4975-ad1d-b4c6d32185bb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:13.919582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106f7dd-5809-4967-a430-97c83151c0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:13.920267 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106f7dd-5809-4967-a430-97c83151c0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:13.920547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106f7dd-5809-4967-a430-97c83151c0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:13.920821 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106f7dd-5809-4967-a430-97c83151c0d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:13.921457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106f7dd-5809-4967-a430-97c83151c0d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:13.923716 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106f7dd-5809-4967-a430-97c83151c0d3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:13.934287 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] The token cache is being invalidate because project d980a95ccc24429995a6fe58508b7d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:13.934654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.935331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-7e925993-e243-4a70-83ce-bcc5fbe6866b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:13.937730 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1365/2767] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:13 2022] DELETE /identity/v3/projects/d980a95ccc24429995a6fe58508b7d48 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:13.942144 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb296-488f-4a79-98a2-5c2e1a5d4228 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:13.942439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb296-488f-4a79-98a2-5c2e1a5d4228 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:13.942712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb296-488f-4a79-98a2-5c2e1a5d4228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:13.962494 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-959bb296-488f-4a79-98a2-5c2e1a5d4228 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:13.963712 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-959bb296-488f-4a79-98a2-5c2e1a5d4228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:13.971526 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1366/2768] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:13.979069 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb1e41-b297-4d4b-82a9-5334ce194c2d None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:13.979347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb1e41-b297-4d4b-82a9-5334ce194c2d None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:13.979631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb1e41-b297-4d4b-82a9-5334ce194c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:13.998810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-dddb1e41-b297-4d4b-82a9-5334ce194c2d None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:13.999991 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-dddb1e41-b297-4d4b-82a9-5334ce194c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:14.007921 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1367/2769] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:14.011767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb1e41-b297-4d4b-82a9-5334ce194c2d None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.021055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb1e41-b297-4d4b-82a9-5334ce194c2d None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.025517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece175e6-26fb-4fe5-aa87-0ded201395bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.026071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece175e6-26fb-4fe5-aa87-0ded201395bf admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.026345 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece175e6-26fb-4fe5-aa87-0ded201395bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.026613 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece175e6-26fb-4fe5-aa87-0ded201395bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.027290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece175e6-26fb-4fe5-aa87-0ded201395bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:14.027576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece175e6-26fb-4fe5-aa87-0ded201395bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.029129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece175e6-26fb-4fe5-aa87-0ded201395bf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.040204 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1368/2770] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:28:14.042339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1403/2771] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:13 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:14.044350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece175e6-26fb-4fe5-aa87-0ded201395bf admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.046531 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106f7dd-5809-4967-a430-97c83151c0d3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.048406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e106f7dd-5809-4967-a430-97c83151c0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:14.054637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece175e6-26fb-4fe5-aa87-0ded201395bf admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.059248 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9c215-41ef-4ad7-a560-e3998b9b1816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.062044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9c215-41ef-4ad7-a560-e3998b9b1816 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.062044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9c215-41ef-4ad7-a560-e3998b9b1816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.062044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9c215-41ef-4ad7-a560-e3998b9b1816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.062300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106f7dd-5809-4967-a430-97c83151c0d3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.062396 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9c215-41ef-4ad7-a560-e3998b9b1816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.063420 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9c215-41ef-4ad7-a560-e3998b9b1816 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.065931 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654f740-ad75-42fa-9a4f-149e65a9e222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.066521 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654f740-ad75-42fa-9a4f-149e65a9e222 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.066844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654f740-ad75-42fa-9a4f-149e65a9e222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.067116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654f740-ad75-42fa-9a4f-149e65a9e222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.067755 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654f740-ad75-42fa-9a4f-149e65a9e222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.069455 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654f740-ad75-42fa-9a4f-149e65a9e222 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.083943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1404/2772] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:28:14.085020 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654f740-ad75-42fa-9a4f-149e65a9e222 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.098366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654f740-ad75-42fa-9a4f-149e65a9e222 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.103847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51706-08dd-4d6d-905e-1bcf24ba7c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.104748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51706-08dd-4d6d-905e-1bcf24ba7c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.105161 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51706-08dd-4d6d-905e-1bcf24ba7c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.105436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51706-08dd-4d6d-905e-1bcf24ba7c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.106072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e51706-08dd-4d6d-905e-1bcf24ba7c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.108331 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e51706-08dd-4d6d-905e-1bcf24ba7c24 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.119533 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1405/2773] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:14.123595 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51706-08dd-4d6d-905e-1bcf24ba7c24 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.133613 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51706-08dd-4d6d-905e-1bcf24ba7c24 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.140075 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f044461-0c87-4d09-a8f6-624ed11a8a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.140737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f044461-0c87-4d09-a8f6-624ed11a8a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.141013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f044461-0c87-4d09-a8f6-624ed11a8a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.141296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f044461-0c87-4d09-a8f6-624ed11a8a2c admin admin] PATH_INFO: `/v3/projects/c7bde478f54b4c738e7951e3311a5e5e/users/3531da52e78c4335b3bd8c302b9ff106/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.142044 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1369/2774] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:14 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:14.145827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9c215-41ef-4ad7-a560-e3998b9b1816 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.147568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-66b9c215-41ef-4ad7-a560-e3998b9b1816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:14.158187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f044461-0c87-4d09-a8f6-624ed11a8a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7bde478f54b4c738e7951e3311a5e5e, user_id=3531da52e78c4335b3bd8c302b9ff106, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.161112 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f044461-0c87-4d09-a8f6-624ed11a8a2c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.221257 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9c215-41ef-4ad7-a560-e3998b9b1816 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.227159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ee2cd-b392-4f27-9e6e-3c419bf507ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.227870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ee2cd-b392-4f27-9e6e-3c419bf507ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.228285 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ee2cd-b392-4f27-9e6e-3c419bf507ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.228662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ee2cd-b392-4f27-9e6e-3c419bf507ec admin admin] PATH_INFO: `/v3/users/5403ca9aa07c440b922eaf135cd3d44c` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.232535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ee2cd-b392-4f27-9e6e-3c419bf507ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=5403ca9aa07c440b922eaf135cd3d44c)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.236087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ee2cd-b392-4f27-9e6e-3c419bf507ec admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.237585 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1406/2775] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:14 2022] PUT /identity/v3/projects/c7bde478f54b4c738e7951e3311a5e5e/users/3531da52e78c4335b3bd8c302b9ff106/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:14.238723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f044461-0c87-4d09-a8f6-624ed11a8a2c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.309765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f044461-0c87-4d09-a8f6-624ed11a8a2c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.318260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a494f-2582-4ecb-9047-315b0750b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.318899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a494f-2582-4ecb-9047-315b0750b75b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.319169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a494f-2582-4ecb-9047-315b0750b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.319432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a494f-2582-4ecb-9047-315b0750b75b admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.320052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a494f-2582-4ecb-9047-315b0750b75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.321970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a494f-2582-4ecb-9047-315b0750b75b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.425615 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5c1ee2cd-b392-4f27-9e6e-3c419bf507ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5403ca9aa07c440b922eaf135cd3d44c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:14.425969 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1407/2776] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:14 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:14.426612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5c1ee2cd-b392-4f27-9e6e-3c419bf507ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5403ca9aa07c440b922eaf135cd3d44c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:14.427383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1487e83-d5a8-40d1-b0a9-cfb29715fade None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.427665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1487e83-d5a8-40d1-b0a9-cfb29715fade None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.427956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1487e83-d5a8-40d1-b0a9-cfb29715fade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.455779 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b1487e83-d5a8-40d1-b0a9-cfb29715fade None None] MFA Rules not processed for user `3531da52e78c4335b3bd8c302b9ff106`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:14.457019 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b1487e83-d5a8-40d1-b0a9-cfb29715fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:14.486909 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:14.499320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5c1ee2cd-b392-4f27-9e6e-3c419bf507ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5403ca9aa07c440b922eaf135cd3d44c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:14.499964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5c1ee2cd-b392-4f27-9e6e-3c419bf507ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5403ca9aa07c440b922eaf135cd3d44c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:14.507559 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5c1ee2cd-b392-4f27-9e6e-3c419bf507ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5403ca9aa07c440b922eaf135cd3d44c'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:14.523758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1408/2777] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:14.524664 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1487e83-d5a8-40d1-b0a9-cfb29715fade None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.526332 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b1487e83-d5a8-40d1-b0a9-cfb29715fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:14.526450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1370/2778] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:14 2022] DELETE /identity/v3/users/5403ca9aa07c440b922eaf135cd3d44c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:14.534549 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa779-a0a2-4190-88bb-22d55f926bad None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.534964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa779-a0a2-4190-88bb-22d55f926bad None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.535330 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caa779-a0a2-4190-88bb-22d55f926bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.543561 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1487e83-d5a8-40d1-b0a9-cfb29715fade None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.555236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-f0caa779-a0a2-4190-88bb-22d55f926bad None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:14.556431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f0caa779-a0a2-4190-88bb-22d55f926bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:14.568963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:14.602378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003dc0-f508-49aa-a756-614631a01904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.603012 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003dc0-f508-49aa-a756-614631a01904 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.603288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003dc0-f508-49aa-a756-614631a01904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.603555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003dc0-f508-49aa-a756-614631a01904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.604191 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003dc0-f508-49aa-a756-614631a01904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.605851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003dc0-f508-49aa-a756-614631a01904 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.615913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1371/2780] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:14.616089 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1409/2780] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:14.619848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003dc0-f508-49aa-a756-614631a01904 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.622913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caa779-a0a2-4190-88bb-22d55f926bad None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.622913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f0caa779-a0a2-4190-88bb-22d55f926bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:14.630356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003dc0-f508-49aa-a756-614631a01904 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.635126 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6065a5e-ce31-46b7-bbef-e07985a59079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.635717 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6065a5e-ce31-46b7-bbef-e07985a59079 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.635990 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6065a5e-ce31-46b7-bbef-e07985a59079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.636256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6065a5e-ce31-46b7-bbef-e07985a59079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.636885 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6065a5e-ce31-46b7-bbef-e07985a59079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.638480 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6065a5e-ce31-46b7-bbef-e07985a59079 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.652318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1410/2781] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:28:14.652318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6065a5e-ce31-46b7-bbef-e07985a59079 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.652318 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a6065a5e-ce31-46b7-bbef-e07985a59079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:14.680952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caa779-a0a2-4190-88bb-22d55f926bad None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.684604 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc2604-b358-47f2-b878-4c63269f8115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.685211 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc2604-b358-47f2-b878-4c63269f8115 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.691777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc2604-b358-47f2-b878-4c63269f8115 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.691777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc2604-b358-47f2-b878-4c63269f8115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.709442 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6065a5e-ce31-46b7-bbef-e07985a59079 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.713181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be232427-b84b-4978-a850-7bba89c76735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.713778 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be232427-b84b-4978-a850-7bba89c76735 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.714072 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be232427-b84b-4978-a850-7bba89c76735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.714329 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be232427-b84b-4978-a850-7bba89c76735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.724188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be232427-b84b-4978-a850-7bba89c76735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.725627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be232427-b84b-4978-a850-7bba89c76735 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.735416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1411/2782] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:14.737098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be232427-b84b-4978-a850-7bba89c76735 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.742960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc2604-b358-47f2-b878-4c63269f8115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.744521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc2604-b358-47f2-b878-4c63269f8115 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.745228 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be232427-b84b-4978-a850-7bba89c76735 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.750589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1634fb-d648-4419-b862-b790946b3b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.751295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1634fb-d648-4419-b862-b790946b3b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.751520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1634fb-d648-4419-b862-b790946b3b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.751790 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1634fb-d648-4419-b862-b790946b3b93 admin admin] PATH_INFO: `/v3/projects/6abc85b245aa44a58e27e8040733ad40/users/bec589d238f244c399b277a473983975/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.754872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1372/2783] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:14.769626 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1634fb-d648-4419-b862-b790946b3b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6abc85b245aa44a58e27e8040733ad40, user_id=bec589d238f244c399b277a473983975, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.772573 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1634fb-d648-4419-b862-b790946b3b93 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.779050 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc2604-b358-47f2-b878-4c63269f8115 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:14.780555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a0cc2604-b358-47f2-b878-4c63269f8115 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:14.794501 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc2604-b358-47f2-b878-4c63269f8115 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:14.799611 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855c1b8-78f8-42de-9b28-6fe400e50ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:14.800469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855c1b8-78f8-42de-9b28-6fe400e50ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.806123 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855c1b8-78f8-42de-9b28-6fe400e50ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.806123 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855c1b8-78f8-42de-9b28-6fe400e50ee0 admin admin] PATH_INFO: `/v3/users/3531da52e78c4335b3bd8c302b9ff106` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.806123 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855c1b8-78f8-42de-9b28-6fe400e50ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3531da52e78c4335b3bd8c302b9ff106)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:14.806123 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855c1b8-78f8-42de-9b28-6fe400e50ee0 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:14.916426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1412/2784] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:14 2022] PUT /identity/v3/projects/6abc85b245aa44a58e27e8040733ad40/users/bec589d238f244c399b277a473983975/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:14.928542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cfd8-4469-43d4-a812-00c1fa971028 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:14.928840 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cfd8-4469-43d4-a812-00c1fa971028 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:14.929140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cfd8-4469-43d4-a812-00c1fa971028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:14.957723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5dd9cfd8-4469-43d4-a812-00c1fa971028 None None] MFA Rules not processed for user `bec589d238f244c399b277a473983975`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:14.959090 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5dd9cfd8-4469-43d4-a812-00c1fa971028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:14.984772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:15.036737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1413/2785] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:15.041570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9cfd8-4469-43d4-a812-00c1fa971028 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:15.054454 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9855c1b8-78f8-42de-9b28-6fe400e50ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3531da52e78c4335b3bd8c302b9ff106'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:15.055157 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9855c1b8-78f8-42de-9b28-6fe400e50ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3531da52e78c4335b3bd8c302b9ff106'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:15.099689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9855c1b8-78f8-42de-9b28-6fe400e50ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3531da52e78c4335b3bd8c302b9ff106'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:15.100751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9855c1b8-78f8-42de-9b28-6fe400e50ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3531da52e78c4335b3bd8c302b9ff106'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:15.113228 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9855c1b8-78f8-42de-9b28-6fe400e50ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3531da52e78c4335b3bd8c302b9ff106'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:15.117446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9cfd8-4469-43d4-a812-00c1fa971028 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:15.119658 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:15.125849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c4b97-32b7-437a-8777-3103b76e08a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:15.126575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c4b97-32b7-437a-8777-3103b76e08a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:15.126810 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c4b97-32b7-437a-8777-3103b76e08a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:15.127109 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c4b97-32b7-437a-8777-3103b76e08a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:15.127740 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c4b97-32b7-437a-8777-3103b76e08a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:15.129653 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c4b97-32b7-437a-8777-3103b76e08a8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:15.133439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1373/2786] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:14 2022] DELETE /identity/v3/users/3531da52e78c4335b3bd8c302b9ff106 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:15.138156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4a41-cd2c-4593-8645-4b4a49173ce4 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:15.138548 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4a41-cd2c-4593-8645-4b4a49173ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:15.139452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4a41-cd2c-4593-8645-4b4a49173ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:15.160298 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0fad4a41-cd2c-4593-8645-4b4a49173ce4 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:15.161527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0fad4a41-cd2c-4593-8645-4b4a49173ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:15.223225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1374/2787] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:15.237217 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad4a41-cd2c-4593-8645-4b4a49173ce4 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:15.238810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0fad4a41-cd2c-4593-8645-4b4a49173ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:15.251649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad4a41-cd2c-4593-8645-4b4a49173ce4 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:15.259133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:15.259133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:15.259133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:15.259133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] PATH_INFO: `/v3/projects/8cc79392e9c94a82bd614e06fe948bb8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:15.259497 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc79392e9c94a82bd614e06fe948bb8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:15.261064 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:15.291896 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1414/2788] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:15 2022] POST /identity/v3/projects => generated 387 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:15.293118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c4b97-32b7-437a-8777-3103b76e08a8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:15.297855 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-348c4b97-32b7-437a-8777-3103b76e08a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:15.366990 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc79392e9c94a82bd614e06fe948bb8', 'request_id': 'req-fb596402-30fc-4e94-8f45-03249ef60aef'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:15.369578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c4b97-32b7-437a-8777-3103b76e08a8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:15.374080 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc79392e9c94a82bd614e06fe948bb8', 'request_id': 'req-fb596402-30fc-4e94-8f45-03249ef60aef'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:15.381250 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc79392e9c94a82bd614e06fe948bb8', 'request_id': 'req-fb596402-30fc-4e94-8f45-03249ef60aef'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:15.419471 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717b5f-2915-450d-8a11-9514b1a55bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:15.420733 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717b5f-2915-450d-8a11-9514b1a55bcc service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:15.421035 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717b5f-2915-450d-8a11-9514b1a55bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:15.421363 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717b5f-2915-450d-8a11-9514b1a55bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:15.442017 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:15.442240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] The token cache is being invalidate because project 8cc79392e9c94a82bd614e06fe948bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:15.442541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:15.443232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:15.444767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1375/2789] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:15 2022] DELETE /identity/v3/projects/8cc79392e9c94a82bd614e06fe948bb8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:15.445649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:15.446973 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:15.499781 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717b5f-2915-450d-8a11-9514b1a55bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:15.501871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717b5f-2915-450d-8a11-9514b1a55bcc service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:15.526644 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1415/2790] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:15.534998 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb596402-30fc-4e94-8f45-03249ef60aef admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:15.540721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d739d-b4e4-44b3-a256-5d1f4d6d598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:15.541514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d739d-b4e4-44b3-a256-5d1f4d6d598d admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:15.541796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d739d-b4e4-44b3-a256-5d1f4d6d598d admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:15.542066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d739d-b4e4-44b3-a256-5d1f4d6d598d admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:15.542749 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d739d-b4e4-44b3-a256-5d1f4d6d598d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:15.544740 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d739d-b4e4-44b3-a256-5d1f4d6d598d admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:15.667460 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:15.674784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1376/2791] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:15 2022] POST /identity/v3/users => generated 300 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:15.678847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717b5f-2915-450d-8a11-9514b1a55bcc service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:15.682709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e0717b5f-2915-450d-8a11-9514b1a55bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:15.695294 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717b5f-2915-450d-8a11-9514b1a55bcc service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:15.700422 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3656c-6309-4374-b6cb-6c7876f09b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:15.701180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3656c-6309-4374-b6cb-6c7876f09b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:15.702177 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3656c-6309-4374-b6cb-6c7876f09b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:15.702577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3656c-6309-4374-b6cb-6c7876f09b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:15.703539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3656c-6309-4374-b6cb-6c7876f09b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:15.705324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3656c-6309-4374-b6cb-6c7876f09b23 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:15.718714 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1416/2792] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:15.721430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d739d-b4e4-44b3-a256-5d1f4d6d598d admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:15.736986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d739d-b4e4-44b3-a256-5d1f4d6d598d admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:15.741781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a759d8-19b4-4c19-bf67-1bb3c6013b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:15.742440 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a759d8-19b4-4c19-bf67-1bb3c6013b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:15.742762 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a759d8-19b4-4c19-bf67-1bb3c6013b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:15.743089 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a759d8-19b4-4c19-bf67-1bb3c6013b90 admin admin] PATH_INFO: `/v3/projects/89c9d48033f24c068e8aefa092bc7906/users/d93e521e7c5448f4abe64c60e39e6eef/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:15.759036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a759d8-19b4-4c19-bf67-1bb3c6013b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d48033f24c068e8aefa092bc7906, user_id=d93e521e7c5448f4abe64c60e39e6eef, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:15.761624 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a759d8-19b4-4c19-bf67-1bb3c6013b90 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:15.860805 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1377/2793] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:15 2022] PUT /identity/v3/projects/89c9d48033f24c068e8aefa092bc7906/users/d93e521e7c5448f4abe64c60e39e6eef/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:15.863991 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3656c-6309-4374-b6cb-6c7876f09b23 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:15.874872 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3656c-6309-4374-b6cb-6c7876f09b23 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:15.935277 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5de57-37c3-401e-8ec8-ccdfb5c032f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:15.936555 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5de57-37c3-401e-8ec8-ccdfb5c032f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:15.936851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5de57-37c3-401e-8ec8-ccdfb5c032f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:15.937118 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5de57-37c3-401e-8ec8-ccdfb5c032f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:15.937750 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5de57-37c3-401e-8ec8-ccdfb5c032f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:15.939368 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5de57-37c3-401e-8ec8-ccdfb5c032f7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:15.949039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1417/2794] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:15.953689 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a759d8-19b4-4c19-bf67-1bb3c6013b90 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:15.964495 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a759d8-19b4-4c19-bf67-1bb3c6013b90 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:15.970043 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6e745-2229-488d-9bae-b23b04cbc1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:15.970720 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6e745-2229-488d-9bae-b23b04cbc1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:15.971000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6e745-2229-488d-9bae-b23b04cbc1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:15.971272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6e745-2229-488d-9bae-b23b04cbc1ca admin admin] PATH_INFO: `/v3/projects/89c9d48033f24c068e8aefa092bc7906/users/d93e521e7c5448f4abe64c60e39e6eef/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:15.973237 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6e745-2229-488d-9bae-b23b04cbc1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c9d48033f24c068e8aefa092bc7906, user_id=d93e521e7c5448f4abe64c60e39e6eef, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:15.975932 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6e745-2229-488d-9bae-b23b04cbc1ca admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:15.986412 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1378/2795] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:15 2022] PUT /identity/v3/projects/89c9d48033f24c068e8aefa092bc7906/users/d93e521e7c5448f4abe64c60e39e6eef/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:15.996588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89796837-0c53-4601-bd98-0a6f9cfcb511 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:15.996876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89796837-0c53-4601-bd98-0a6f9cfcb511 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:15.997156 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89796837-0c53-4601-bd98-0a6f9cfcb511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.004034 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6e745-2229-488d-9bae-b23b04cbc1ca admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:16.005916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3ad6e745-2229-488d-9bae-b23b04cbc1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:16.039019 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-89796837-0c53-4601-bd98-0a6f9cfcb511 None None] MFA Rules not processed for user `d93e521e7c5448f4abe64c60e39e6eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:16.040256 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-89796837-0c53-4601-bd98-0a6f9cfcb511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:16.076273 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6e745-2229-488d-9bae-b23b04cbc1ca admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:16.081939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:16.082270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.082545 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.082848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] PATH_INFO: `/v3/projects/c7bde478f54b4c738e7951e3311a5e5e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.084001 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7bde478f54b4c738e7951e3311a5e5e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:16.086147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:16.111390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1418/2796] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:16.123094 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89796837-0c53-4601-bd98-0a6f9cfcb511 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:16.125067 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-89796837-0c53-4601-bd98-0a6f9cfcb511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:16.155751 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:16.181908 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89796837-0c53-4601-bd98-0a6f9cfcb511 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:16.190279 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7bde478f54b4c738e7951e3311a5e5e', 'request_id': 'req-81676527-1956-4079-a865-e234bfc28222'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:16.196121 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7bde478f54b4c738e7951e3311a5e5e', 'request_id': 'req-81676527-1956-4079-a865-e234bfc28222'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:16.202996 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7bde478f54b4c738e7951e3311a5e5e', 'request_id': 'req-81676527-1956-4079-a865-e234bfc28222'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:16.231584 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dae12-747e-461d-b0fd-4432bda8b799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:16.233172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dae12-747e-461d-b0fd-4432bda8b799 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.233172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dae12-747e-461d-b0fd-4432bda8b799 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.233172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dae12-747e-461d-b0fd-4432bda8b799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.287348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] The token cache is being invalidate because project c7bde478f54b4c738e7951e3311a5e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:16.287876 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:16.288293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-81676527-1956-4079-a865-e234bfc28222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:16.289810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1379/2797] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:16 2022] DELETE /identity/v3/projects/c7bde478f54b4c738e7951e3311a5e5e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:16.293383 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dae12-747e-461d-b0fd-4432bda8b799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:16.293648 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dae12-747e-461d-b0fd-4432bda8b799 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:16.294571 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019a233-1209-4257-bfea-6e77019b36a4 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.294871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019a233-1209-4257-bfea-6e77019b36a4 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.295783 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019a233-1209-4257-bfea-6e77019b36a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.305432 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1419/2798] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:28:16.315386 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b019a233-1209-4257-bfea-6e77019b36a4 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:16.316592 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b019a233-1209-4257-bfea-6e77019b36a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:16.362819 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:16.371956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dae12-747e-461d-b0fd-4432bda8b799 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:16.379083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1380/2799] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:16.382691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dae12-747e-461d-b0fd-4432bda8b799 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:16.387600 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4d6c0-5a49-4ace-b1c5-94d1c94c3eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:16.388250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4d6c0-5a49-4ace-b1c5-94d1c94c3eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.388529 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4d6c0-5a49-4ace-b1c5-94d1c94c3eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.388820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4d6c0-5a49-4ace-b1c5-94d1c94c3eef admin admin] PATH_INFO: `/v3/users/bec589d238f244c399b277a473983975` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.390013 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4d6c0-5a49-4ace-b1c5-94d1c94c3eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec589d238f244c399b277a473983975)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:16.392257 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4d6c0-5a49-4ace-b1c5-94d1c94c3eef admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:16.392959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52683-980a-42fa-98db-81462fd66023 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.393259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52683-980a-42fa-98db-81462fd66023 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.393544 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52683-980a-42fa-98db-81462fd66023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.415444 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b9c52683-980a-42fa-98db-81462fd66023 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:16.416837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b9c52683-980a-42fa-98db-81462fd66023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:16.425855 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1381/2800] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:16.430165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52683-980a-42fa-98db-81462fd66023 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:16.439301 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52683-980a-42fa-98db-81462fd66023 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:16.443848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0c70f-be72-4c8c-adac-40bafb068fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:16.444446 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c70f-be72-4c8c-adac-40bafb068fac admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.444700 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c70f-be72-4c8c-adac-40bafb068fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.444965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c70f-be72-4c8c-adac-40bafb068fac admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.445606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0c70f-be72-4c8c-adac-40bafb068fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:16.445898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0c70f-be72-4c8c-adac-40bafb068fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:16.447640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0c70f-be72-4c8c-adac-40bafb068fac admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:16.459364 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1382/2801] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:28:16.463796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0c70f-be72-4c8c-adac-40bafb068fac admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:16.474640 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0c70f-be72-4c8c-adac-40bafb068fac admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:16.479293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcbe78-5b73-4ada-89de-04c0d2ad58f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:16.479872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcbe78-5b73-4ada-89de-04c0d2ad58f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.480150 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcbe78-5b73-4ada-89de-04c0d2ad58f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.480422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcbe78-5b73-4ada-89de-04c0d2ad58f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.481036 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcbe78-5b73-4ada-89de-04c0d2ad58f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:16.482997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcbe78-5b73-4ada-89de-04c0d2ad58f1 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:16.562934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1383/2802] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:16 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:16.566947 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcbe78-5b73-4ada-89de-04c0d2ad58f1 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:16.599926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2fa4d6c0-5a49-4ace-b1c5-94d1c94c3eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec589d238f244c399b277a473983975'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:16.600658 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2fa4d6c0-5a49-4ace-b1c5-94d1c94c3eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec589d238f244c399b277a473983975'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:16.629147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcbe78-5b73-4ada-89de-04c0d2ad58f1 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:16.634048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446569a1-d4f1-4304-8825-027ae2a11f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:16.634750 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446569a1-d4f1-4304-8825-027ae2a11f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.635025 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446569a1-d4f1-4304-8825-027ae2a11f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.635290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446569a1-d4f1-4304-8825-027ae2a11f9f admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.635904 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446569a1-d4f1-4304-8825-027ae2a11f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:16.637849 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446569a1-d4f1-4304-8825-027ae2a11f9f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:16.670546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2fa4d6c0-5a49-4ace-b1c5-94d1c94c3eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec589d238f244c399b277a473983975'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:16.671261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2fa4d6c0-5a49-4ace-b1c5-94d1c94c3eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec589d238f244c399b277a473983975'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:16.678998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2fa4d6c0-5a49-4ace-b1c5-94d1c94c3eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec589d238f244c399b277a473983975'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:16.696875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1420/2803] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:16 2022] DELETE /identity/v3/users/bec589d238f244c399b277a473983975 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:16.701391 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76523910-cc30-495e-b87b-78a5e817cd08 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.701695 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76523910-cc30-495e-b87b-78a5e817cd08 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.701962 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76523910-cc30-495e-b87b-78a5e817cd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.709712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:16.720436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-76523910-cc30-495e-b87b-78a5e817cd08 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:16.721647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-76523910-cc30-495e-b87b-78a5e817cd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:16.721889 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1384/2804] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:16 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:16.727166 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446569a1-d4f1-4304-8825-027ae2a11f9f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:16.728800 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-446569a1-d4f1-4304-8825-027ae2a11f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:16.741127 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446569a1-d4f1-4304-8825-027ae2a11f9f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:16.781243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1421/2805] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:16.791066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76523910-cc30-495e-b87b-78a5e817cd08 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:16.792434 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-76523910-cc30-495e-b87b-78a5e817cd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:16.798244 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010f3f-9436-4711-9848-564a47e2d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:16.798890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010f3f-9436-4711-9848-564a47e2d57f admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.799165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010f3f-9436-4711-9848-564a47e2d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.799451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010f3f-9436-4711-9848-564a47e2d57f admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.800071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1010f3f-9436-4711-9848-564a47e2d57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:16.801715 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1010f3f-9436-4711-9848-564a47e2d57f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:16.815173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1385/2806] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:28:16.816138 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010f3f-9436-4711-9848-564a47e2d57f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:16.826377 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010f3f-9436-4711-9848-564a47e2d57f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:16.831102 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e459-60d1-4da3-b4f0-67ade02ce1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:16.831693 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e459-60d1-4da3-b4f0-67ade02ce1bf admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.831971 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e459-60d1-4da3-b4f0-67ade02ce1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.832243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e459-60d1-4da3-b4f0-67ade02ce1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.832879 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871e459-60d1-4da3-b4f0-67ade02ce1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:16.834604 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871e459-60d1-4da3-b4f0-67ade02ce1bf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:16.844964 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1386/2807] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:28:16.849492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e459-60d1-4da3-b4f0-67ade02ce1bf admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:16.859772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76523910-cc30-495e-b87b-78a5e817cd08 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:16.860447 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e459-60d1-4da3-b4f0-67ade02ce1bf admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:16.863682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cfd30-73e7-4c5b-bfb4-ad07da75da0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:16.864289 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cfd30-73e7-4c5b-bfb4-ad07da75da0b service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.864599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cfd30-73e7-4c5b-bfb4-ad07da75da0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.864837 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cfd30-73e7-4c5b-bfb4-ad07da75da0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.865896 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e6614-3f9e-426c-86fd-81c3f799304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:16.866867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6614-3f9e-426c-86fd-81c3f799304c admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.867259 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6614-3f9e-426c-86fd-81c3f799304c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.867558 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e6614-3f9e-426c-86fd-81c3f799304c admin admin] PATH_INFO: `/v3/projects/bf4818036f9a4473a6939163ea615b83/users/b65f77476b144e3b97f7d33967b906ad/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:16.874324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cfd30-73e7-4c5b-bfb4-ad07da75da0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:16.875794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cfd30-73e7-4c5b-bfb4-ad07da75da0b service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:16.884605 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e6614-3f9e-426c-86fd-81c3f799304c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4818036f9a4473a6939163ea615b83, user_id=b65f77476b144e3b97f7d33967b906ad, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:16.885808 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1422/2808] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:28:16.887677 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e6614-3f9e-426c-86fd-81c3f799304c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:16.957300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:16.971631 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1387/2809] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:16 2022] PUT /identity/v3/projects/bf4818036f9a4473a6939163ea615b83/users/b65f77476b144e3b97f7d33967b906ad/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:16.973128 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c9e1-13ed-4012-9e09-4daf22b68d11 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:16.973417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c9e1-13ed-4012-9e09-4daf22b68d11 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:16.973696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c9e1-13ed-4012-9e09-4daf22b68d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:17.003728 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bf00c9e1-13ed-4012-9e09-4daf22b68d11 None None] MFA Rules not processed for user `b65f77476b144e3b97f7d33967b906ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:17.005008 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bf00c9e1-13ed-4012-9e09-4daf22b68d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:17.084217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1423/2810] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:17.088684 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e6614-3f9e-426c-86fd-81c3f799304c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:17.162576 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e6614-3f9e-426c-86fd-81c3f799304c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:17.167476 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ffe7a-9387-4377-9541-c2379b173809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:17.168243 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ffe7a-9387-4377-9541-c2379b173809 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:17.168522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ffe7a-9387-4377-9541-c2379b173809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:17.168794 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ffe7a-9387-4377-9541-c2379b173809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:17.169438 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ffe7a-9387-4377-9541-c2379b173809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:17.172412 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ffe7a-9387-4377-9541-c2379b173809 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:17.253190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1388/2811] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:17 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:17.254643 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00c9e1-13ed-4012-9e09-4daf22b68d11 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:17.266942 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00c9e1-13ed-4012-9e09-4daf22b68d11 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:17.300460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:17.322777 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2828e11-199f-4974-b684-752eef3f84f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:17.323317 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828e11-199f-4974-b684-752eef3f84f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:17.323596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828e11-199f-4974-b684-752eef3f84f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:17.323869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2828e11-199f-4974-b684-752eef3f84f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:17.324493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2828e11-199f-4974-b684-752eef3f84f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:17.327022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2828e11-199f-4974-b684-752eef3f84f5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:17.341055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ffe7a-9387-4377-9541-c2379b173809 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:17.343487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0e0ffe7a-9387-4377-9541-c2379b173809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:17.356514 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ffe7a-9387-4377-9541-c2379b173809 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:17.361596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:17.362238 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:17.363392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:17.363392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] PATH_INFO: `/v3/projects/6abc85b245aa44a58e27e8040733ad40` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:17.364162 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6abc85b245aa44a58e27e8040733ad40)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:17.366090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:17.408589 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1424/2812] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:17 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:17.412735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2828e11-199f-4974-b684-752eef3f84f5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:17.423697 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2828e11-199f-4974-b684-752eef3f84f5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:17.429182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285db7d-f649-4c39-adfd-dbdb397b3886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:17.429911 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285db7d-f649-4c39-adfd-dbdb397b3886 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:17.430210 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285db7d-f649-4c39-adfd-dbdb397b3886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:17.430482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285db7d-f649-4c39-adfd-dbdb397b3886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:17.431166 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285db7d-f649-4c39-adfd-dbdb397b3886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:17.432878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285db7d-f649-4c39-adfd-dbdb397b3886 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:17.443472 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1425/2813] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:28:17.447575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285db7d-f649-4c39-adfd-dbdb397b3886 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:17.457774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285db7d-f649-4c39-adfd-dbdb397b3886 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:17.462610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf6ca2-3783-4db5-8745-ba9f87d68ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:17.468148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf6ca2-3783-4db5-8745-ba9f87d68ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:17.468148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf6ca2-3783-4db5-8745-ba9f87d68ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:17.468148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf6ca2-3783-4db5-8745-ba9f87d68ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:17.468148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf6ca2-3783-4db5-8745-ba9f87d68ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:17.468148 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf6ca2-3783-4db5-8745-ba9f87d68ef8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:17.477186 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1426/2814] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:28:17.478718 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6abc85b245aa44a58e27e8040733ad40', 'request_id': 'req-23f45067-762a-4ccd-a057-e60aa78f5edb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:17.481321 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf6ca2-3783-4db5-8745-ba9f87d68ef8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:17.485662 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6abc85b245aa44a58e27e8040733ad40', 'request_id': 'req-23f45067-762a-4ccd-a057-e60aa78f5edb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:17.492377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf6ca2-3783-4db5-8745-ba9f87d68ef8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:17.493000 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6abc85b245aa44a58e27e8040733ad40', 'request_id': 'req-23f45067-762a-4ccd-a057-e60aa78f5edb'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:17.548151 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2e00c-740f-47ea-bd44-27621b7fce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:17.548799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e00c-740f-47ea-bd44-27621b7fce0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:17.549077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e00c-740f-47ea-bd44-27621b7fce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:17.549347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e00c-740f-47ea-bd44-27621b7fce0e admin admin] PATH_INFO: `/v3/projects/87f1df078e984632b81081c8b02c29b3/users/0804f879844e474ea2f5f16e8f697f4f/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:17.563711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2e00c-740f-47ea-bd44-27621b7fce0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f1df078e984632b81081c8b02c29b3, user_id=0804f879844e474ea2f5f16e8f697f4f, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:17.566360 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2e00c-740f-47ea-bd44-27621b7fce0e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:17.607424 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] The token cache is being invalidate because project 6abc85b245aa44a58e27e8040733ad40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:17.611509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:17.611509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:17.611509 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1389/2815] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:17 2022] DELETE /identity/v3/projects/6abc85b245aa44a58e27e8040733ad40 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:17.614261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:17.615608 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:17.628479 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f45067-762a-4ccd-a057-e60aa78f5edb admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:17.633212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:17.646839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:17.646839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:17.646839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] PATH_INFO: `/v3/users/d93e521e7c5448f4abe64c60e39e6eef` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:17.646839 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d93e521e7c5448f4abe64c60e39e6eef)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:17.647218 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1427/2816] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:17 2022] PUT /identity/v3/projects/87f1df078e984632b81081c8b02c29b3/users/0804f879844e474ea2f5f16e8f697f4f/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:17.647308 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:17.705110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e39908-d797-4f4c-af2c-7967b67d10ea None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:17.705700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e39908-d797-4f4c-af2c-7967b67d10ea None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:17.705700 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e39908-d797-4f4c-af2c-7967b67d10ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:17.735140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-78e39908-d797-4f4c-af2c-7967b67d10ea None None] MFA Rules not processed for user `0804f879844e474ea2f5f16e8f697f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:17.743474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-78e39908-d797-4f4c-af2c-7967b67d10ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:17.799998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1428/2817] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:17.804361 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e39908-d797-4f4c-af2c-7967b67d10ea None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:17.805615 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-78e39908-d797-4f4c-af2c-7967b67d10ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:17.824871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:17.849606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd93e521e7c5448f4abe64c60e39e6eef'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:17.850249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd93e521e7c5448f4abe64c60e39e6eef'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:17.869500 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e39908-d797-4f4c-af2c-7967b67d10ea None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:17.874559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73074c-0d95-4858-9f0d-bde75bf408e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:17.875185 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73074c-0d95-4858-9f0d-bde75bf408e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:17.875454 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73074c-0d95-4858-9f0d-bde75bf408e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:17.875720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73074c-0d95-4858-9f0d-bde75bf408e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:17.876862 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73074c-0d95-4858-9f0d-bde75bf408e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:17.878187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73074c-0d95-4858-9f0d-bde75bf408e0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:17.971958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd93e521e7c5448f4abe64c60e39e6eef'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:17.972616 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd93e521e7c5448f4abe64c60e39e6eef'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:17.979355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1429/2818] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:17 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:17.980815 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd93e521e7c5448f4abe64c60e39e6eef'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:17.982055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:17.984206 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73074c-0d95-4858-9f0d-bde75bf408e0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:17.985824 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6e73074c-0d95-4858-9f0d-bde75bf408e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:18.000029 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1390/2819] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:17 2022] DELETE /identity/v3/users/d93e521e7c5448f4abe64c60e39e6eef => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:18.062064 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73074c-0d95-4858-9f0d-bde75bf408e0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:18.122452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb987d-014d-41de-ae82-5386c2c31adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:18.123111 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb987d-014d-41de-ae82-5386c2c31adf admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.124022 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb987d-014d-41de-ae82-5386c2c31adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.124296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb987d-014d-41de-ae82-5386c2c31adf admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.124928 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb987d-014d-41de-ae82-5386c2c31adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:18.126871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb987d-014d-41de-ae82-5386c2c31adf admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:18.239995 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1430/2820] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:17 2022] POST /identity/v3/users => generated 295 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:18.243642 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:18.255209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe9dbf-94e6-495e-ad1b-12d0ee0bd744 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:18.267477 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f02044-ffd0-4fb8-a796-8b490207b33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:18.273908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f02044-ffd0-4fb8-a796-8b490207b33f admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.273908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f02044-ffd0-4fb8-a796-8b490207b33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.273908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f02044-ffd0-4fb8-a796-8b490207b33f admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.273908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f02044-ffd0-4fb8-a796-8b490207b33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:18.273908 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f02044-ffd0-4fb8-a796-8b490207b33f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:18.283125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1391/2821] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:18.290868 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb987d-014d-41de-ae82-5386c2c31adf admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:18.302268 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb987d-014d-41de-ae82-5386c2c31adf admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:18.307288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109bc5b-462d-467e-9c1c-40697a36aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:18.307940 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109bc5b-462d-467e-9c1c-40697a36aa9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.308217 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109bc5b-462d-467e-9c1c-40697a36aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.308487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109bc5b-462d-467e-9c1c-40697a36aa9c admin admin] PATH_INFO: `/v3/projects/1d59d6b7da8e41a0b3e8458f09f68329/users/4344134f04574847b137ba727bca559e/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.324141 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109bc5b-462d-467e-9c1c-40697a36aa9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d59d6b7da8e41a0b3e8458f09f68329, user_id=4344134f04574847b137ba727bca559e, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:18.327428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109bc5b-462d-467e-9c1c-40697a36aa9c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:18.413683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1431/2822] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:18 2022] PUT /identity/v3/projects/1d59d6b7da8e41a0b3e8458f09f68329/users/4344134f04574847b137ba727bca559e/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:18.417741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f02044-ffd0-4fb8-a796-8b490207b33f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:18.429168 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f02044-ffd0-4fb8-a796-8b490207b33f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:18.444732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109bc5b-462d-467e-9c1c-40697a36aa9c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:18.446624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6109bc5b-462d-467e-9c1c-40697a36aa9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:18.470038 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:18.495437 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991a0a3-a1b4-4665-baaf-e5f9b4a0ff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:18.496206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991a0a3-a1b4-4665-baaf-e5f9b4a0ff9e admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.496487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991a0a3-a1b4-4665-baaf-e5f9b4a0ff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.496763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991a0a3-a1b4-4665-baaf-e5f9b4a0ff9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.497410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991a0a3-a1b4-4665-baaf-e5f9b4a0ff9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:18.499081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991a0a3-a1b4-4665-baaf-e5f9b4a0ff9e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:18.512299 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1392/2823] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:18.513898 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991a0a3-a1b4-4665-baaf-e5f9b4a0ff9e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:18.520634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109bc5b-462d-467e-9c1c-40697a36aa9c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:18.523107 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991a0a3-a1b4-4665-baaf-e5f9b4a0ff9e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:18.525364 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:18.526051 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.526327 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.526606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] PATH_INFO: `/v3/projects/89c9d48033f24c068e8aefa092bc7906` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.527769 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c9d48033f24c068e8aefa092bc7906)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:18.527916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e06e5-88f2-4928-8483-8928a5f581be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:18.528395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e06e5-88f2-4928-8483-8928a5f581be admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.528690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e06e5-88f2-4928-8483-8928a5f581be admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.528945 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e06e5-88f2-4928-8483-8928a5f581be admin admin] PATH_INFO: `/v3/projects/1d59d6b7da8e41a0b3e8458f09f68329/users/4344134f04574847b137ba727bca559e/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.530261 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:18.531429 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e06e5-88f2-4928-8483-8928a5f581be admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d59d6b7da8e41a0b3e8458f09f68329, user_id=4344134f04574847b137ba727bca559e, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:18.534325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e06e5-88f2-4928-8483-8928a5f581be admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:18.548159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1393/2824] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:18 2022] PUT /identity/v3/projects/1d59d6b7da8e41a0b3e8458f09f68329/users/4344134f04574847b137ba727bca559e/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:18.558459 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff30e9-e73a-4cec-badd-8498401519b1 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.558778 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff30e9-e73a-4cec-badd-8498401519b1 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.559058 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff30e9-e73a-4cec-badd-8498401519b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.586163 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-19ff30e9-e73a-4cec-badd-8498401519b1 None None] MFA Rules not processed for user `4344134f04574847b137ba727bca559e`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:18.587407 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-19ff30e9-e73a-4cec-badd-8498401519b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:18.655645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1394/2825] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:18.659820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c9d48033f24c068e8aefa092bc7906', 'request_id': 'req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:18.666007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c9d48033f24c068e8aefa092bc7906', 'request_id': 'req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:18.666692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff30e9-e73a-4cec-badd-8498401519b1 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:18.668049 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-19ff30e9-e73a-4cec-badd-8498401519b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:18.673130 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c9d48033f24c068e8aefa092bc7906', 'request_id': 'req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:18.710261 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:18.724892 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff30e9-e73a-4cec-badd-8498401519b1 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:18.755696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] The token cache is being invalidate because project 89c9d48033f24c068e8aefa092bc7906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:18.756249 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:18.756665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a00bd8a2-a2b2-4d8e-b5ab-e9d71d47ffdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:18.758237 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1432/2826] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:18 2022] DELETE /identity/v3/projects/89c9d48033f24c068e8aefa092bc7906 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:18.762826 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c594f1-e27f-4822-88a7-a5823bd29d31 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.763114 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c594f1-e27f-4822-88a7-a5823bd29d31 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.763393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c594f1-e27f-4822-88a7-a5823bd29d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.772972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd929f-e27d-4c6d-8606-be8e7a00e34a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:18.774963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd929f-e27d-4c6d-8606-be8e7a00e34a service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.774963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd929f-e27d-4c6d-8606-be8e7a00e34a service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.774963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd929f-e27d-4c6d-8606-be8e7a00e34a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.775957 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0fdd929f-e27d-4c6d-8606-be8e7a00e34a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:18.782869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e3c594f1-e27f-4822-88a7-a5823bd29d31 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:18.784063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e3c594f1-e27f-4822-88a7-a5823bd29d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:18.838333 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd929f-e27d-4c6d-8606-be8e7a00e34a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:18.840153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd929f-e27d-4c6d-8606-be8e7a00e34a service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:18.849957 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1395/2827] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:28:18.853000 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1433/2828] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:18.861126 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6631f0-e7c5-4dd9-90c5-be287c4c7022 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.861520 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6631f0-e7c5-4dd9-90c5-be287c4c7022 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.861801 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6631f0-e7c5-4dd9-90c5-be287c4c7022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.881666 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-4a6631f0-e7c5-4dd9-90c5-be287c4c7022 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:18.882910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-4a6631f0-e7c5-4dd9-90c5-be287c4c7022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:18.891075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1396/2829] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:18.895242 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c594f1-e27f-4822-88a7-a5823bd29d31 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:18.904988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c594f1-e27f-4822-88a7-a5823bd29d31 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:18.910394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385533-1d1f-4530-847f-516e51e4ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:18.911209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385533-1d1f-4530-847f-516e51e4ba55 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.911554 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385533-1d1f-4530-847f-516e51e4ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.911875 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46385533-1d1f-4530-847f-516e51e4ba55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.917608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385533-1d1f-4530-847f-516e51e4ba55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:18.917608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385533-1d1f-4530-847f-516e51e4ba55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:18.917608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46385533-1d1f-4530-847f-516e51e4ba55 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:18.927273 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1434/2830] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 16:28:18.932986 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6631f0-e7c5-4dd9-90c5-be287c4c7022 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:18.943278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6631f0-e7c5-4dd9-90c5-be287c4c7022 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:18.948584 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dceb9a-6421-4061-8e42-98e6f8933589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:18.949178 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dceb9a-6421-4061-8e42-98e6f8933589 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:18.950638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dceb9a-6421-4061-8e42-98e6f8933589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:18.950638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dceb9a-6421-4061-8e42-98e6f8933589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:18.950638 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dceb9a-6421-4061-8e42-98e6f8933589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:18.952831 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dceb9a-6421-4061-8e42-98e6f8933589 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:19.073093 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1397/2831] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:18 2022] POST /identity/v3/projects => generated 407 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:19.076193 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385533-1d1f-4530-847f-516e51e4ba55 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:19.088578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46385533-1d1f-4530-847f-516e51e4ba55 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:19.123054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:19.150570 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6e6a7-a149-4d51-83cb-e5c644951a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:19.151205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e6a7-a149-4d51-83cb-e5c644951a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:19.151478 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e6a7-a149-4d51-83cb-e5c644951a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:19.153287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6e6a7-a149-4d51-83cb-e5c644951a47 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:19.153287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6e6a7-a149-4d51-83cb-e5c644951a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:19.155215 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6e6a7-a149-4d51-83cb-e5c644951a47 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:19.264408 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1435/2832] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:19 2022] POST /identity/v3/users => generated 304 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:19.268777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dceb9a-6421-4061-8e42-98e6f8933589 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:19.280225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dceb9a-6421-4061-8e42-98e6f8933589 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:19.284834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f52ae-f33a-47f9-9882-58640b9aa57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:19.285430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f52ae-f33a-47f9-9882-58640b9aa57f admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:19.285713 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f52ae-f33a-47f9-9882-58640b9aa57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:19.285988 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f52ae-f33a-47f9-9882-58640b9aa57f admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:19.286792 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f52ae-f33a-47f9-9882-58640b9aa57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:19.291062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f52ae-f33a-47f9-9882-58640b9aa57f admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:19.301292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1398/2833] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:28:19.305446 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6e6a7-a149-4d51-83cb-e5c644951a47 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:19.317208 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6e6a7-a149-4d51-83cb-e5c644951a47 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:19.322799 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80780e80-2141-4639-b040-ed6889e4b9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:19.323419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780e80-2141-4639-b040-ed6889e4b9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:19.323683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780e80-2141-4639-b040-ed6889e4b9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:19.324009 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80780e80-2141-4639-b040-ed6889e4b9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:19.324645 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80780e80-2141-4639-b040-ed6889e4b9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:19.326263 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80780e80-2141-4639-b040-ed6889e4b9c8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:19.336390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1436/2834] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:19.343473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f52ae-f33a-47f9-9882-58640b9aa57f admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:19.353748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f52ae-f33a-47f9-9882-58640b9aa57f admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:19.359109 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd727471-e7e9-4ba0-a3e3-b4b9c2766d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:19.359768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd727471-e7e9-4ba0-a3e3-b4b9c2766d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:19.360052 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd727471-e7e9-4ba0-a3e3-b4b9c2766d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:19.360324 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd727471-e7e9-4ba0-a3e3-b4b9c2766d89 admin admin] PATH_INFO: `/v3/projects/d2a0e23b4cfe499cb977d7ae1f3f99c6/users/858b77f8c06e40b6b894db09ce76db47/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:19.375431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd727471-e7e9-4ba0-a3e3-b4b9c2766d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a0e23b4cfe499cb977d7ae1f3f99c6, user_id=858b77f8c06e40b6b894db09ce76db47, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:19.378300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd727471-e7e9-4ba0-a3e3-b4b9c2766d89 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:19.456035 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1399/2835] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:19 2022] PUT /identity/v3/projects/d2a0e23b4cfe499cb977d7ae1f3f99c6/users/858b77f8c06e40b6b894db09ce76db47/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:19.527214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eada46-792b-4a7f-82c1-864dfce9b54e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:19.527735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eada46-792b-4a7f-82c1-864dfce9b54e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:19.527839 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eada46-792b-4a7f-82c1-864dfce9b54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:19.559225 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-54eada46-792b-4a7f-82c1-864dfce9b54e None None] MFA Rules not processed for user `858b77f8c06e40b6b894db09ce76db47`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:19.560423 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-54eada46-792b-4a7f-82c1-864dfce9b54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:19.624647 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1437/2836] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:19 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:19.629147 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd727471-e7e9-4ba0-a3e3-b4b9c2766d89 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:19.682777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:19.696574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd727471-e7e9-4ba0-a3e3-b4b9c2766d89 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:19.701706 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59721006-63fa-43cf-b769-13efd6c56875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:19.702349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721006-63fa-43cf-b769-13efd6c56875 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:19.702630 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721006-63fa-43cf-b769-13efd6c56875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:19.702960 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721006-63fa-43cf-b769-13efd6c56875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:19.711737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59721006-63fa-43cf-b769-13efd6c56875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:19.711737 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59721006-63fa-43cf-b769-13efd6c56875 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:19.808862 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1400/2837] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:19 2022] POST /identity/v3/projects => generated 409 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:19.813534 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eada46-792b-4a7f-82c1-864dfce9b54e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:19.824240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eada46-792b-4a7f-82c1-864dfce9b54e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:19.880016 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b377c-72de-4c6b-9adf-a73d4966ede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:19.880616 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b377c-72de-4c6b-9adf-a73d4966ede8 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:19.880889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b377c-72de-4c6b-9adf-a73d4966ede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:19.881158 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b377c-72de-4c6b-9adf-a73d4966ede8 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:19.881791 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b377c-72de-4c6b-9adf-a73d4966ede8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:19.883743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b377c-72de-4c6b-9adf-a73d4966ede8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:19.961725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1438/2838] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:19 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:19.965614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59721006-63fa-43cf-b769-13efd6c56875 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:19.976928 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59721006-63fa-43cf-b769-13efd6c56875 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:19.981934 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c6d3f-6007-42b9-b811-a1fff14108dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:19.983106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c6d3f-6007-42b9-b811-a1fff14108dc admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:19.983415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c6d3f-6007-42b9-b811-a1fff14108dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:19.983717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c6d3f-6007-42b9-b811-a1fff14108dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:19.984358 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c6d3f-6007-42b9-b811-a1fff14108dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:19.985958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c6d3f-6007-42b9-b811-a1fff14108dc admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:19.995958 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1401/2839] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:20.000791 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b377c-72de-4c6b-9adf-a73d4966ede8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:20.010785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b377c-72de-4c6b-9adf-a73d4966ede8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:20.016030 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1fccf-59aa-4997-8ef9-9140844263c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:20.016667 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1fccf-59aa-4997-8ef9-9140844263c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:20.016943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1fccf-59aa-4997-8ef9-9140844263c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:20.017214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1fccf-59aa-4997-8ef9-9140844263c8 admin admin] PATH_INFO: `/v3/projects/008a4b4b3e1e43acbe33cad1dba7ee85/users/12fbb05701f94c11bf4e37aa5067c702/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:20.031881 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1fccf-59aa-4997-8ef9-9140844263c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=008a4b4b3e1e43acbe33cad1dba7ee85, user_id=12fbb05701f94c11bf4e37aa5067c702, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:20.034536 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1fccf-59aa-4997-8ef9-9140844263c8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:20.099258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1439/2840] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:19 2022] PUT /identity/v3/projects/008a4b4b3e1e43acbe33cad1dba7ee85/users/12fbb05701f94c11bf4e37aa5067c702/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:20.103219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c6d3f-6007-42b9-b811-a1fff14108dc admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:20.113732 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c6d3f-6007-42b9-b811-a1fff14108dc admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:20.172561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cefee-4ee2-4cc4-99f0-9957562a58bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:20.173174 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cefee-4ee2-4cc4-99f0-9957562a58bf admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:20.173451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cefee-4ee2-4cc4-99f0-9957562a58bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:20.173727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cefee-4ee2-4cc4-99f0-9957562a58bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:20.174370 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cefee-4ee2-4cc4-99f0-9957562a58bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:20.176021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cefee-4ee2-4cc4-99f0-9957562a58bf admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:20.186395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1402/2841] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:20.190735 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1fccf-59aa-4997-8ef9-9140844263c8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:20.201982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1fccf-59aa-4997-8ef9-9140844263c8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:20.206747 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ace152-bb3b-44bf-bb4e-3752d1bfeb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:20.207406 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ace152-bb3b-44bf-bb4e-3752d1bfeb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:20.207682 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ace152-bb3b-44bf-bb4e-3752d1bfeb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:20.207956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ace152-bb3b-44bf-bb4e-3752d1bfeb0a admin admin] PATH_INFO: `/v3/projects/008a4b4b3e1e43acbe33cad1dba7ee85/users/12fbb05701f94c11bf4e37aa5067c702/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:20.209899 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ace152-bb3b-44bf-bb4e-3752d1bfeb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=008a4b4b3e1e43acbe33cad1dba7ee85, user_id=12fbb05701f94c11bf4e37aa5067c702, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:20.212680 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ace152-bb3b-44bf-bb4e-3752d1bfeb0a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:20.215045 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:20.223498 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1440/2842] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:20 2022] PUT /identity/v3/projects/008a4b4b3e1e43acbe33cad1dba7ee85/users/12fbb05701f94c11bf4e37aa5067c702/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:20.234412 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56a01c-4587-4547-9102-d5baa7d8d334 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:20.234742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56a01c-4587-4547-9102-d5baa7d8d334 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:20.235539 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56a01c-4587-4547-9102-d5baa7d8d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:20.263704 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-9b56a01c-4587-4547-9102-d5baa7d8d334 None None] MFA Rules not processed for user `12fbb05701f94c11bf4e37aa5067c702`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:20.264929 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9b56a01c-4587-4547-9102-d5baa7d8d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:20.333415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1403/2843] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:20 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:20.345073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ace152-bb3b-44bf-bb4e-3752d1bfeb0a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:20.346836 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-37ace152-bb3b-44bf-bb4e-3752d1bfeb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:20.407546 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ace152-bb3b-44bf-bb4e-3752d1bfeb0a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:20.411260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fcd22-03ba-49a3-8374-05cfc9adb735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:20.411871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fcd22-03ba-49a3-8374-05cfc9adb735 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:20.412145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fcd22-03ba-49a3-8374-05cfc9adb735 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:20.412416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fcd22-03ba-49a3-8374-05cfc9adb735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:20.421873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fcd22-03ba-49a3-8374-05cfc9adb735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:20.423606 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4fcd22-03ba-49a3-8374-05cfc9adb735 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:20.433475 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1441/2844] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:20 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:20.767619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56a01c-4587-4547-9102-d5baa7d8d334 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:20.781126 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56a01c-4587-4547-9102-d5baa7d8d334 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:20.785119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98bcd9-051f-4ba0-95b8-c42bf97b2d43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:20.785974 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98bcd9-051f-4ba0-95b8-c42bf97b2d43 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:20.787042 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98bcd9-051f-4ba0-95b8-c42bf97b2d43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:20.787392 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98bcd9-051f-4ba0-95b8-c42bf97b2d43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:20.842561 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:20.858510 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98bcd9-051f-4ba0-95b8-c42bf97b2d43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:20.860054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98bcd9-051f-4ba0-95b8-c42bf97b2d43 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:20.872441 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1404/2845] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:20 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:20.874974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fcd22-03ba-49a3-8374-05cfc9adb735 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:20.879403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0e4fcd22-03ba-49a3-8374-05cfc9adb735 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:20.893505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98bcd9-051f-4ba0-95b8-c42bf97b2d43 service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:20.895030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5a98bcd9-051f-4ba0-95b8-c42bf97b2d43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:20.896972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fcd22-03ba-49a3-8374-05cfc9adb735 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:20.901917 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79cad2-e24c-4068-aece-63556788f42b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:20.902592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79cad2-e24c-4068-aece-63556788f42b service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:20.903088 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79cad2-e24c-4068-aece-63556788f42b service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:20.903460 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79cad2-e24c-4068-aece-63556788f42b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:20.906110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ca79cad2-e24c-4068-aece-63556788f42b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:20.975061 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79cad2-e24c-4068-aece-63556788f42b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:20.976771 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79cad2-e24c-4068-aece-63556788f42b service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:20.984491 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98bcd9-051f-4ba0-95b8-c42bf97b2d43 service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:20.987732 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1442/2846] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:20.990574 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f42ec-a423-4d9a-b07d-cd8ae045fcf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:20.991305 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f42ec-a423-4d9a-b07d-cd8ae045fcf8 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:20.991698 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f42ec-a423-4d9a-b07d-cd8ae045fcf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:20.991980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f42ec-a423-4d9a-b07d-cd8ae045fcf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:20.993940 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-140f42ec-a423-4d9a-b07d-cd8ae045fcf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:21.007717 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f42ec-a423-4d9a-b07d-cd8ae045fcf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:21.011334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f42ec-a423-4d9a-b07d-cd8ae045fcf8 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:21.021054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1405/2847] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:22.461542 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79cad2-e24c-4068-aece-63556788f42b service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:22.470691 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79cad2-e24c-4068-aece-63556788f42b service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:22.474255 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87835f7f-d965-41ab-b0cb-597250dbfff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:22.484232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87835f7f-d965-41ab-b0cb-597250dbfff6 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:22.484232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87835f7f-d965-41ab-b0cb-597250dbfff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:22.484232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87835f7f-d965-41ab-b0cb-597250dbfff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:22.484232 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-87835f7f-d965-41ab-b0cb-597250dbfff6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:22.539428 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87835f7f-d965-41ab-b0cb-597250dbfff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:22.540864 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87835f7f-d965-41ab-b0cb-597250dbfff6 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:22.551285 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1443/2848] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:26.621295 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f42ec-a423-4d9a-b07d-cd8ae045fcf8 service nova] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:26.623269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-140f42ec-a423-4d9a-b07d-cd8ae045fcf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:26.689516 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f42ec-a423-4d9a-b07d-cd8ae045fcf8 service nova] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:26.694072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:26.694716 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:26.694997 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:26.695269 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] PATH_INFO: `/v3/users/b65f77476b144e3b97f7d33967b906ad` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:26.696385 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65f77476b144e3b97f7d33967b906ad)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:26.698408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:27.060431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65f77476b144e3b97f7d33967b906ad'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:27.061007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65f77476b144e3b97f7d33967b906ad'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:27.143796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65f77476b144e3b97f7d33967b906ad'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:27.144417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65f77476b144e3b97f7d33967b906ad'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:27.152521 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65f77476b144e3b97f7d33967b906ad'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:27.154746 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:27.170745 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1406/2849] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:26 2022] DELETE /identity/v3/users/b65f77476b144e3b97f7d33967b906ad => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:27.176190 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63452-a851-4419-a79a-7185462586f3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:27.176713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63452-a851-4419-a79a-7185462586f3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:27.176713 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a63452-a851-4419-a79a-7185462586f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:27.196874 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-52a63452-a851-4419-a79a-7185462586f3 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:27.198140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-52a63452-a851-4419-a79a-7185462586f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:27.221736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:27.256082 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1444/2850] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:27.266267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:27.267710 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:27.324373 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3032d-6f33-4645-8ccd-c2ea82592c42 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:27.328727 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930bf9b-0cfb-47b7-acc5-b5c71354f9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:27.332595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930bf9b-0cfb-47b7-acc5-b5c71354f9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:27.332595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930bf9b-0cfb-47b7-acc5-b5c71354f9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:27.332595 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930bf9b-0cfb-47b7-acc5-b5c71354f9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:27.338828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930bf9b-0cfb-47b7-acc5-b5c71354f9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:27.340291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930bf9b-0cfb-47b7-acc5-b5c71354f9a9 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:27.349534 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1407/2851] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:27.808950 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a63452-a851-4419-a79a-7185462586f3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:27.810402 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-52a63452-a851-4419-a79a-7185462586f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:27.823335 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a63452-a851-4419-a79a-7185462586f3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:27.828270 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:27.828998 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:27.829280 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:27.829581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] PATH_INFO: `/v3/projects/bf4818036f9a4473a6939163ea615b83` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:27.830858 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4818036f9a4473a6939163ea615b83)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:27.832675 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:27.966970 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4818036f9a4473a6939163ea615b83', 'request_id': 'req-08d5875d-c86d-4c68-ba0e-cc7d027001ea'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:27.972576 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4818036f9a4473a6939163ea615b83', 'request_id': 'req-08d5875d-c86d-4c68-ba0e-cc7d027001ea'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:27.978578 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4818036f9a4473a6939163ea615b83', 'request_id': 'req-08d5875d-c86d-4c68-ba0e-cc7d027001ea'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.057132 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930bf9b-0cfb-47b7-acc5-b5c71354f9a9 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:28.058728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0930bf9b-0cfb-47b7-acc5-b5c71354f9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:28.059458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] The token cache is being invalidate because project bf4818036f9a4473a6939163ea615b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:28.063160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.063160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.063160 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1445/2852] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:27 2022] DELETE /identity/v3/projects/bf4818036f9a4473a6939163ea615b83 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:28.066385 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:28.067739 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:28.072741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930bf9b-0cfb-47b7-acc5-b5c71354f9a9 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:28.129037 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01222d-829a-4684-8cd7-3b690b819415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:28.129582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01222d-829a-4684-8cd7-3b690b819415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:28.129864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01222d-829a-4684-8cd7-3b690b819415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:28.130131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01222d-829a-4684-8cd7-3b690b819415 admin admin] PATH_INFO: `/v3/users/858b77f8c06e40b6b894db09ce76db47` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:28.131288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01222d-829a-4684-8cd7-3b690b819415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=858b77f8c06e40b6b894db09ce76db47)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:28.133229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01222d-829a-4684-8cd7-3b690b819415 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:28.134077 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5875d-c86d-4c68-ba0e-cc7d027001ea admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:28.139356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:28.139619 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:28.139900 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:28.140169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] PATH_INFO: `/v3/users/0804f879844e474ea2f5f16e8f697f4f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:28.141315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0804f879844e474ea2f5f16e8f697f4f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:28.143388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:28.415602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4c01222d-829a-4684-8cd7-3b690b819415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858b77f8c06e40b6b894db09ce76db47'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.416218 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4c01222d-829a-4684-8cd7-3b690b819415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858b77f8c06e40b6b894db09ce76db47'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.426159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0804f879844e474ea2f5f16e8f697f4f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.426850 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0804f879844e474ea2f5f16e8f697f4f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.504450 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4c01222d-829a-4684-8cd7-3b690b819415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858b77f8c06e40b6b894db09ce76db47'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.505130 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4c01222d-829a-4684-8cd7-3b690b819415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858b77f8c06e40b6b894db09ce76db47'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.512499 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-4c01222d-829a-4684-8cd7-3b690b819415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858b77f8c06e40b6b894db09ce76db47'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.530066 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1408/2853] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:28 2022] DELETE /identity/v3/users/858b77f8c06e40b6b894db09ce76db47 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:28.534910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976025-35e6-4263-8908-36303b96dcfa None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:28.535196 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976025-35e6-4263-8908-36303b96dcfa None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:28.535471 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d976025-35e6-4263-8908-36303b96dcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:28.543141 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:28.554820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-9d976025-35e6-4263-8908-36303b96dcfa None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:28.556031 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9d976025-35e6-4263-8908-36303b96dcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:28.560575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0804f879844e474ea2f5f16e8f697f4f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.564827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0804f879844e474ea2f5f16e8f697f4f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.564827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:28.569436 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0804f879844e474ea2f5f16e8f697f4f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:28.588702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1446/2854] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:28 2022] DELETE /identity/v3/users/0804f879844e474ea2f5f16e8f697f4f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:28.616738 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1409/2855] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:28.627113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:28.628704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:28.687665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f086d-0166-46ed-8921-39c55b10a7d8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:28.691393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445d156-2ec0-4a87-8eff-55b3e563c1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:28.692033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445d156-2ec0-4a87-8eff-55b3e563c1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:28.692304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445d156-2ec0-4a87-8eff-55b3e563c1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:28.692571 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445d156-2ec0-4a87-8eff-55b3e563c1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:28.753200 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445d156-2ec0-4a87-8eff-55b3e563c1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:28.758311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445d156-2ec0-4a87-8eff-55b3e563c1e6 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:28.772982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1447/2856] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:28:28.997904 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d976025-35e6-4263-8908-36303b96dcfa None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:28.999649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-9d976025-35e6-4263-8908-36303b96dcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:29.023500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d976025-35e6-4263-8908-36303b96dcfa None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:29.029575 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:29.030284 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:29.030629 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:29.031032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] PATH_INFO: `/v3/projects/87f1df078e984632b81081c8b02c29b3` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:29.032240 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f1df078e984632b81081c8b02c29b3)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:29.034373 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:29.180486 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f1df078e984632b81081c8b02c29b3', 'request_id': 'req-e944271c-26c4-470b-b446-131843fd8a66'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.186347 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f1df078e984632b81081c8b02c29b3', 'request_id': 'req-e944271c-26c4-470b-b446-131843fd8a66'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.193309 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f1df078e984632b81081c8b02c29b3', 'request_id': 'req-e944271c-26c4-470b-b446-131843fd8a66'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.253010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] The token cache is being invalidate because project 87f1df078e984632b81081c8b02c29b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:29.253294 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.254342 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.255355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445d156-2ec0-4a87-8eff-55b3e563c1e6 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:29.256131 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1410/2857] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:28 2022] DELETE /identity/v3/projects/87f1df078e984632b81081c8b02c29b3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:29.259614 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d445d156-2ec0-4a87-8eff-55b3e563c1e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:29.264828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:29.264828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:29.272817 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445d156-2ec0-4a87-8eff-55b3e563c1e6 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:29.335165 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944271c-26c4-470b-b446-131843fd8a66 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:29.338770 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:29.339412 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:29.339692 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:29.339893 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:29.340033 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] PATH_INFO: `/v3/projects/d2a0e23b4cfe499cb977d7ae1f3f99c6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:29.340513 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:29.340787 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:29.341055 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] PATH_INFO: `/v3/users/4344134f04574847b137ba727bca559e` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:29.341180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a0e23b4cfe499cb977d7ae1f3f99c6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:29.342175 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4344134f04574847b137ba727bca559e)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:29.343041 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:29.344821 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:29.369320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:29.545569 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:29.559865 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4344134f04574847b137ba727bca559e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.560430 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a0e23b4cfe499cb977d7ae1f3f99c6', 'request_id': 'req-2b073b60-d632-4c63-86c9-b67621524980'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.561974 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4344134f04574847b137ba727bca559e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.567009 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a0e23b4cfe499cb977d7ae1f3f99c6', 'request_id': 'req-2b073b60-d632-4c63-86c9-b67621524980'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.573375 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a0e23b4cfe499cb977d7ae1f3f99c6', 'request_id': 'req-2b073b60-d632-4c63-86c9-b67621524980'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.624826 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4344134f04574847b137ba727bca559e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.625453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4344134f04574847b137ba727bca559e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.632722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4344134f04574847b137ba727bca559e'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.650041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1411/2858] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:29 2022] DELETE /identity/v3/users/4344134f04574847b137ba727bca559e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:29.709227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] The token cache is being invalidate because project d2a0e23b4cfe499cb977d7ae1f3f99c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:29.709519 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.710174 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:29.711699 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1448/2859] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:29 2022] DELETE /identity/v3/projects/d2a0e23b4cfe499cb977d7ae1f3f99c6 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:29.715897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:29.717318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:29.780886 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9c09f-d8ea-4b40-9cec-5205acc90673 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:29.786032 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430f2a-34e9-4028-8242-19acf86be1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:29.789004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430f2a-34e9-4028-8242-19acf86be1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:29.789004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430f2a-34e9-4028-8242-19acf86be1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:29.789004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430f2a-34e9-4028-8242-19acf86be1ec admin admin] PATH_INFO: `/v3/users/12fbb05701f94c11bf4e37aa5067c702` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:29.789004 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29430f2a-34e9-4028-8242-19acf86be1ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=12fbb05701f94c11bf4e37aa5067c702)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:29.790897 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29430f2a-34e9-4028-8242-19acf86be1ec admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:30.032617 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-29430f2a-34e9-4028-8242-19acf86be1ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12fbb05701f94c11bf4e37aa5067c702'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.033375 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-29430f2a-34e9-4028-8242-19acf86be1ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12fbb05701f94c11bf4e37aa5067c702'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.144589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-29430f2a-34e9-4028-8242-19acf86be1ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12fbb05701f94c11bf4e37aa5067c702'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.145068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-29430f2a-34e9-4028-8242-19acf86be1ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12fbb05701f94c11bf4e37aa5067c702'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.153402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-29430f2a-34e9-4028-8242-19acf86be1ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12fbb05701f94c11bf4e37aa5067c702'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.171181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1412/2860] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:29 2022] DELETE /identity/v3/users/12fbb05701f94c11bf4e37aa5067c702 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:30.250300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:30.253886 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:30.340510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b073b60-d632-4c63-86c9-b67621524980 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:30.397923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:30.398575 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:30.398880 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:30.399169 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] PATH_INFO: `/v3/projects/1d59d6b7da8e41a0b3e8458f09f68329` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:30.400314 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d59d6b7da8e41a0b3e8458f09f68329)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:30.402316 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:30.532926 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d59d6b7da8e41a0b3e8458f09f68329', 'request_id': 'req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.542871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d59d6b7da8e41a0b3e8458f09f68329', 'request_id': 'req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.542871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:30.546214 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d59d6b7da8e41a0b3e8458f09f68329', 'request_id': 'req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.636272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] The token cache is being invalidate because project 1d59d6b7da8e41a0b3e8458f09f68329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:30.636860 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.637356 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.638878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1449/2861] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:30 2022] DELETE /identity/v3/projects/1d59d6b7da8e41a0b3e8458f09f68329 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:30.652830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eadd2-6b9e-4572-a82a-838fa63162ba None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:30.653306 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eadd2-6b9e-4572-a82a-838fa63162ba None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:30.653416 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55eadd2-6b9e-4572-a82a-838fa63162ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:30.678943 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a55eadd2-6b9e-4572-a82a-838fa63162ba None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:30.680398 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a55eadd2-6b9e-4572-a82a-838fa63162ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:30.700219 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:30.708300 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:30.709366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:30.754848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1413/2862] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:30.764374 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6c06a-4826-4cda-a49b-c7e23ddafe37 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:30.764780 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6c06a-4826-4cda-a49b-c7e23ddafe37 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:30.765128 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6c06a-4826-4cda-a49b-c7e23ddafe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:30.785395 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166c0ce-2cfa-4541-a1c2-f0181c0a0ed0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:30.789714 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a2d6c06a-4826-4cda-a49b-c7e23ddafe37 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:30.790599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:30.791099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a2d6c06a-4826-4cda-a49b-c7e23ddafe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:30.791396 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:30.791731 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:30.792066 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] PATH_INFO: `/v3/projects/008a4b4b3e1e43acbe33cad1dba7ee85` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:30.793302 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=008a4b4b3e1e43acbe33cad1dba7ee85)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:30.795424 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:30.800239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1414/2863] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:30.804459 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6c06a-4826-4cda-a49b-c7e23ddafe37 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:30.813601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6c06a-4826-4cda-a49b-c7e23ddafe37 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:30.818828 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845823ab-52eb-4703-9944-6e3b3339ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:30.823008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845823ab-52eb-4703-9944-6e3b3339ecf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:30.823008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845823ab-52eb-4703-9944-6e3b3339ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:30.823008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845823ab-52eb-4703-9944-6e3b3339ecf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:30.823008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845823ab-52eb-4703-9944-6e3b3339ecf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:30.823008 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845823ab-52eb-4703-9944-6e3b3339ecf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:30.823455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845823ab-52eb-4703-9944-6e3b3339ecf9 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:30.835610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1415/2864] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:28:30.840179 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845823ab-52eb-4703-9944-6e3b3339ecf9 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:30.851028 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845823ab-52eb-4703-9944-6e3b3339ecf9 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:30.855939 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded8922-ca9c-4fee-8706-448804bbd235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:30.856540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded8922-ca9c-4fee-8706-448804bbd235 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:30.856816 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded8922-ca9c-4fee-8706-448804bbd235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:30.857180 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded8922-ca9c-4fee-8706-448804bbd235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:30.857810 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded8922-ca9c-4fee-8706-448804bbd235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:30.859818 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded8922-ca9c-4fee-8706-448804bbd235 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:30.917195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008a4b4b3e1e43acbe33cad1dba7ee85', 'request_id': 'req-0ff57670-6c0a-498d-b304-e31288ae8e3d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.923007 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008a4b4b3e1e43acbe33cad1dba7ee85', 'request_id': 'req-0ff57670-6c0a-498d-b304-e31288ae8e3d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.929226 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008a4b4b3e1e43acbe33cad1dba7ee85', 'request_id': 'req-0ff57670-6c0a-498d-b304-e31288ae8e3d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:30.944125 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1416/2865] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:30 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:30.945290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded8922-ca9c-4fee-8706-448804bbd235 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.004915 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded8922-ca9c-4fee-8706-448804bbd235 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.009672 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd0521-5e6e-4172-9b85-392ec671e58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.010271 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd0521-5e6e-4172-9b85-392ec671e58a admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.012415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd0521-5e6e-4172-9b85-392ec671e58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.012415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd0521-5e6e-4172-9b85-392ec671e58a admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.012415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd0521-5e6e-4172-9b85-392ec671e58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.013472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd0521-5e6e-4172-9b85-392ec671e58a admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.046988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] The token cache is being invalidate because project 008a4b4b3e1e43acbe33cad1dba7ee85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:31.047201 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:31.048079 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ff57670-6c0a-498d-b304-e31288ae8e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:31.049569 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1450/2866] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:30 2022] DELETE /identity/v3/projects/008a4b4b3e1e43acbe33cad1dba7ee85 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:31.054106 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0ee6-de4c-479e-861d-6a2d70588bdc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.054387 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0ee6-de4c-479e-861d-6a2d70588bdc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.054658 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0ee6-de4c-479e-861d-6a2d70588bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.074288 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ef0d0ee6-de4c-479e-861d-6a2d70588bdc None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:31.075515 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ef0d0ee6-de4c-479e-861d-6a2d70588bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:31.083977 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1451/2867] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:31.094497 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951bc2-f78b-4268-88d8-fc78b39ef4c2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.094835 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951bc2-f78b-4268-88d8-fc78b39ef4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.095129 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951bc2-f78b-4268-88d8-fc78b39ef4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.105881 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1417/2868] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:30 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:31.109930 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd0521-5e6e-4172-9b85-392ec671e58a admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.111683 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-12bd0521-5e6e-4172-9b85-392ec671e58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:31.116021 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d9951bc2-f78b-4268-88d8-fc78b39ef4c2 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:31.117180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d9951bc2-f78b-4268-88d8-fc78b39ef4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:31.123972 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd0521-5e6e-4172-9b85-392ec671e58a admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.126560 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1452/2869] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:31.129145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37319f-e335-463a-bbe3-08d642fb0bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.129741 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37319f-e335-463a-bbe3-08d642fb0bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.130576 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951bc2-f78b-4268-88d8-fc78b39ef4c2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.130728 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37319f-e335-463a-bbe3-08d642fb0bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.130903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37319f-e335-463a-bbe3-08d642fb0bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.131547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37319f-e335-463a-bbe3-08d642fb0bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.133188 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37319f-e335-463a-bbe3-08d642fb0bb4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.140103 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951bc2-f78b-4268-88d8-fc78b39ef4c2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.145232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1418/2870] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:28:31.146982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060a794-ce33-4121-bc1f-2f20bbcd4667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.146982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060a794-ce33-4121-bc1f-2f20bbcd4667 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.146982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060a794-ce33-4121-bc1f-2f20bbcd4667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.146982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060a794-ce33-4121-bc1f-2f20bbcd4667 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.147404 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060a794-ce33-4121-bc1f-2f20bbcd4667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:31.147528 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060a794-ce33-4121-bc1f-2f20bbcd4667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.149243 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060a794-ce33-4121-bc1f-2f20bbcd4667 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.149840 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37319f-e335-463a-bbe3-08d642fb0bb4 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.165774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1453/2871] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:28:31.166038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37319f-e335-463a-bbe3-08d642fb0bb4 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.167052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060a794-ce33-4121-bc1f-2f20bbcd4667 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.171229 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1f61d-9f1f-453f-906a-5a2fbbc89efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.171834 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1f61d-9f1f-453f-906a-5a2fbbc89efd admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.172106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1f61d-9f1f-453f-906a-5a2fbbc89efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.172639 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1f61d-9f1f-453f-906a-5a2fbbc89efd admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.173846 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1f61d-9f1f-453f-906a-5a2fbbc89efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.178027 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060a794-ce33-4121-bc1f-2f20bbcd4667 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.179451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1f61d-9f1f-453f-906a-5a2fbbc89efd admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.182734 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a8517-308b-45c4-97a0-2acc6e039cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.183334 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a8517-308b-45c4-97a0-2acc6e039cad admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.183610 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a8517-308b-45c4-97a0-2acc6e039cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.183878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a8517-308b-45c4-97a0-2acc6e039cad admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.184535 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a8517-308b-45c4-97a0-2acc6e039cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.186418 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a8517-308b-45c4-97a0-2acc6e039cad admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.195078 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1419/2872] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:28:31.196180 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1f61d-9f1f-453f-906a-5a2fbbc89efd admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.206054 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1f61d-9f1f-453f-906a-5a2fbbc89efd admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.210767 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625ee82-6e43-4ec4-9cfa-860e70b42df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.211415 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625ee82-6e43-4ec4-9cfa-860e70b42df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.211690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625ee82-6e43-4ec4-9cfa-860e70b42df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.211963 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625ee82-6e43-4ec4-9cfa-860e70b42df5 admin admin] PATH_INFO: `/v3/projects/e436302de1fc42478064340e4a483b6b/users/763bbd6b18374ad38899057abed6902a/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.227289 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625ee82-6e43-4ec4-9cfa-860e70b42df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e436302de1fc42478064340e4a483b6b, user_id=763bbd6b18374ad38899057abed6902a, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.229951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625ee82-6e43-4ec4-9cfa-860e70b42df5 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.283354 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1454/2873] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:31 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:31.287609 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a8517-308b-45c4-97a0-2acc6e039cad admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.313201 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1420/2874] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:31 2022] PUT /identity/v3/projects/e436302de1fc42478064340e4a483b6b/users/763bbd6b18374ad38899057abed6902a/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:31.322258 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283470-11a7-437a-9f55-5c92d089a2a3 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.322541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283470-11a7-437a-9f55-5c92d089a2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.322655 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:31.322885 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283470-11a7-437a-9f55-5c92d089a2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.352463 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a8517-308b-45c4-97a0-2acc6e039cad admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.353858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-7d283470-11a7-437a-9f55-5c92d089a2a3 None None] MFA Rules not processed for user `763bbd6b18374ad38899057abed6902a`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:31.355108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7d283470-11a7-437a-9f55-5c92d089a2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:31.372490 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:31.409107 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76891e48-dbca-4444-9201-512bbfb44625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.410876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76891e48-dbca-4444-9201-512bbfb44625 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.410876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76891e48-dbca-4444-9201-512bbfb44625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.410876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76891e48-dbca-4444-9201-512bbfb44625 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.411182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76891e48-dbca-4444-9201-512bbfb44625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.412832 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76891e48-dbca-4444-9201-512bbfb44625 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.421606 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1421/2875] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:28:31.433506 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d283470-11a7-437a-9f55-5c92d089a2a3 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.434913 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7d283470-11a7-437a-9f55-5c92d089a2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:31.491976 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d283470-11a7-437a-9f55-5c92d089a2a3 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.495699 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcf566-05a0-4eb2-9771-f9328dff7d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.496348 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcf566-05a0-4eb2-9771-f9328dff7d8a service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.496621 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcf566-05a0-4eb2-9771-f9328dff7d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.496901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcf566-05a0-4eb2-9771-f9328dff7d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.505951 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcf566-05a0-4eb2-9771-f9328dff7d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.507422 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcf566-05a0-4eb2-9771-f9328dff7d8a service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.516278 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1422/2876] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:28:31.527793 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1455/2877] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:31 2022] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:28:31.531916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcf566-05a0-4eb2-9771-f9328dff7d8a service cinder] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.543234 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcf566-05a0-4eb2-9771-f9328dff7d8a service cinder] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.548778 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1825a1-7873-4297-9744-fcea9bc0bd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.549482 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1825a1-7873-4297-9744-fcea9bc0bd4c admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.549756 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1825a1-7873-4297-9744-fcea9bc0bd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.550030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1825a1-7873-4297-9744-fcea9bc0bd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.550822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1825a1-7873-4297-9744-fcea9bc0bd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.552263 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1825a1-7873-4297-9744-fcea9bc0bd4c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.562072 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1423/2878] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:31.566748 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76891e48-dbca-4444-9201-512bbfb44625 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.577399 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76891e48-dbca-4444-9201-512bbfb44625 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.582773 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c5448-0945-424a-a186-3589f981da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.583426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5448-0945-424a-a186-3589f981da0a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.583696 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5448-0945-424a-a186-3589f981da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.583960 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5448-0945-424a-a186-3589f981da0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.584596 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c5448-0945-424a-a186-3589f981da0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.586469 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c5448-0945-424a-a186-3589f981da0a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.600509 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1456/2879] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:31.602155 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1825a1-7873-4297-9744-fcea9bc0bd4c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.612784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1825a1-7873-4297-9744-fcea9bc0bd4c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.617432 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fe37-8eab-4855-8016-b9f675449e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.618081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fe37-8eab-4855-8016-b9f675449e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.618357 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fe37-8eab-4855-8016-b9f675449e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.618637 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42fe37-8eab-4855-8016-b9f675449e49 admin admin] PATH_INFO: `/v3/projects/8809a32ff62c45d18665c091f495635b/users/89ad6d5543fd49b1b3187f223b49928a/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.634236 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42fe37-8eab-4855-8016-b9f675449e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8809a32ff62c45d18665c091f495635b, user_id=89ad6d5543fd49b1b3187f223b49928a, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.637062 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42fe37-8eab-4855-8016-b9f675449e49 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.701063 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1424/2880] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:31 2022] PUT /identity/v3/projects/8809a32ff62c45d18665c091f495635b/users/89ad6d5543fd49b1b3187f223b49928a/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:31.711842 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33ad7-07e3-434f-979f-12b4b4e9cdad None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.712311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33ad7-07e3-434f-979f-12b4b4e9cdad None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.712439 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c33ad7-07e3-434f-979f-12b4b4e9cdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.741639 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e7c33ad7-07e3-434f-979f-12b4b4e9cdad None None] MFA Rules not processed for user `89ad6d5543fd49b1b3187f223b49928a`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:31.742772 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e7c33ad7-07e3-434f-979f-12b4b4e9cdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:31.818113 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1457/2881] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:31.830363 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fe37-8eab-4855-8016-b9f675449e49 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:31.832098 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-fa42fe37-8eab-4855-8016-b9f675449e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:31.889547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42fe37-8eab-4855-8016-b9f675449e49 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:31.893334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c50f9-3e7b-4e7a-b071-bc3821e67acb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0892bfab3ce435b90b93b0786899f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:31.893950 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c50f9-3e7b-4e7a-b071-bc3821e67acb service glance] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:31.894202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c50f9-3e7b-4e7a-b071-bc3821e67acb service glance] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:31.894467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c50f9-3e7b-4e7a-b071-bc3821e67acb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:31.902660 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c50f9-3e7b-4e7a-b071-bc3821e67acb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:31.904122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c50f9-3e7b-4e7a-b071-bc3821e67acb service glance] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:31.913645 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1425/2882] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:33.400145 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86992a-e694-44b7-ae54-43277836782a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:33.400646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86992a-e694-44b7-ae54-43277836782a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:33.400879 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86992a-e694-44b7-ae54-43277836782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:33.422608 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7a86992a-e694-44b7-ae54-43277836782a None None] MFA Rules not processed for user `763bbd6b18374ad38899057abed6902a`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:33.423898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7a86992a-e694-44b7-ae54-43277836782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:33.467712 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:33.481725 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1458/2883] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:34.059111 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c50f9-3e7b-4e7a-b071-bc3821e67acb service glance] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:34.059573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f09c50f9-3e7b-4e7a-b071-bc3821e67acb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:34.108281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:34.146853 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c50f9-3e7b-4e7a-b071-bc3821e67acb service glance] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:34.151953 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04d259-b145-4b6d-a2f6-5186c7c5dc81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:34.152612 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04d259-b145-4b6d-a2f6-5186c7c5dc81 service placement] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:34.152891 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04d259-b145-4b6d-a2f6-5186c7c5dc81 service placement] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:34.153161 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04d259-b145-4b6d-a2f6-5186c7c5dc81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:34.155140 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7f04d259-b145-4b6d-a2f6-5186c7c5dc81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:34.168848 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04d259-b145-4b6d-a2f6-5186c7c5dc81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:34.170453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04d259-b145-4b6d-a2f6-5186c7c5dc81 service placement] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:34.183181 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1426/2884] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:37.453601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86992a-e694-44b7-ae54-43277836782a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:37.455547 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7a86992a-e694-44b7-ae54-43277836782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:37.530827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86992a-e694-44b7-ae54-43277836782a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:37.537603 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453182b0-71df-49d2-935b-9fa8121010f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:37.538063 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453182b0-71df-49d2-935b-9fa8121010f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:37.538339 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453182b0-71df-49d2-935b-9fa8121010f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:37.538627 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453182b0-71df-49d2-935b-9fa8121010f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:37.540482 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-453182b0-71df-49d2-935b-9fa8121010f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:37.552159 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453182b0-71df-49d2-935b-9fa8121010f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:37.553760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453182b0-71df-49d2-935b-9fa8121010f1 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:37.562623 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1459/2885] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:44.314893 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=19 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:45.911207 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04d259-b145-4b6d-a2f6-5186c7c5dc81 service placement] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:45.912757 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-7f04d259-b145-4b6d-a2f6-5186c7c5dc81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:45.978777 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04d259-b145-4b6d-a2f6-5186c7c5dc81 service placement] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:45.983601 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf671b-bf1c-4462-bfea-e869461510f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:45.984225 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf671b-bf1c-4462-bfea-e869461510f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:45.984570 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf671b-bf1c-4462-bfea-e869461510f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:45.984773 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf671b-bf1c-4462-bfea-e869461510f5 admin admin] PATH_INFO: `/v3/users/73143a267c38445eabd106950531c1fe` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:45.985915 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf671b-bf1c-4462-bfea-e869461510f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73143a267c38445eabd106950531c1fe)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:45.988542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf671b-bf1c-4462-bfea-e869461510f5 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:46.163781 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9ebf671b-bf1c-4462-bfea-e869461510f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73143a267c38445eabd106950531c1fe'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:46.164431 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9ebf671b-bf1c-4462-bfea-e869461510f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73143a267c38445eabd106950531c1fe'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:46.213492 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9ebf671b-bf1c-4462-bfea-e869461510f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73143a267c38445eabd106950531c1fe'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:46.214122 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9ebf671b-bf1c-4462-bfea-e869461510f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73143a267c38445eabd106950531c1fe'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:46.222267 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-9ebf671b-bf1c-4462-bfea-e869461510f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73143a267c38445eabd106950531c1fe'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:46.240614 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1427/2886] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:28:45 2022] DELETE /identity/v3/users/73143a267c38445eabd106950531c1fe => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:46.488916 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453182b0-71df-49d2-935b-9fa8121010f1 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:46.501403 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453182b0-71df-49d2-935b-9fa8121010f1 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:46.576433 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:46.577131 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:46.577393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:46.577720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] PATH_INFO: `/v3/projects/8f85140af1514dbf998aa6ffb8b48d28` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:46.578914 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f85140af1514dbf998aa6ffb8b48d28)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:46.581458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:46.688324 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f85140af1514dbf998aa6ffb8b48d28', 'request_id': 'req-55143bae-9d8f-47d7-bef6-0b97fed95466'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:46.693865 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f85140af1514dbf998aa6ffb8b48d28', 'request_id': 'req-55143bae-9d8f-47d7-bef6-0b97fed95466'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:46.700046 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f85140af1514dbf998aa6ffb8b48d28', 'request_id': 'req-55143bae-9d8f-47d7-bef6-0b97fed95466'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:46.800304 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] The token cache is being invalidate because project 8f85140af1514dbf998aa6ffb8b48d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:28:46.800591 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:46.801202 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-55143bae-9d8f-47d7-bef6-0b97fed95466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:28:46.802681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1460/2887] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:28:46 2022] DELETE /identity/v3/projects/8f85140af1514dbf998aa6ffb8b48d28 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:46.807671 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2dc93-7c02-40e2-89d0-a189f7cc71ec None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:46.807959 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2dc93-7c02-40e2-89d0-a189f7cc71ec None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:46.808320 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2dc93-7c02-40e2-89d0-a189f7cc71ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:46.828378 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-78c2dc93-7c02-40e2-89d0-a189f7cc71ec None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:46.829597 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-78c2dc93-7c02-40e2-89d0-a189f7cc71ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:46.891619 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1428/2888] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:46.900794 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151613ac-7374-4635-987d-cee388b12c22 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:46.901108 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151613ac-7374-4635-987d-cee388b12c22 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:46.901419 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151613ac-7374-4635-987d-cee388b12c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:46.921834 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-151613ac-7374-4635-987d-cee388b12c22 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:46.924873 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-151613ac-7374-4635-987d-cee388b12c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:46.931932 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1461/2889] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:46.936215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2dc93-7c02-40e2-89d0-a189f7cc71ec None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:46.946589 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2dc93-7c02-40e2-89d0-a189f7cc71ec None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:46.951399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5d3b5-4d36-4486-b7b1-fb947517a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:46.953600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5d3b5-4d36-4486-b7b1-fb947517a5ea admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:46.953600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5d3b5-4d36-4486-b7b1-fb947517a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:46.953600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5d3b5-4d36-4486-b7b1-fb947517a5ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:46.953600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5d3b5-4d36-4486-b7b1-fb947517a5ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81696) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:28:46.953600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5d3b5-4d36-4486-b7b1-fb947517a5ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:46.955137 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5d3b5-4d36-4486-b7b1-fb947517a5ea admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:46.967540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1429/2890] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:28:46.971984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151613ac-7374-4635-987d-cee388b12c22 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:46.982018 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151613ac-7374-4635-987d-cee388b12c22 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:46.986867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fc902-dfdd-4157-832a-1994999a3fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:46.988054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fc902-dfdd-4157-832a-1994999a3fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:46.988054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fc902-dfdd-4157-832a-1994999a3fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:46.988054 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fc902-dfdd-4157-832a-1994999a3fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:46.988723 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fc902-dfdd-4157-832a-1994999a3fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:46.990624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fc902-dfdd-4157-832a-1994999a3fc7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:47.007625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:47.080195 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1462/2891] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:46 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:47.082331 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5d3b5-4d36-4486-b7b1-fb947517a5ea admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:47.092784 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5d3b5-4d36-4486-b7b1-fb947517a5ea admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:47.096804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:47.153742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0a2eb-f884-4304-be15-a4b9a3f5b7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:47.154517 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0a2eb-f884-4304-be15-a4b9a3f5b7fc admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:47.154858 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0a2eb-f884-4304-be15-a4b9a3f5b7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:47.155135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0a2eb-f884-4304-be15-a4b9a3f5b7fc admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:47.155827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0a2eb-f884-4304-be15-a4b9a3f5b7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:47.157776 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0a2eb-f884-4304-be15-a4b9a3f5b7fc admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:47.247468 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1430/2892] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:47 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:47.250930 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fc902-dfdd-4157-832a-1994999a3fc7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:47.262532 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fc902-dfdd-4157-832a-1994999a3fc7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:47.267346 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66cc57-8815-4590-b0f6-87efca12f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:47.267982 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66cc57-8815-4590-b0f6-87efca12f59a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:47.268253 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66cc57-8815-4590-b0f6-87efca12f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:47.268517 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66cc57-8815-4590-b0f6-87efca12f59a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:47.269149 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66cc57-8815-4590-b0f6-87efca12f59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:47.270759 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66cc57-8815-4590-b0f6-87efca12f59a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:47.280941 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1463/2893] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:47.284748 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0a2eb-f884-4304-be15-a4b9a3f5b7fc admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:47.295108 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0a2eb-f884-4304-be15-a4b9a3f5b7fc admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:47.300600 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227822c-ca53-4407-b206-bf40f8e52704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:47.303769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227822c-ca53-4407-b206-bf40f8e52704 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:47.303769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227822c-ca53-4407-b206-bf40f8e52704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:47.303769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227822c-ca53-4407-b206-bf40f8e52704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:47.303769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227822c-ca53-4407-b206-bf40f8e52704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:47.304242 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227822c-ca53-4407-b206-bf40f8e52704 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:47.314326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1431/2894] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:47.318870 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66cc57-8815-4590-b0f6-87efca12f59a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:47.328871 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66cc57-8815-4590-b0f6-87efca12f59a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:47.333510 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27351c68-6680-4491-b68d-cc2ab7120bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:47.334143 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27351c68-6680-4491-b68d-cc2ab7120bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:47.334421 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27351c68-6680-4491-b68d-cc2ab7120bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:47.334730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27351c68-6680-4491-b68d-cc2ab7120bdc admin admin] PATH_INFO: `/v3/projects/c1acc4544d504537b9922042568a49a0/users/7639fc147cca4f46bd51d82786b29458/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:47.350286 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27351c68-6680-4491-b68d-cc2ab7120bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1acc4544d504537b9922042568a49a0, user_id=7639fc147cca4f46bd51d82786b29458, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:47.352954 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27351c68-6680-4491-b68d-cc2ab7120bdc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:47.447278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1464/2895] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:47 2022] PUT /identity/v3/projects/c1acc4544d504537b9922042568a49a0/users/7639fc147cca4f46bd51d82786b29458/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 16:28:47.454439 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260f138-e945-4483-8474-3539ffbda456 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:47.454751 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260f138-e945-4483-8474-3539ffbda456 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:47.455071 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260f138-e945-4483-8474-3539ffbda456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:47.474675 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-1260f138-e945-4483-8474-3539ffbda456 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:47.475952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1260f138-e945-4483-8474-3539ffbda456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:47.533502 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1432/2896] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:47.543642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27351c68-6680-4491-b68d-cc2ab7120bdc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:47.545338 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-27351c68-6680-4491-b68d-cc2ab7120bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:47.601683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27351c68-6680-4491-b68d-cc2ab7120bdc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:47.605426 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ba82-b1d4-4321-9dd5-f5fc763b2da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:47.606028 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ba82-b1d4-4321-9dd5-f5fc763b2da7 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:47.606305 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ba82-b1d4-4321-9dd5-f5fc763b2da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:47.606577 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ba82-b1d4-4321-9dd5-f5fc763b2da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:47.616786 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ba82-b1d4-4321-9dd5-f5fc763b2da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:47.618250 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ba82-b1d4-4321-9dd5-f5fc763b2da7 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:47.627809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1465/2897] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:28:53.337850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5876c3-cc4e-4ff6-bb12-be0c08627156 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:53.338311 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5876c3-cc4e-4ff6-bb12-be0c08627156 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:53.338582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5876c3-cc4e-4ff6-bb12-be0c08627156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:53.369981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-be5876c3-cc4e-4ff6-bb12-be0c08627156 None None] MFA Rules not processed for user `7639fc147cca4f46bd51d82786b29458`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:53.375329 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-be5876c3-cc4e-4ff6-bb12-be0c08627156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:53.445540 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1433/2898] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:53.450413 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ba82-b1d4-4321-9dd5-f5fc763b2da7 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:53.461260 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ba82-b1d4-4321-9dd5-f5fc763b2da7 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:53.466110 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ac14-8ead-485b-bbbc-26e530e26282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:53.466760 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ac14-8ead-485b-bbbc-26e530e26282 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:53.467042 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ac14-8ead-485b-bbbc-26e530e26282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:53.467315 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ac14-8ead-485b-bbbc-26e530e26282 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:53.467963 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2ac14-8ead-485b-bbbc-26e530e26282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:53.469897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2ac14-8ead-485b-bbbc-26e530e26282 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:53.552954 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1466/2899] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:28:53 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:53.557465 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5876c3-cc4e-4ff6-bb12-be0c08627156 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:53.571485 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5876c3-cc4e-4ff6-bb12-be0c08627156 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:53.584820 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:53.636053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100415a-22a7-43e3-8f08-7d03d6ebb13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:53.636755 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100415a-22a7-43e3-8f08-7d03d6ebb13c admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:53.637133 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100415a-22a7-43e3-8f08-7d03d6ebb13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:53.637472 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100415a-22a7-43e3-8f08-7d03d6ebb13c admin admin] PATH_INFO: `/v3/users` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:53.638172 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100415a-22a7-43e3-8f08-7d03d6ebb13c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:53.640176 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100415a-22a7-43e3-8f08-7d03d6ebb13c admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:53.744860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1434/2900] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:28:53 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 16:28:53.749401 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ac14-8ead-485b-bbbc-26e530e26282 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:53.761884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ac14-8ead-485b-bbbc-26e530e26282 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:53.766493 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bcbbb-c3e2-409f-8cc6-054c24e01ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:53.767352 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bcbbb-c3e2-409f-8cc6-054c24e01ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:53.769494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bcbbb-c3e2-409f-8cc6-054c24e01ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:53.769494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bcbbb-c3e2-409f-8cc6-054c24e01ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:53.769494 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bcbbb-c3e2-409f-8cc6-054c24e01ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:53.770221 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bcbbb-c3e2-409f-8cc6-054c24e01ef9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:53.782172 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1467/2901] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:28:53.787026 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100415a-22a7-43e3-8f08-7d03d6ebb13c admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:53.788706 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3764f-7084-4778-90e0-7f55391efa19 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:53.789052 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3764f-7084-4778-90e0-7f55391efa19 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:53.789409 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3764f-7084-4778-90e0-7f55391efa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:53.800270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100415a-22a7-43e3-8f08-7d03d6ebb13c admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:53.806524 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a079d4-7fbf-41f3-a401-a7dda1bd7102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:53.807847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a079d4-7fbf-41f3-a401-a7dda1bd7102 admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:53.808402 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a079d4-7fbf-41f3-a401-a7dda1bd7102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:53.811555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a079d4-7fbf-41f3-a401-a7dda1bd7102 admin admin] PATH_INFO: `/v3/projects/75aecc7d0d61432ba06577458e59f757/users/88b31f9d11ad41dd99c124cad7fcd913/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:53.829183 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a079d4-7fbf-41f3-a401-a7dda1bd7102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75aecc7d0d61432ba06577458e59f757, user_id=88b31f9d11ad41dd99c124cad7fcd913, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:53.831923 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a079d4-7fbf-41f3-a401-a7dda1bd7102 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:53.859095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c3a3764f-7084-4778-90e0-7f55391efa19 None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:53.860377 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c3a3764f-7084-4778-90e0-7f55391efa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:53.901474 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1435/2902] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:53 2022] PUT /identity/v3/projects/75aecc7d0d61432ba06577458e59f757/users/88b31f9d11ad41dd99c124cad7fcd913/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:53.905568 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a079d4-7fbf-41f3-a401-a7dda1bd7102 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:53.959073 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1468/2903] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:53.985796 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a079d4-7fbf-41f3-a401-a7dda1bd7102 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:53.992180 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75e26-f0af-42de-8d2c-99c0d0a6f711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:53.992870 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75e26-f0af-42de-8d2c-99c0d0a6f711 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:53.993227 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75e26-f0af-42de-8d2c-99c0d0a6f711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:53.993726 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75e26-f0af-42de-8d2c-99c0d0a6f711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:53.994565 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa75e26-f0af-42de-8d2c-99c0d0a6f711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:53.996307 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa75e26-f0af-42de-8d2c-99c0d0a6f711 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:54.006654 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1436/2904] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 16:28:54.010778 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3764f-7084-4778-90e0-7f55391efa19 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:54.016829 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:54.023220 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3764f-7084-4778-90e0-7f55391efa19 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:54.027895 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65386a0-0fe5-41e7-81bf-9e4074e1078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:54.028582 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65386a0-0fe5-41e7-81bf-9e4074e1078a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:54.028863 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65386a0-0fe5-41e7-81bf-9e4074e1078a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:54.029136 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65386a0-0fe5-41e7-81bf-9e4074e1078a admin admin] PATH_INFO: `/v3/projects/75aecc7d0d61432ba06577458e59f757/users/88b31f9d11ad41dd99c124cad7fcd913/roles/519b356d36364663a59265dc7eeff0b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:54.031157 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65386a0-0fe5-41e7-81bf-9e4074e1078a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75aecc7d0d61432ba06577458e59f757, user_id=88b31f9d11ad41dd99c124cad7fcd913, role_id=519b356d36364663a59265dc7eeff0b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:54.034416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65386a0-0fe5-41e7-81bf-9e4074e1078a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:54.045116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1469/2905] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:28:54 2022] PUT /identity/v3/projects/75aecc7d0d61432ba06577458e59f757/users/88b31f9d11ad41dd99c124cad7fcd913/roles/519b356d36364663a59265dc7eeff0b8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:28:54.115981 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75e26-f0af-42de-8d2c-99c0d0a6f711 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:54.117826 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-cfa75e26-f0af-42de-8d2c-99c0d0a6f711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:54.217542 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:28:54.227765 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75e26-f0af-42de-8d2c-99c0d0a6f711 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:54.291162 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa119911-a978-49be-aea9-53080dca20bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:54.291774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa119911-a978-49be-aea9-53080dca20bc service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:54.292048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa119911-a978-49be-aea9-53080dca20bc service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:54.292319 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa119911-a978-49be-aea9-53080dca20bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:54.350836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa119911-a978-49be-aea9-53080dca20bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:54.352505 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa119911-a978-49be-aea9-53080dca20bc service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:54.361177 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1437/2906] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:28:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:28:55.327082 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5453b-c575-4f4f-b08e-f65ccc0965ff None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:55.327878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5453b-c575-4f4f-b08e-f65ccc0965ff None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:55.327878 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5453b-c575-4f4f-b08e-f65ccc0965ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:55.365736 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-16e5453b-c575-4f4f-b08e-f65ccc0965ff None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:55.367039 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-16e5453b-c575-4f4f-b08e-f65ccc0965ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:55.375347 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1470/2907] 10.222.0.23 () {58 vars in 967 bytes} [Thu Sep 8 16:28:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:55.389081 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa119911-a978-49be-aea9-53080dca20bc service swift] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:55.401224 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa119911-a978-49be-aea9-53080dca20bc service swift] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:55.406789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64c090-e496-4e0f-9c2f-a2514a49ca4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:55.407779 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64c090-e496-4e0f-9c2f-a2514a49ca4b service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:55.408038 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64c090-e496-4e0f-9c2f-a2514a49ca4b service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:55.408316 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64c090-e496-4e0f-9c2f-a2514a49ca4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:55.431398 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64c090-e496-4e0f-9c2f-a2514a49ca4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:55.431398 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab64c090-e496-4e0f-9c2f-a2514a49ca4b service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:55.439403 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1438/2908] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:28:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:28:56.200363 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e905351-08ac-46b3-8aad-7f4a3a4c6aef None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:56.204745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e905351-08ac-46b3-8aad-7f4a3a4c6aef None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:56.204745 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e905351-08ac-46b3-8aad-7f4a3a4c6aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:56.223849 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7e905351-08ac-46b3-8aad-7f4a3a4c6aef None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:56.225104 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7e905351-08ac-46b3-8aad-7f4a3a4c6aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:56.237474 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1471/2909] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:56.250586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64c090-e496-4e0f-9c2f-a2514a49ca4b service swift] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:56.262500 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64c090-e496-4e0f-9c2f-a2514a49ca4b service swift] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:56.268326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fde0b-54db-4151-aa48-6ffa24b13537 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:56.268985 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fde0b-54db-4151-aa48-6ffa24b13537 service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:56.269205 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fde0b-54db-4151-aa48-6ffa24b13537 service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:56.269709 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fde0b-54db-4151-aa48-6ffa24b13537 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:56.285251 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fde0b-54db-4151-aa48-6ffa24b13537 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:56.287350 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fde0b-54db-4151-aa48-6ffa24b13537 service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:56.297076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1439/2910] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:28:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:28:57.193295 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1215-a838-4f19-b06b-cd270dbe36de None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:57.193785 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1215-a838-4f19-b06b-cd270dbe36de None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:57.193897 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1215-a838-4f19-b06b-cd270dbe36de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:57.241281 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b07a1215-a838-4f19-b06b-cd270dbe36de None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:28:57.242925 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b07a1215-a838-4f19-b06b-cd270dbe36de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:28:57.257883 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1472/2911] 10.222.0.23 () {58 vars in 967 bytes} [Thu Sep 8 16:28:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:28:57.266836 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fde0b-54db-4151-aa48-6ffa24b13537 service swift] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:28:57.285206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fde0b-54db-4151-aa48-6ffa24b13537 service swift] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:28:57.325965 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8ffcc-623b-427b-be6f-6bda6b069fd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:28:57.326599 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8ffcc-623b-427b-be6f-6bda6b069fd5 service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:28:57.328189 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8ffcc-623b-427b-be6f-6bda6b069fd5 service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:28:57.328469 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8ffcc-623b-427b-be6f-6bda6b069fd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:28:57.338744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8ffcc-623b-427b-be6f-6bda6b069fd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:28:57.341041 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8ffcc-623b-427b-be6f-6bda6b069fd5 service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:28:57.356528 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1440/2912] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:28:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:29:00.562069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e05384-a0a6-4be3-a87d-87b7ac94fcdd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:00.562544 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e05384-a0a6-4be3-a87d-87b7ac94fcdd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:00.562927 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e05384-a0a6-4be3-a87d-87b7ac94fcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:00.597625 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-81e05384-a0a6-4be3-a87d-87b7ac94fcdd None None] MFA Rules not processed for user `88b31f9d11ad41dd99c124cad7fcd913`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:29:00.599125 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-81e05384-a0a6-4be3-a87d-87b7ac94fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:00.683258 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1473/2913] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:29:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:29:00.695555 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8ffcc-623b-427b-be6f-6bda6b069fd5 service swift] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:00.697107 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f9c8ffcc-623b-427b-be6f-6bda6b069fd5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:00.761863 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8ffcc-623b-427b-be6f-6bda6b069fd5 service swift] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:00.765586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71593b-1a8d-4680-a5f2-b504a07a2bd6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0892bfab3ce435b90b93b0786899f84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:00.766195 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71593b-1a8d-4680-a5f2-b504a07a2bd6 service glance] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:00.766473 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71593b-1a8d-4680-a5f2-b504a07a2bd6 service glance] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:00.766785 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71593b-1a8d-4680-a5f2-b504a07a2bd6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:00.783153 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=100 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:29:00.803227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e05384-a0a6-4be3-a87d-87b7ac94fcdd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:00.804705 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-81e05384-a0a6-4be3-a87d-87b7ac94fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:00.833380 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71593b-1a8d-4680-a5f2-b504a07a2bd6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:00.834980 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71593b-1a8d-4680-a5f2-b504a07a2bd6 service glance] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:00.845270 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1441/2914] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:29:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:29:00.885181 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e05384-a0a6-4be3-a87d-87b7ac94fcdd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:00.890452 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a188c2d-a7b7-4ef5-80cc-5c8d08bc9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:00.891142 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188c2d-a7b7-4ef5-80cc-5c8d08bc9497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:00.891566 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188c2d-a7b7-4ef5-80cc-5c8d08bc9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:00.891848 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188c2d-a7b7-4ef5-80cc-5c8d08bc9497 admin admin] PATH_INFO: `/v3/users/763bbd6b18374ad38899057abed6902a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:00.893738 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a188c2d-a7b7-4ef5-80cc-5c8d08bc9497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=763bbd6b18374ad38899057abed6902a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:00.895758 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a188c2d-a7b7-4ef5-80cc-5c8d08bc9497 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:01.153915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5a188c2d-a7b7-4ef5-80cc-5c8d08bc9497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763bbd6b18374ad38899057abed6902a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:01.154820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5a188c2d-a7b7-4ef5-80cc-5c8d08bc9497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763bbd6b18374ad38899057abed6902a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:01.261884 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5a188c2d-a7b7-4ef5-80cc-5c8d08bc9497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763bbd6b18374ad38899057abed6902a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:01.264146 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5a188c2d-a7b7-4ef5-80cc-5c8d08bc9497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763bbd6b18374ad38899057abed6902a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:01.267227 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:29:01.275116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5a188c2d-a7b7-4ef5-80cc-5c8d08bc9497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763bbd6b18374ad38899057abed6902a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:01.291579 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49974a6-2dc6-4eba-825b-c1fac68c2aea None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:01.291861 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49974a6-2dc6-4eba-825b-c1fac68c2aea None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:01.292158 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49974a6-2dc6-4eba-825b-c1fac68c2aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:01.303457 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1474/2915] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:29:00 2022] DELETE /identity/v3/users/763bbd6b18374ad38899057abed6902a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:29:01.308458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b2f25-a132-4a2c-8c9f-1b3397710bf8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:01.308737 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b2f25-a132-4a2c-8c9f-1b3397710bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:01.309005 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b2f25-a132-4a2c-8c9f-1b3397710bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:01.320675 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-a49974a6-2dc6-4eba-825b-c1fac68c2aea None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:29:01.322145 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a49974a6-2dc6-4eba-825b-c1fac68c2aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:01.331571 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4d4b2f25-a132-4a2c-8c9f-1b3397710bf8 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:29:01.333001 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4d4b2f25-a132-4a2c-8c9f-1b3397710bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:01.379893 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1442/2916] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:29:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:29:01.391742 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49974a6-2dc6-4eba-825b-c1fac68c2aea None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:01.393634 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a49974a6-2dc6-4eba-825b-c1fac68c2aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:01.399820 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1475/2917] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:29:01.415171 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b2f25-a132-4a2c-8c9f-1b3397710bf8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:01.416764 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4d4b2f25-a132-4a2c-8c9f-1b3397710bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:01.469318 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49974a6-2dc6-4eba-825b-c1fac68c2aea None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:01.474691 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257e0e0-bdb0-4663-b9ce-e5a047751874 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:01.475323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e0e0-bdb0-4663-b9ce-e5a047751874 service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:01.475602 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e0e0-bdb0-4663-b9ce-e5a047751874 service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:01.475880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e0e0-bdb0-4663-b9ce-e5a047751874 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:01.479846 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b2f25-a132-4a2c-8c9f-1b3397710bf8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:01.485334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257e0e0-bdb0-4663-b9ce-e5a047751874 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:01.485688 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f450b-7e0a-465c-a6f7-bd1e0188fd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:01.486981 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f450b-7e0a-465c-a6f7-bd1e0188fd56 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:01.487366 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f450b-7e0a-465c-a6f7-bd1e0188fd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:01.487649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257e0e0-bdb0-4663-b9ce-e5a047751874 service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:01.487828 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f450b-7e0a-465c-a6f7-bd1e0188fd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:01.496293 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1443/2918] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:29:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 16:29:01.498358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f450b-7e0a-465c-a6f7-bd1e0188fd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:01.499867 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f450b-7e0a-465c-a6f7-bd1e0188fd56 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:01.511398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1476/2919] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:29:01.799625 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257e0e0-bdb0-4663-b9ce-e5a047751874 service swift] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:01.800332 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-3257e0e0-bdb0-4663-b9ce-e5a047751874 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:01.821790 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257e0e0-bdb0-4663-b9ce-e5a047751874 service swift] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:01.827156 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:01.829209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:01.829209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:01.829209 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] PATH_INFO: `/v3/projects/e436302de1fc42478064340e4a483b6b` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:01.830281 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e436302de1fc42478064340e4a483b6b)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:01.832527 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:01.958326 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:29:01.961384 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e436302de1fc42478064340e4a483b6b', 'request_id': 'req-b511af87-a91f-4062-8a3d-47350c7901db'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:01.967203 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e436302de1fc42478064340e4a483b6b', 'request_id': 'req-b511af87-a91f-4062-8a3d-47350c7901db'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:01.977151 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e436302de1fc42478064340e4a483b6b', 'request_id': 'req-b511af87-a91f-4062-8a3d-47350c7901db'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:02.088695 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] The token cache is being invalidate because project e436302de1fc42478064340e4a483b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:29:02.089272 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:02.090085 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-b511af87-a91f-4062-8a3d-47350c7901db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:02.092023 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1444/2920] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:29:01 2022] DELETE /identity/v3/projects/e436302de1fc42478064340e4a483b6b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:29:04.876431 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f450b-7e0a-465c-a6f7-bd1e0188fd56 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:04.877853 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e61f450b-7e0a-465c-a6f7-bd1e0188fd56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:04.890844 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f450b-7e0a-465c-a6f7-bd1e0188fd56 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:04.949599 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:04.950505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:04.950505 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:04.950869 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] PATH_INFO: `/v3/users/89ad6d5543fd49b1b3187f223b49928a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:04.952187 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ad6d5543fd49b1b3187f223b49928a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:04.954370 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:04.980464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:29:05.194098 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ad6d5543fd49b1b3187f223b49928a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:05.194894 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ad6d5543fd49b1b3187f223b49928a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:05.271750 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ad6d5543fd49b1b3187f223b49928a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:05.272539 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ad6d5543fd49b1b3187f223b49928a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:05.288116 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ad6d5543fd49b1b3187f223b49928a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:05.326576 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1477/2921] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:29:04 2022] DELETE /identity/v3/users/89ad6d5543fd49b1b3187f223b49928a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:29:05.331587 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd400e-e8f3-43c1-82e8-dff69017845a None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:05.332421 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd400e-e8f3-43c1-82e8-dff69017845a None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:05.332867 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd400e-e8f3-43c1-82e8-dff69017845a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:05.355076 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-e2dd400e-e8f3-43c1-82e8-dff69017845a None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:29:05.356596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e2dd400e-e8f3-43c1-82e8-dff69017845a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:05.430706 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1445/2922] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:29:05.440996 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:05.442465 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:05.518540 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cd683-3a48-4d84-b36a-e88c72118232 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:05.523240 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72f743-0053-460c-b09d-13c50ad2a831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:05.523951 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f743-0053-460c-b09d-13c50ad2a831 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:05.524222 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f743-0053-460c-b09d-13c50ad2a831 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:05.524487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72f743-0053-460c-b09d-13c50ad2a831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:05.536398 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72f743-0053-460c-b09d-13c50ad2a831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:05.542520 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72f743-0053-460c-b09d-13c50ad2a831 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:05.552272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1478/2923] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 16:29:06.093349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd400e-e8f3-43c1-82e8-dff69017845a None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:06.095675 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-e2dd400e-e8f3-43c1-82e8-dff69017845a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:06.127822 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd400e-e8f3-43c1-82e8-dff69017845a None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:06.134167 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:06.134856 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:06.135170 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:06.135410 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] PATH_INFO: `/v3/projects/8809a32ff62c45d18665c091f495635b` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:06.136789 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8809a32ff62c45d18665c091f495635b)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:06.138901 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:06.248087 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8809a32ff62c45d18665c091f495635b', 'request_id': 'req-747dba91-2727-45a0-bf3e-ee6163ea67e3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:06.255321 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8809a32ff62c45d18665c091f495635b', 'request_id': 'req-747dba91-2727-45a0-bf3e-ee6163ea67e3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:06.264938 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8809a32ff62c45d18665c091f495635b', 'request_id': 'req-747dba91-2727-45a0-bf3e-ee6163ea67e3'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:06.339724 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] The token cache is being invalidate because project 8809a32ff62c45d18665c091f495635b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:29:06.340430 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:06.340850 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-747dba91-2727-45a0-bf3e-ee6163ea67e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:06.346791 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1446/2924] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:29:06 2022] DELETE /identity/v3/projects/8809a32ff62c45d18665c091f495635b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:29:06.348389 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306420d-b761-4057-b785-4990d50d033c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:06.349923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306420d-b761-4057-b785-4990d50d033c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:06.349923 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306420d-b761-4057-b785-4990d50d033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:06.370987 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f306420d-b761-4057-b785-4990d50d033c None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:29:06.372458 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f306420d-b761-4057-b785-4990d50d033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:06.450646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1479/2925] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:29:06.461083 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dccba-ef8a-4306-b3c4-b451a5e41cc9 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:06.461711 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dccba-ef8a-4306-b3c4-b451a5e41cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:06.462202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dccba-ef8a-4306-b3c4-b451a5e41cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:06.487356 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-0f5dccba-ef8a-4306-b3c4-b451a5e41cc9 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:29:06.488493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-0f5dccba-ef8a-4306-b3c4-b451a5e41cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:06.498417 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1447/2926] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:29:06.502809 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306420d-b761-4057-b785-4990d50d033c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:06.512882 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306420d-b761-4057-b785-4990d50d033c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:06.518797 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4827533-c60b-4dd4-ac98-12d6b9e2ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:06.519502 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827533-c60b-4dd4-ac98-12d6b9e2ad25 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:06.519847 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827533-c60b-4dd4-ac98-12d6b9e2ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:06.520180 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827533-c60b-4dd4-ac98-12d6b9e2ad25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:06.520898 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4827533-c60b-4dd4-ac98-12d6b9e2ad25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 16:29:06.521265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4827533-c60b-4dd4-ac98-12d6b9e2ad25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:06.523602 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4827533-c60b-4dd4-ac98-12d6b9e2ad25 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:06.539866 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1480/2927] 10.222.0.23 () {58 vars in 1153 bytes} [Thu Sep 8 16:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 16:29:06.543106 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dccba-ef8a-4306-b3c4-b451a5e41cc9 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:06.553768 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dccba-ef8a-4306-b3c4-b451a5e41cc9 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:06.560847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714d42a-5d21-4329-b3d1-ebe89716a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:06.561547 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714d42a-5d21-4329-b3d1-ebe89716a3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:06.561903 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714d42a-5d21-4329-b3d1-ebe89716a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:06.562290 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714d42a-5d21-4329-b3d1-ebe89716a3b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:06.563051 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714d42a-5d21-4329-b3d1-ebe89716a3b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:06.565180 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714d42a-5d21-4329-b3d1-ebe89716a3b4 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:06.681022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1448/2928] 10.222.0.23 () {60 vars in 1153 bytes} [Thu Sep 8 16:29:06 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:29:06.682176 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4827533-c60b-4dd4-ac98-12d6b9e2ad25 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:06.696266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4827533-c60b-4dd4-ac98-12d6b9e2ad25 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:06.731378 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:29:06.775296 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0fcb2-1a39-438d-9991-43dd7705cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:06.776231 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0fcb2-1a39-438d-9991-43dd7705cc96 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:06.776681 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0fcb2-1a39-438d-9991-43dd7705cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:06.777188 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0fcb2-1a39-438d-9991-43dd7705cc96 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:06.777803 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0fcb2-1a39-438d-9991-43dd7705cc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:06.780851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0fcb2-1a39-438d-9991-43dd7705cc96 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:06.870254 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1481/2929] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Sep 8 16:29:06 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 16:29:06.872610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714d42a-5d21-4329-b3d1-ebe89716a3b4 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:06.890854 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714d42a-5d21-4329-b3d1-ebe89716a3b4 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:06.904390 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36261af6-8f9a-47d4-8247-9efccf1617a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:06.905023 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36261af6-8f9a-47d4-8247-9efccf1617a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:06.905300 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36261af6-8f9a-47d4-8247-9efccf1617a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:06.905566 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36261af6-8f9a-47d4-8247-9efccf1617a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:06.906215 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36261af6-8f9a-47d4-8247-9efccf1617a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:06.907847 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36261af6-8f9a-47d4-8247-9efccf1617a8 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:06.934007 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1449/2930] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:29:06.936481 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0fcb2-1a39-438d-9991-43dd7705cc96 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:06.949416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0fcb2-1a39-438d-9991-43dd7705cc96 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:06.957101 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76a51c-bf7c-435f-b563-08425cd9b50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:06.957943 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76a51c-bf7c-435f-b563-08425cd9b50c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:06.958390 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76a51c-bf7c-435f-b563-08425cd9b50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:06.958904 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76a51c-bf7c-435f-b563-08425cd9b50c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:06.959727 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76a51c-bf7c-435f-b563-08425cd9b50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:06.963711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76a51c-bf7c-435f-b563-08425cd9b50c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:06.976069 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1482/2931] 10.222.0.23 () {58 vars in 1122 bytes} [Thu Sep 8 16:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 16:29:06.980030 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36261af6-8f9a-47d4-8247-9efccf1617a8 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:06.995923 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36261af6-8f9a-47d4-8247-9efccf1617a8 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:07.003721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb3602-4479-4a52-87fd-f3d5d221a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:07.004487 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb3602-4479-4a52-87fd-f3d5d221a41e admin admin] REQUEST_METHOD: `PUT` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:07.004890 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb3602-4479-4a52-87fd-f3d5d221a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:07.005395 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb3602-4479-4a52-87fd-f3d5d221a41e admin admin] PATH_INFO: `/v3/projects/5e880811868f40508daf8508a7292271/users/d918de67e2fe4b3d9a8ad61db6dd3dce/roles/6ba784d4bd374e1793729d1ff430e45f` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:07.026218 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb3602-4479-4a52-87fd-f3d5d221a41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e880811868f40508daf8508a7292271, user_id=d918de67e2fe4b3d9a8ad61db6dd3dce, role_id=6ba784d4bd374e1793729d1ff430e45f)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:07.029239 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb3602-4479-4a52-87fd-f3d5d221a41e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:07.032230 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:29:07.114023 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1450/2932] 10.222.0.23 () {60 vars in 1483 bytes} [Thu Sep 8 16:29:06 2022] PUT /identity/v3/projects/5e880811868f40508daf8508a7292271/users/d918de67e2fe4b3d9a8ad61db6dd3dce/roles/6ba784d4bd374e1793729d1ff430e45f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:29:07.119541 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64d481-6165-4fe1-b8c8-8139ca25a3cd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:07.119907 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64d481-6165-4fe1-b8c8-8139ca25a3cd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:07.120278 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64d481-6165-4fe1-b8c8-8139ca25a3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:07.160299 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5c64d481-6165-4fe1-b8c8-8139ca25a3cd None None] MFA Rules not processed for user `d918de67e2fe4b3d9a8ad61db6dd3dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:29:07.161631 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5c64d481-6165-4fe1-b8c8-8139ca25a3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:07.245574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1483/2933] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:29:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:29:07.257126 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb3602-4479-4a52-87fd-f3d5d221a41e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:07.259483 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-5adb3602-4479-4a52-87fd-f3d5d221a41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:07.342573 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb3602-4479-4a52-87fd-f3d5d221a41e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:07.348952 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f76245-bd77-41ce-a043-9a7319659472 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1d9c18139104883848f3ba22b38b360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:07.349578 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f76245-bd77-41ce-a043-9a7319659472 service cinder] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:07.349857 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f76245-bd77-41ce-a043-9a7319659472 service cinder] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:07.350129 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f76245-bd77-41ce-a043-9a7319659472 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:07.359428 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f76245-bd77-41ce-a043-9a7319659472 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:07.360874 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f76245-bd77-41ce-a043-9a7319659472 service cinder] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:07.375979 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1451/2934] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:29:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:29:10.874322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64d481-6165-4fe1-b8c8-8139ca25a3cd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:10.944122 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64d481-6165-4fe1-b8c8-8139ca25a3cd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:10.948755 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:10.949388 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:10.949665 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:10.949984 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] PATH_INFO: `/v3/users/d918de67e2fe4b3d9a8ad61db6dd3dce` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:10.951140 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d918de67e2fe4b3d9a8ad61db6dd3dce)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:10.953083 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:11.293265 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:29:11.303394 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd918de67e2fe4b3d9a8ad61db6dd3dce'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:11.304238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd918de67e2fe4b3d9a8ad61db6dd3dce'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:11.349829 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd918de67e2fe4b3d9a8ad61db6dd3dce'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:11.352246 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd918de67e2fe4b3d9a8ad61db6dd3dce'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:11.359056 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd918de67e2fe4b3d9a8ad61db6dd3dce'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:11.381964 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1484/2935] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:29:10 2022] DELETE /identity/v3/users/d918de67e2fe4b3d9a8ad61db6dd3dce => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:29:11.386721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e68916-f6c3-4bb4-9e57-e71863fd2769 None None] REQUEST_METHOD: `POST` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:11.387212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e68916-f6c3-4bb4-9e57-e71863fd2769 None None] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:11.387343 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e68916-f6c3-4bb4-9e57-e71863fd2769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:11.416541 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.auth.core [None req-b0e68916-f6c3-4bb4-9e57-e71863fd2769 None None] MFA Rules not processed for user `36773b7875fb4147ba998e41ff5a8fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81696) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:29:11.417804 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b0e68916-f6c3-4bb4-9e57-e71863fd2769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:11.493906 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1452/2936] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:29:11.503774 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:11.505184 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:11.576272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9d96a-326d-4324-87b1-cc1d76d407e1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:11.580152 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da0dcf-ce06-47a2-8c69-15f4427b521f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:11.581358 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da0dcf-ce06-47a2-8c69-15f4427b521f service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:11.581701 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da0dcf-ce06-47a2-8c69-15f4427b521f service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:11.581965 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da0dcf-ce06-47a2-8c69-15f4427b521f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:11.591551 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da0dcf-ce06-47a2-8c69-15f4427b521f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:11.592972 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da0dcf-ce06-47a2-8c69-15f4427b521f service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:11.604204 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1485/2937] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:29:12.095090 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e68916-f6c3-4bb4-9e57-e71863fd2769 None None] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:12.096690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-b0e68916-f6c3-4bb4-9e57-e71863fd2769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:12.108626 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e68916-f6c3-4bb4-9e57-e71863fd2769 None None] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:12.114099 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:12.117190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:12.117190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:12.117190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] PATH_INFO: `/v3/projects/5e880811868f40508daf8508a7292271` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:12.117190 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e880811868f40508daf8508a7292271)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:12.118325 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:12.230204 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e880811868f40508daf8508a7292271', 'request_id': 'req-a4a3108c-2ae6-45cb-9643-bbf313f33c17'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:12.235722 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e880811868f40508daf8508a7292271', 'request_id': 'req-a4a3108c-2ae6-45cb-9643-bbf313f33c17'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:12.242372 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e880811868f40508daf8508a7292271', 'request_id': 'req-a4a3108c-2ae6-45cb-9643-bbf313f33c17'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:12.315974 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f4868-fd70-4ff7-a713-3fe05b35eca2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:12.316484 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f4868-fd70-4ff7-a713-3fe05b35eca2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:12.316592 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f4868-fd70-4ff7-a713-3fe05b35eca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:12.332235 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] The token cache is being invalidate because project 5e880811868f40508daf8508a7292271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81696) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:29:12.332609 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:12.333204 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:29:12.334875 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1453/2938] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:29:12 2022] DELETE /identity/v3/projects/5e880811868f40508daf8508a7292271 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:29:12.336495 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fc3f4868-fd70-4ff7-a713-3fe05b35eca2 None None] MFA Rules not processed for user `7639fc147cca4f46bd51d82786b29458`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:29:12.337705 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fc3f4868-fd70-4ff7-a713-3fe05b35eca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:12.401009 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1486/2939] 10.222.0.23 () {58 vars in 958 bytes} [Thu Sep 8 16:29:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 16:29:12.675349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:12.676769 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:12.699721 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:29:12.734744 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3108c-2ae6-45cb-9643-bbf313f33c17 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:12.738315 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fcb97-4687-4eb4-8236-234d1b435c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:12.738942 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fcb97-4687-4eb4-8236-234d1b435c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:12.739216 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fcb97-4687-4eb4-8236-234d1b435c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:12.739484 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fcb97-4687-4eb4-8236-234d1b435c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:12.741197 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1b2fcb97-4687-4eb4-8236-234d1b435c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:12.750522 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fcb97-4687-4eb4-8236-234d1b435c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:12.751968 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fcb97-4687-4eb4-8236-234d1b435c8d service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:12.759910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1454/2940] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:29:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:29:15.843721 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bca4f-b65a-456a-b122-950d2186254d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:15.844601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bca4f-b65a-456a-b122-950d2186254d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:15.844601 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bca4f-b65a-456a-b122-950d2186254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:15.863961 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-923bca4f-b65a-456a-b122-950d2186254d None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:29:15.865320 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-923bca4f-b65a-456a-b122-950d2186254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:15.920634 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1487/2941] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Sep 8 16:29:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:29:15.934005 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fcb97-4687-4eb4-8236-234d1b435c8d service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:15.935452 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1b2fcb97-4687-4eb4-8236-234d1b435c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:16.007888 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fcb97-4687-4eb4-8236-234d1b435c8d service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:16.013173 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15052e5f-1777-42eb-9734-859b5c303a97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:16.013864 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15052e5f-1777-42eb-9734-859b5c303a97 service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:16.014200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15052e5f-1777-42eb-9734-859b5c303a97 service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:16.014535 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15052e5f-1777-42eb-9734-859b5c303a97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:16.023763 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15052e5f-1777-42eb-9734-859b5c303a97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:16.025409 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15052e5f-1777-42eb-9734-859b5c303a97 service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:16.042075 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1455/2942] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:29:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:29:25.913782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:29:26.031811 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=49 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:29:33.129913 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bca4f-b65a-456a-b122-950d2186254d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:33.131851 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-923bca4f-b65a-456a-b122-950d2186254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:33.208124 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bca4f-b65a-456a-b122-950d2186254d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:33.213702 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918f459-9c8e-46b5-ad58-5f2b7dbaebf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:33.214310 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f459-9c8e-46b5-ad58-5f2b7dbaebf0 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:33.214588 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f459-9c8e-46b5-ad58-5f2b7dbaebf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:33.214889 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f459-9c8e-46b5-ad58-5f2b7dbaebf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:33.216646 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9918f459-9c8e-46b5-ad58-5f2b7dbaebf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:33.229704 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918f459-9c8e-46b5-ad58-5f2b7dbaebf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:33.231322 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918f459-9c8e-46b5-ad58-5f2b7dbaebf0 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:33.243095 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1488/2943] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:29:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:29:41.070159 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15052e5f-1777-42eb-9734-859b5c303a97 service swift] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:29:41.071585 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-15052e5f-1777-42eb-9734-859b5c303a97 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:41.083872 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15052e5f-1777-42eb-9734-859b5c303a97 service swift] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:29:41.087455 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868176b0-322f-48c6-a5ef-592cb3ee7a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08c9de660c04ed98f6100be2d687ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:29:41.088048 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868176b0-322f-48c6-a5ef-592cb3ee7a73 service neutron] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:29:41.088323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868176b0-322f-48c6-a5ef-592cb3ee7a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:29:41.088596 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868176b0-322f-48c6-a5ef-592cb3ee7a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:29:41.090247 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-868176b0-322f-48c6-a5ef-592cb3ee7a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:29:41.151467 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868176b0-322f-48c6-a5ef-592cb3ee7a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:29:41.152910 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868176b0-322f-48c6-a5ef-592cb3ee7a73 service neutron] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:29:41.163059 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1456/2944] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:29:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:29:43.237720 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=34 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:29:51.158232 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=30 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:31:55.889730 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918f459-9c8e-46b5-ad58-5f2b7dbaebf0 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:31:55.891170 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9918f459-9c8e-46b5-ad58-5f2b7dbaebf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:31:55.959274 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918f459-9c8e-46b5-ad58-5f2b7dbaebf0 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:31:55.964275 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913197f9-7816-49d8-b437-cf53a631ae54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:31:55.964876 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913197f9-7816-49d8-b437-cf53a631ae54 service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:31:55.965150 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913197f9-7816-49d8-b437-cf53a631ae54 service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:31:55.965416 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913197f9-7816-49d8-b437-cf53a631ae54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:31:55.967272 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-913197f9-7816-49d8-b437-cf53a631ae54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:31:55.978650 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913197f9-7816-49d8-b437-cf53a631ae54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:31:55.980355 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913197f9-7816-49d8-b437-cf53a631ae54 service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:31:55.990686 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1489/2945] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:31:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:32:02.503304 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868176b0-322f-48c6-a5ef-592cb3ee7a73 service neutron] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:32:02.517871 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868176b0-322f-48c6-a5ef-592cb3ee7a73 service neutron] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:32:02.523876 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2ed9-64f6-41e3-a078-1d93343b0d33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f7a6292d004a648c3c92526d1304ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:32:02.524493 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2ed9-64f6-41e3-a078-1d93343b0d33 service nova] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:32:02.524774 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2ed9-64f6-41e3-a078-1d93343b0d33 service nova] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:32:02.525045 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2ed9-64f6-41e3-a078-1d93343b0d33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:32:02.526830 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-15ad2ed9-64f6-41e3-a078-1d93343b0d33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:32:02.542349 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad2ed9-64f6-41e3-a078-1d93343b0d33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:32:02.544012 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad2ed9-64f6-41e3-a078-1d93343b0d33 service nova] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:32:02.556690 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1457/2946] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:32:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:32:05.985956 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=32 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:32:11.249103 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d91ee-2120-4381-844f-195061a29848 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:32:11.249642 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d91ee-2120-4381-844f-195061a29848 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:32:11.249743 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d91ee-2120-4381-844f-195061a29848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:32:11.268978 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0c5d91ee-2120-4381-844f-195061a29848 None None] MFA Rules not processed for user `ce22dab95b864b84812335cc050ca2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 16:32:11.270838 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0c5d91ee-2120-4381-844f-195061a29848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:32:11.277805 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1490/2947] 10.222.0.23 () {58 vars in 967 bytes} [Thu Sep 8 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 16:32:11.317265 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2ed9-64f6-41e3-a078-1d93343b0d33 service nova] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:32:11.328623 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2ed9-64f6-41e3-a078-1d93343b0d33 service nova] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:32:11.334213 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a408ca6-858c-4424-a48b-d8edfcb49a11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50c9553845ba42e78de0293fd3a338d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:32:11.334837 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a408ca6-858c-4424-a48b-d8edfcb49a11 service swift] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:32:11.335119 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a408ca6-858c-4424-a48b-d8edfcb49a11 service swift] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:32:11.335411 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a408ca6-858c-4424-a48b-d8edfcb49a11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:32:11.343292 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a408ca6-858c-4424-a48b-d8edfcb49a11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:32:11.344914 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a408ca6-858c-4424-a48b-d8edfcb49a11 service swift] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:32:11.353313 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1458/2948] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Sep 8 16:32:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 16:32:15.393827 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d91ee-2120-4381-844f-195061a29848 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:32:15.407291 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d91ee-2120-4381-844f-195061a29848 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:32:15.416092 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cfa67-425a-4029-89b0-1b686cf1d157 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:32:15.416709 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cfa67-425a-4029-89b0-1b686cf1d157 service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:32:15.416985 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cfa67-425a-4029-89b0-1b686cf1d157 service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:32:15.417247 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cfa67-425a-4029-89b0-1b686cf1d157 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:32:15.419147 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a09cfa67-425a-4029-89b0-1b686cf1d157 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:32:15.432808 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cfa67-425a-4029-89b0-1b686cf1d157 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:32:15.440380 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cfa67-425a-4029-89b0-1b686cf1d157 service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:32:15.444593 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1491/2949] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:32:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:32:19.166399 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a408ca6-858c-4424-a48b-d8edfcb49a11 service swift] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:32:19.167916 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-1a408ca6-858c-4424-a48b-d8edfcb49a11 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:32:19.233288 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a408ca6-858c-4424-a48b-d8edfcb49a11 service swift] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:32:19.238010 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:32:19.238649 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:32:19.238962 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:32:19.239212 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] PATH_INFO: `/v3/users/7639fc147cca4f46bd51d82786b29458` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:32:19.240323 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7639fc147cca4f46bd51d82786b29458)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:32:19.242249 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:32:19.412443 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7639fc147cca4f46bd51d82786b29458'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:19.413053 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7639fc147cca4f46bd51d82786b29458'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:19.495408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7639fc147cca4f46bd51d82786b29458'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:19.496022 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7639fc147cca4f46bd51d82786b29458'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:19.503280 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7639fc147cca4f46bd51d82786b29458'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:19.521202 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1459/2950] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:32:19 2022] DELETE /identity/v3/users/7639fc147cca4f46bd51d82786b29458 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:32:19.771559 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cfa67-425a-4029-89b0-1b686cf1d157 service placement] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:32:19.782470 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cfa67-425a-4029-89b0-1b686cf1d157 service placement] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:32:19.840581 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:32:19.841205 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:32:19.841487 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:32:19.841765 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] PATH_INFO: `/v3/projects/c1acc4544d504537b9922042568a49a0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:32:19.842915 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1acc4544d504537b9922042568a49a0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:32:19.844824 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:32:19.941266 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1acc4544d504537b9922042568a49a0', 'request_id': 'req-254c03ac-f4c9-4d2b-968c-ebbce4181019'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:19.947287 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1acc4544d504537b9922042568a49a0', 'request_id': 'req-254c03ac-f4c9-4d2b-968c-ebbce4181019'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:19.953311 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1acc4544d504537b9922042568a49a0', 'request_id': 'req-254c03ac-f4c9-4d2b-968c-ebbce4181019'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.014393 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] The token cache is being invalidate because project c1acc4544d504537b9922042568a49a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:32:20.014640 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.015241 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.016711 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1492/2951] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:32:19 2022] DELETE /identity/v3/projects/c1acc4544d504537b9922042568a49a0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:32:20.020707 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:32:20.022092 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:32:20.034827 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583f327-a40c-45ea-8f5a-871bde1fc81e admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:32:20.081068 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:32:20.089706 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:32:20.090334 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:32:20.090610 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:32:20.090907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] PATH_INFO: `/v3/users/88b31f9d11ad41dd99c124cad7fcd913` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:32:20.092039 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b31f9d11ad41dd99c124cad7fcd913)` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:32:20.094021 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:32:20.274200 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b31f9d11ad41dd99c124cad7fcd913'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.274866 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b31f9d11ad41dd99c124cad7fcd913'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.333291 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b31f9d11ad41dd99c124cad7fcd913'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.333907 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b31f9d11ad41dd99c124cad7fcd913'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.341135 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.notifications [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b31f9d11ad41dd99c124cad7fcd913'} {{(pid=81696) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.358408 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1460/2952] 10.222.0.23 () {58 vars in 1224 bytes} [Thu Sep 8 16:32:20 2022] DELETE /identity/v3/users/88b31f9d11ad41dd99c124cad7fcd913 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:32:20.615753 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:32:20.617182 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:32:20.630782 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c03ac-f4c9-4d2b-968c-ebbce4181019 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:32:20.688293 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36773b7875fb4147ba998e41ff5a8fe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2058312f3bcf45699a154a422ba5b605', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:32:20.688917 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:32:20.689209 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:32:20.689464 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] PATH_INFO: `/v3/projects/75aecc7d0d61432ba06577458e59f757` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:32:20.690572 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75aecc7d0d61432ba06577458e59f757)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:32:20.692683 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:32:20.703574 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:32:20.808125 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75aecc7d0d61432ba06577458e59f757', 'request_id': 'req-01536fde-ebcb-4001-8923-51ed98052803'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.813524 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75aecc7d0d61432ba06577458e59f757', 'request_id': 'req-01536fde-ebcb-4001-8923-51ed98052803'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.819473 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75aecc7d0d61432ba06577458e59f757', 'request_id': 'req-01536fde-ebcb-4001-8923-51ed98052803'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.904417 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] The token cache is being invalidate because project 75aecc7d0d61432ba06577458e59f757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 16:32:20.904624 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.905238 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-01536fde-ebcb-4001-8923-51ed98052803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 16:32:20.906988 dv-cinder-856259-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1493/2953] 10.222.0.23 () {58 vars in 1233 bytes} [Thu Sep 8 16:32:20 2022] DELETE /identity/v3/projects/75aecc7d0d61432ba06577458e59f757 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 16:32:30.354940 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:32:31.015823 dv-cinder-856259-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:36:57.895880 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] Authenticating user token {{(pid=81696) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 16:36:57.897451 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:36:58.034586 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf711-846a-4f6f-b7c1-b126f462cb92 admin admin] Validating token access rules against request {{(pid=81696) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 16:36:58.091582 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce813d54-1e3b-43f3-b47c-4a820395ef8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e6c855e2692410d83c78cc95cb4f37e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daac4b88e8e447d2843ce79a4ca1ed4c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81696) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 16:36:58.092146 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce813d54-1e3b-43f3-b47c-4a820395ef8c service placement] REQUEST_METHOD: `GET` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 16:36:58.092423 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce813d54-1e3b-43f3-b47c-4a820395ef8c service placement] SCRIPT_NAME: `/identity` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 16:36:58.092692 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce813d54-1e3b-43f3-b47c-4a820395ef8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81696) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 16:36:58.094453 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.fernet_utils [None req-ce813d54-1e3b-43f3-b47c-4a820395ef8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81696) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 16:36:58.106553 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce813d54-1e3b-43f3-b47c-4a820395ef8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 16:36:58.108206 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce813d54-1e3b-43f3-b47c-4a820395ef8c service placement] RBAC: Authorization granted {{(pid=81696) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 16:36:58.118628 dv-cinder-856259-2-smb devstack@keystone.service[81696]: [pid: 81696|app: 0|req: 1461/2954] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Sep 8 16:36:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 16:37:08.113860 dv-cinder-856259-2-smb devstack@keystone.service[81696]: DEBUG dbcounter [-] [81696] Writing DB stats keystone:SELECT=89 {{(pid=81696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}